2024-08-17T02:13:50.581 INFO:root:teuthology version: 1.2.0 2024-08-17T02:13:50.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:13:50.691 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858250' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:13:50.692 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:13:50.692 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:13:50.692 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:13:50.694 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:13:50.714 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:13:50.715 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:13:50.715 INFO:teuthology.packaging:ref: None 2024-08-17T02:13:50.715 INFO:teuthology.packaging:tag: None 2024-08-17T02:13:50.715 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:13:50.715 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:13:50.715 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:13:50.857 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375-g2577e813-1focal 2024-08-17T02:13:50.858 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:13:50.864 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:13:50.865 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:13:50.870 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:13:50.885 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:13:50.892 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:13:50.915 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:47.933349', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:13:50.935 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:47.935097', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:13:50.935 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:13:50.942 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:13:50.942 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:13:50.942 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:13:51.026 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3683347ac0>, signals=[15]) 2024-08-17T02:13:51.026 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:13:51.032 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:13:51.032 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:13:51.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:51.131 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:13:51.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:51.217 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:13:51.223 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-08-17T02:13:51.228 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-08-17T02:13:51.228 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-08-17T02:13:51.276 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Ubuntu" 2024-08-17T02:13:51.276 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:13:51.276 INFO:teuthology.orchestra.run.smithi019.stdout:ID=ubuntu 2024-08-17T02:13:51.276 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE=debian 2024-08-17T02:13:51.277 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:13:51.277 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="20.04" 2024-08-17T02:13:51.277 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:13:51.277 INFO:teuthology.orchestra.run.smithi019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:13:51.277 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:13:51.277 INFO:teuthology.orchestra.run.smithi019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:13:51.277 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_CODENAME=focal 2024-08-17T02:13:51.277 INFO:teuthology.orchestra.run.smithi019.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:13:51.278 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-08-17T02:13:51.298 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-08-17T02:13:51.304 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-08-17T02:13:51.304 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-08-17T02:13:51.351 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2024-08-17T02:13:51.351 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:13:51.351 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2024-08-17T02:13:51.351 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2024-08-17T02:13:51.351 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:13:51.351 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="20.04" 2024-08-17T02:13:51.351 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:13:51.351 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:13:51.351 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:13:51.352 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:13:51.352 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=focal 2024-08-17T02:13:51.352 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:13:51.352 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-08-17T02:13:51.373 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:13:51.382 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:13:51.483 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:13:51.483 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:13:51.485 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:13:51.491 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:13:51.497 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:13:51.497 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:13:51.500 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:13:51.512 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:13:51.565 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:13:51.578 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:13:51.579 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-17T02:13:51.579 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:13:51.579 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:13:51.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:13:51.585 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-08-17T02:13:51.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:13:51.586 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-08-17T02:13:51.592 INFO:teuthology.orchestra.run.smithi119.stdout:5.4.0-124-generic 2024-08-17T02:13:51.593 INFO:teuthology.orchestra.run.smithi019.stdout:5.4.0-124-generic 2024-08-17T02:13:51.593 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.4.0-124-generic 2024-08-17T02:13:51.593 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get clean 2024-08-17T02:13:51.593 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.4.0-124-generic 2024-08-17T02:13:51.593 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get clean 2024-08-17T02:13:51.673 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-08-17T02:13:51.719 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2024-08-17T02:13:51.825 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:13:51.887 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:13:51.893 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:13:51.945 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:13:51.958 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:13:51.995 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:13:52.028 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:13:52.125 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:13:52.259 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:13:52.261 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:13:52.264 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:13:52.264 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:13:52.265 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:13:52.272 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:13:52.285 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:13:52.288 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:13:52.288 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:13:52.294 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:13:52.299 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:13:52.300 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:13:52.313 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:13:52.314 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:13:52.314 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:13:52.314 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:13:52.381 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:13:52.396 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:13:52.410 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:13:52.413 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:13:52.414 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:13:52.439 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:13:52.439 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:13:52.442 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:13:52.442 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:13:52.448 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:13:52.458 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:13:52.460 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:13:52.461 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:13:52.461 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:13:52.462 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:13:52.462 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:13:52.464 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:13:52.464 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:13:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:13:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:13:52.495 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:13:52.495 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:13:52.522 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:13:52.597 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:13:52.904 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:13:52.931 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:13:52.932 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:13:52.945 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:13:52.945 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:13:53.035 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:13:53.036 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:13:53.052 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:13:53.052 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:13:53.090 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:13:53.109 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:13:53.117 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:13:53.117 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:13:53.118 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:13:53.123 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:13:53.138 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:13:53.139 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:13:53.139 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:13:53.150 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:13:53.151 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:13:53.151 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:13:53.152 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:13:53.232 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:13:53.234 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:13:53.234 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:13:53.235 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:13:53.236 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:13:53.240 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:13:53.240 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:13:53.262 INFO:teuthology.orchestra.run.smithi019.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:13:53.292 INFO:teuthology.orchestra.run.smithi019.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:13:53.295 INFO:teuthology.orchestra.run.smithi019.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:13:53.296 INFO:teuthology.orchestra.run.smithi019.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:13:53.296 INFO:teuthology.orchestra.run.smithi019.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:13:53.296 INFO:teuthology.orchestra.run.smithi019.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:13:53.373 INFO:teuthology.orchestra.run.smithi019.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:13:56.622 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 21.4 MB in 3s (7,280 kB/s) 2024-08-17T02:13:56.874 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 21.4 MB in 3s (6,884 kB/s) 2024-08-17T02:13:58.115 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-08-17T02:13:58.141 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:13:58.229 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-08-17T02:13:58.445 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-08-17T02:13:58.445 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-08-17T02:13:58.625 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-08-17T02:13:58.645 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-08-17T02:13:58.645 INFO:teuthology.orchestra.run.smithi119.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:13:58.645 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:13:58.646 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:13:58.647 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-08-17T02:13:58.647 INFO:teuthology.orchestra.run.smithi119.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:13:58.647 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2024-08-17T02:13:58.647 INFO:teuthology.orchestra.run.smithi119.stdout: thermald 2024-08-17T02:13:58.651 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:13:58.703 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-08-17T02:13:58.703 INFO:teuthology.orchestra.run.smithi119.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:13:58.703 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:13:58.704 INFO:teuthology.orchestra.run.smithi119.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:13:58.705 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2024-08-17T02:13:58.706 INFO:teuthology.orchestra.run.smithi119.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:13:58.730 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-08-17T02:13:58.775 INFO:teuthology.orchestra.run.smithi119.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:13:58.775 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:13:58.775 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:13:58.775 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:13:58.952 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-08-17T02:13:58.953 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-08-17T02:13:59.171 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2024-08-17T02:13:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:13:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:13:59.171 INFO:teuthology.orchestra.run.smithi019.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:13:59.172 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2024-08-17T02:13:59.172 INFO:teuthology.orchestra.run.smithi019.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:13:59.173 INFO:teuthology.orchestra.run.smithi019.stdout:Recommended packages: 2024-08-17T02:13:59.173 INFO:teuthology.orchestra.run.smithi019.stdout: thermald 2024-08-17T02:13:59.188 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:13:59.230 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2024-08-17T02:13:59.230 INFO:teuthology.orchestra.run.smithi019.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:13:59.231 INFO:teuthology.orchestra.run.smithi019.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:13:59.231 INFO:teuthology.orchestra.run.smithi019.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:13:59.232 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages will be upgraded: 2024-08-17T02:13:59.233 INFO:teuthology.orchestra.run.smithi019.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:13:59.287 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:13:59.299 INFO:teuthology.orchestra.run.smithi019.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:13:59.299 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:13:59.299 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:13:59.299 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:13:59.765 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:13:59.893 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:13:59.904 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:13:59.904 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:13:59.905 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:14:00.019 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:14:00.031 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:14:00.451 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:14:00.452 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:14:00.452 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:14:00.549 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:14:00.560 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:14:00.711 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 77.2 MB in 1s (58.6 MB/s) 2024-08-17T02:14:00.898 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:14:01.260 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 77.2 MB in 1s (58.5 MB/s) 2024-08-17T02:14:01.443 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:14:02.626 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:14:02.631 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:02.728 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:03.188 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:14:03.193 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:03.307 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:04.645 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:14:04.659 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:04.763 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:05.340 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:14:05.357 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:05.464 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:14:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:06.543 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:14:06.556 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:06.614 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:11.019 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:14:11.145 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:14:11.396 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:14:11.470 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:14:11.539 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:14:11.624 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:14:11.881 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:14:11.960 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:14:11.975 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:14:12.018 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:14:12.034 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:14:12.354 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:14:12.371 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:14:12.412 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:14:17.374 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:14:17.397 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:17.441 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:18.198 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:14:18.220 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:14:18.273 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:20.097 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:14:20.225 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:14:20.711 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:14:20.838 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:21.061 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:14:21.215 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:14:21.558 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:14:21.678 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:22.050 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:22.914 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:23.219 INFO:teuthology.orchestra.run.smithi119.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:23.219 INFO:teuthology.orchestra.run.smithi119.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:23.361 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:23.487 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:24.476 INFO:teuthology.orchestra.run.smithi019.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:24.476 INFO:teuthology.orchestra.run.smithi019.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:24.608 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:24.663 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:14:24.734 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:24.789 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:14:24.915 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:14:25.067 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:25.138 INFO:teuthology.orchestra.run.smithi119.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:14:25.138 INFO:teuthology.orchestra.run.smithi119.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:26.002 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:14:26.128 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:14:26.255 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:14:26.406 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:14:26.473 INFO:teuthology.orchestra.run.smithi019.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:14:26.473 INFO:teuthology.orchestra.run.smithi019.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi119.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi119.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi119.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi119.stdout:Generating grub configuration file ... 2024-08-17T02:14:48.112 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:48.133 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:48.527 INFO:teuthology.orchestra.run.smithi119.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:14:48.537 INFO:teuthology.orchestra.run.smithi119.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:14:48.757 INFO:teuthology.orchestra.run.smithi019.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:14:48.757 INFO:teuthology.orchestra.run.smithi019.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:14:48.767 INFO:teuthology.orchestra.run.smithi019.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:14:48.816 INFO:teuthology.orchestra.run.smithi019.stdout:Generating grub configuration file ... 2024-08-17T02:14:49.117 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:49.146 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:49.518 INFO:teuthology.orchestra.run.smithi019.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:14:49.529 INFO:teuthology.orchestra.run.smithi019.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:14:50.659 INFO:teuthology.orchestra.run.smithi119.stdout:done 2024-08-17T02:14:51.067 DEBUG:teuthology.orchestra.run.smithi119:> dpkg -s linux-image-generic 2024-08-17T02:14:51.108 INFO:teuthology.orchestra.run.smithi119.stdout:Package: linux-image-generic 2024-08-17T02:14:51.108 INFO:teuthology.orchestra.run.smithi119.stdout:Status: install ok installed 2024-08-17T02:14:51.108 INFO:teuthology.orchestra.run.smithi119.stdout:Priority: optional 2024-08-17T02:14:51.108 INFO:teuthology.orchestra.run.smithi119.stdout:Section: kernel 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout:Installed-Size: 20 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: amd64 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout:Source: linux-meta 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout:Version: 5.4.0.192.190 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout:Recommends: thermald 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout:Description: Generic Linux kernel image 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:14:51.109 INFO:teuthology.orchestra.run.smithi119.stdout: available. 2024-08-17T02:14:51.109 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:14:51.110 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:14:51.110 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:14:51.110 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-08-17T02:14:51.110 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:14:51.110 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get clean 2024-08-17T02:14:51.195 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-08-17T02:14:51.326 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:14:51.333 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:14:51.334 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:14:51.350 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:14:51.795 INFO:teuthology.orchestra.run.smithi019.stdout:done 2024-08-17T02:14:52.243 DEBUG:teuthology.orchestra.run.smithi019:> dpkg -s linux-image-generic 2024-08-17T02:14:52.297 INFO:teuthology.orchestra.run.smithi019.stdout:Package: linux-image-generic 2024-08-17T02:14:52.297 INFO:teuthology.orchestra.run.smithi019.stdout:Status: install ok installed 2024-08-17T02:14:52.297 INFO:teuthology.orchestra.run.smithi019.stdout:Priority: optional 2024-08-17T02:14:52.297 INFO:teuthology.orchestra.run.smithi019.stdout:Section: kernel 2024-08-17T02:14:52.297 INFO:teuthology.orchestra.run.smithi019.stdout:Installed-Size: 20 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: amd64 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:Source: linux-meta 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:Version: 5.4.0.192.190 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:Recommends: thermald 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:Description: Generic Linux kernel image 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:14:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: available. 2024-08-17T02:14:52.298 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:14:52.299 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:14:52.299 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:14:52.299 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-17T02:14:52.299 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:14:52.299 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get clean 2024-08-17T02:14:52.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2024-08-17T02:14:52.520 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:14:52.526 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:14:52.543 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:14:52.637 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:14:53.178 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-08-17T02:14:53.205 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:14:53.276 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-08-17T02:14:53.467 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-08-17T02:14:53.468 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-08-17T02:14:53.698 INFO:teuthology.orchestra.run.smithi119.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:14:53.698 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:14:53.700 DEBUG:teuthology.orchestra.run.smithi119:> dpkg -s linux-image-generic 2024-08-17T02:14:53.721 INFO:teuthology.orchestra.run.smithi119.stdout:Package: linux-image-generic 2024-08-17T02:14:53.721 INFO:teuthology.orchestra.run.smithi119.stdout:Status: install ok installed 2024-08-17T02:14:53.721 INFO:teuthology.orchestra.run.smithi119.stdout:Priority: optional 2024-08-17T02:14:53.721 INFO:teuthology.orchestra.run.smithi119.stdout:Section: kernel 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout:Installed-Size: 20 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: amd64 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout:Source: linux-meta 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout:Version: 5.4.0.192.190 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout:Recommends: thermald 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout:Description: Generic Linux kernel image 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:14:53.722 INFO:teuthology.orchestra.run.smithi119.stdout: available. 2024-08-17T02:14:53.723 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-08-17T02:14:53.729 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.w4uHEpKAZG 2024-08-17T02:14:53.729 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub/grub.cfg /tmp/tmp.w4uHEpKAZG 2024-08-17T02:14:53.788 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.w4uHEpKAZG 2024-08-17T02:14:53.834 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.w4uHEpKAZG is 9KB 2024-08-17T02:14:53.849 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.w4uHEpKAZG 2024-08-17T02:14:53.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:14:53.910 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:14:53.910 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:14:53.910 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:14:53.937 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:14:53.937 DEBUG:teuthology.orchestra.run.smithi119:> sudo update-grub 2024-08-17T02:14:54.443 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-08-17T02:14:54.468 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:14:54.539 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-08-17T02:14:54.761 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-08-17T02:14:54.761 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-08-17T02:14:55.015 INFO:teuthology.orchestra.run.smithi019.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:14:55.015 INFO:teuthology.orchestra.run.smithi019.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:14:55.017 DEBUG:teuthology.orchestra.run.smithi019:> dpkg -s linux-image-generic 2024-08-17T02:14:55.040 INFO:teuthology.orchestra.run.smithi019.stdout:Package: linux-image-generic 2024-08-17T02:14:55.040 INFO:teuthology.orchestra.run.smithi019.stdout:Status: install ok installed 2024-08-17T02:14:55.040 INFO:teuthology.orchestra.run.smithi019.stdout:Priority: optional 2024-08-17T02:14:55.040 INFO:teuthology.orchestra.run.smithi019.stdout:Section: kernel 2024-08-17T02:14:55.040 INFO:teuthology.orchestra.run.smithi019.stdout:Installed-Size: 20 2024-08-17T02:14:55.040 INFO:teuthology.orchestra.run.smithi019.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:14:55.040 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: amd64 2024-08-17T02:14:55.041 INFO:teuthology.orchestra.run.smithi019.stdout:Source: linux-meta 2024-08-17T02:14:55.041 INFO:teuthology.orchestra.run.smithi019.stdout:Version: 5.4.0.192.190 2024-08-17T02:14:55.041 INFO:teuthology.orchestra.run.smithi019.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:14:55.041 INFO:teuthology.orchestra.run.smithi019.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:14:55.041 INFO:teuthology.orchestra.run.smithi019.stdout:Recommends: thermald 2024-08-17T02:14:55.041 INFO:teuthology.orchestra.run.smithi019.stdout:Description: Generic Linux kernel image 2024-08-17T02:14:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:14:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: available. 2024-08-17T02:14:55.041 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-08-17T02:14:55.045 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.0mlIRARkAH 2024-08-17T02:14:55.046 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub/grub.cfg /tmp/tmp.0mlIRARkAH 2024-08-17T02:14:55.056 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.0mlIRARkAH 2024-08-17T02:14:55.089 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.0mlIRARkAH is 9KB 2024-08-17T02:14:55.102 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.0mlIRARkAH 2024-08-17T02:14:55.109 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:14:55.166 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:14:55.166 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:14:55.166 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:14:55.203 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:14:55.203 DEBUG:teuthology.orchestra.run.smithi019:> sudo update-grub 2024-08-17T02:14:55.294 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:14:55.306 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:14:55.317 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-08-17T02:14:55.573 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:55.584 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:55.928 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:14:55.940 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:14:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:14:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:14:56.665 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-08-17T02:14:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:14:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:14:56.989 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-08-17T02:14:56.991 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2024-08-17T02:14:57.249 INFO:teuthology.orchestra.run.smithi019.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:14:57.260 INFO:teuthology.orchestra.run.smithi019.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:14:58.361 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-08-17T02:14:58.363 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-08-17T02:15:27.022 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-17T02:15:27.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-17T02:15:27.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:28.366 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-17T02:15:28.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-08-17T02:15:28.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:45.375 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-08-17T02:15:46.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-08-17T02:15:54.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-17T02:15:54.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:55.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-08-17T02:15:55.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:57.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-08-17T02:16:09.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-17T02:16:09.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:27.875 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-08-17T02:16:42.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-17T02:16:42.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:43.140 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-08-17T02:16:43.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-17T02:16:43.681 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-192-generic"... 2024-08-17T02:16:43.681 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-08-17T02:16:43.687 INFO:teuthology.orchestra.run.smithi119.stdout:5.4.0-192-generic 2024-08-17T02:16:43.688 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:16:43.688 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:16:43.688 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:16:44.689 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-17T02:16:44.689 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-08-17T02:16:44.811 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:55.917 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:17:07.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-08-17T02:17:07.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:08.080 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-08-17T02:17:08.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-08-17T02:17:08.665 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-192-generic"... 2024-08-17T02:17:08.666 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-08-17T02:17:08.672 INFO:teuthology.orchestra.run.smithi019.stdout:5.4.0-192-generic 2024-08-17T02:17:08.673 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:17:08.673 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:17:08.673 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:17:09.674 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-17T02:17:09.674 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:17:09.780 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2024-08-17T02:17:09.804 DEBUG:teuthology.parallel:result is None 2024-08-17T02:17:09.805 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:17:09.812 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:17:09.813 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:17:09.815 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:17:09.822 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:17:09.837 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:17:09.843 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:17:09.844 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:17:09.847 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:17:09.877 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:17:09.883 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:17:09.884 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:17:09.904 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:17:09.934 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:17:09.942 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:17:09.945 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:17:09.953 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:17:09.955 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:17:09.962 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:17:09.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:17:09.964 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:17:09.978 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:17:09.987 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:17:09.987 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:17:09.989 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:17:09.996 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:17:10.045 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:17:10.051 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:17:10.051 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:17:10.116 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:17:10.123 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:17:10.130 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:17:10.130 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:17:10.154 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-08-17T02:17:10.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-08-17T02:17:10.206 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:17:10.214 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:17:10.214 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:17:10.225 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:17:10.233 DEBUG:teuthology.task.selinux:Excluding smithi019: OS 'ubuntu' does not support SELinux 2024-08-17T02:17:10.233 DEBUG:teuthology.task.selinux:Excluding smithi119: OS 'ubuntu' does not support SELinux 2024-08-17T02:17:10.233 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:17:10.234 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-17T02:17:10.234 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:17:10.234 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:17:10.245 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:17:10.257 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:17:10.258 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:22:46.140 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2024-08-17T02:22:46.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-08-17T02:22:46.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:22:46.245 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-08-17T02:22:46.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-08-17T02:22:46.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-17T02:22:46.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:22:46.464 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-08-17T02:22:46.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-08-17T02:22:46.588 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:22:46.599 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:22:46.599 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:22:46.600 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:22:46.602 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:22:46.602 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:22:46.636 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:22:46.636 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: Command line: ntpd -gq 2024-08-17T02:22:46.637 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: proto: precision = 0.046 usec (-24) 2024-08-17T02:22:46.637 INFO:teuthology.orchestra.run.smithi019.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:22:46.637 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:22:46.637 INFO:teuthology.orchestra.run.smithi019.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:22:46.638 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:22:46.639 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:22:46.639 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:22:46.639 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:22:46.639 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: Listen normally on 3 ens1f0 172.21.15.19:123 2024-08-17T02:22:46.639 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: Listen normally on 4 lo [::1]:123 2024-08-17T02:22:46.639 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:161e%4]:123 2024-08-17T02:22:46.639 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:46 ntpd[13549]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:22:46.640 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:22:46.640 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: Command line: ntpd -gq 2024-08-17T02:22:46.640 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: proto: precision = 0.064 usec (-24) 2024-08-17T02:22:46.640 INFO:teuthology.orchestra.run.smithi119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:22:46.640 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:22:46.641 INFO:teuthology.orchestra.run.smithi119.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:22:46.642 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:22:46.642 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:22:46.642 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:22:46.642 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:22:46.642 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: Listen normally on 3 enp3s0f1 172.21.15.119:123 2024-08-17T02:22:46.642 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: Listen normally on 4 lo [::1]:123 2024-08-17T02:22:46.642 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5ef%5]:123 2024-08-17T02:22:46.642 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:46 ntpd[13641]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:22:48.637 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:48 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:48.637 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:48 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:48.637 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:48 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:48.637 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:48 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:48.637 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:48 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:48.637 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:48 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:48.638 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:48 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:48.638 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:48 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:48.638 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:48 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:48.638 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:48 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:48.638 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:48 ntpd[13641]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:48.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:48 ntpd[13641]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:49.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:49 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:49.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:49 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:49.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:49 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:49.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:49 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:49.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:49 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:49.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:49 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:49.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:49 ntpd[13641]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:49.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:49 ntpd[13641]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:50.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:50.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:50.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:50.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:50.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:50.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:50.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:50.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:50.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:50.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:50 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:50.641 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:50 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:50.641 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:50 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:50.641 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:50 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:50.641 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:50 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:50.641 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:50 ntpd[13641]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:50.641 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:50 ntpd[13641]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:51.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:51.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:51.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:51.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:51.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:51.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:51.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:51.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:51.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:51.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:51.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:51.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:51 ntpd[13641]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:52.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:52 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:52.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:52 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:52.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:52 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:52.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:52 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:52.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:52 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:52.641 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:52 ntpd[13641]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:52.641 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:52 ntpd[13641]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:53.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:53.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:53.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:53.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:53.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:53.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:53.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:53.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:53.639 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:53.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:53.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:53.640 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:53 ntpd[13641]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:54.639 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stdout:17 Aug 02:22:54 ntpd[13549]: ntpd: time slew +0.002434 s 2024-08-17T02:22:54.640 INFO:teuthology.orchestra.run.smithi019.stdout:ntpd: time slew +0.002434s 2024-08-17T02:22:54.641 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:22:54.641 INFO:teuthology.orchestra.run.smithi019.stderr:17 Aug 02:22:54 ntpd[13549]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:22:54.642 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:54 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:54.642 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:54 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:54.642 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:54 ntpd[13641]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:22:54.642 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:54 ntpd[13641]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:22:54.642 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:54 ntpd[13641]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:22:54.642 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:54 ntpd[13641]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:22:54.642 INFO:teuthology.orchestra.run.smithi119.stdout:17 Aug 02:22:54 ntpd[13641]: ntpd: time slew -0.000278 s 2024-08-17T02:22:54.643 INFO:teuthology.orchestra.run.smithi119.stdout:ntpd: time slew -0.000278s 2024-08-17T02:22:54.643 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:54 ntpd[13641]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:22:54.643 INFO:teuthology.orchestra.run.smithi119.stderr:17 Aug 02:22:54 ntpd[13641]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:22:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:22:54.703 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-08-17T02:22:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:54.703 INFO:teuthology.orchestra.run.smithi119.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:54.704 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:22:54.705 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================== 2024-08-17T02:22:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:22:54.706 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:22:54.715 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:22:54.715 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:22:54.715 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:22:54.715 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:22:54.721 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:22:54.721 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:22:54.722 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-key list | grep Ceph 2024-08-17T02:22:54.722 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-key list | grep Ceph 2024-08-17T02:22:54.821 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:22:54.824 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:22:54.881 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:22:54.881 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:22:54.882 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:22:54.882 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:22:54.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:54.887 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:22:54.887 INFO:teuthology.orchestra.run.smithi019.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:22:54.888 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:22:54.888 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:22:54.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:55.032 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:22:55.033 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:55.044 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:22:55.044 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:55.148 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:22:55.148 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:22:55.157 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:22:55.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:22:55.165 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-08-17T02:22:55.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo apt-get update 2024-08-17T02:22:55.331 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:22:55.332 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:22:55.366 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:22:55.367 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:22:55.388 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:22:55.388 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:22:55.410 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:22:55.412 INFO:teuthology.orchestra.run.smithi019.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:22:55.429 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:22:55.430 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:22:55.432 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:22:55.433 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:22:55.465 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:22:55.465 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:22:55.512 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:22:55.512 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:22:55.593 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:22:55.594 INFO:teuthology.orchestra.run.smithi019.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:22:55.988 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 28.5 kB in 1s (43.6 kB/s) 2024-08-17T02:22:56.018 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 28.5 kB in 1s (41.9 kB/s) 2024-08-17T02:22:57.128 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-08-17T02:22:57.153 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:57.209 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-08-17T02:22:57.224 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-08-17T02:22:57.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:22:57.313 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-08-17T02:22:57.438 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-08-17T02:22:57.439 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-08-17T02:22:57.536 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-08-17T02:22:57.536 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-08-17T02:22:57.627 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:22:57.628 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:22:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:22:57.628 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-08-17T02:22:57.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:22:57.628 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:22:57.629 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:22:57.629 INFO:teuthology.orchestra.run.smithi119.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:22:57.629 INFO:teuthology.orchestra.run.smithi119.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:22:57.629 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:57.630 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:57.631 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:57.631 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:57.631 INFO:teuthology.orchestra.run.smithi119.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:22:57.631 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-08-17T02:22:57.631 INFO:teuthology.orchestra.run.smithi119.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:22:57.631 INFO:teuthology.orchestra.run.smithi119.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:22:57.631 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:22:57.631 INFO:teuthology.orchestra.run.smithi119.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:22:57.632 INFO:teuthology.orchestra.run.smithi119.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:22:57.632 INFO:teuthology.orchestra.run.smithi119.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:22:57.632 INFO:teuthology.orchestra.run.smithi119.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:22:57.632 INFO:teuthology.orchestra.run.smithi119.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:22:57.632 INFO:teuthology.orchestra.run.smithi119.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:22:57.632 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2024-08-17T02:22:57.632 INFO:teuthology.orchestra.run.smithi119.stdout: btrfs-tools 2024-08-17T02:22:57.741 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:22:57.742 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:22:57.742 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:22:57.743 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2024-08-17T02:22:57.743 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:22:57.743 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:22:57.743 INFO:teuthology.orchestra.run.smithi019.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:22:57.743 INFO:teuthology.orchestra.run.smithi019.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:22:57.743 INFO:teuthology.orchestra.run.smithi019.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:22:57.744 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:22:57.745 INFO:teuthology.orchestra.run.smithi019.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:22:57.746 INFO:teuthology.orchestra.run.smithi019.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:22:57.746 INFO:teuthology.orchestra.run.smithi019.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:22:57.746 INFO:teuthology.orchestra.run.smithi019.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:22:57.746 INFO:teuthology.orchestra.run.smithi019.stdout:Recommended packages: 2024-08-17T02:22:57.746 INFO:teuthology.orchestra.run.smithi019.stdout: btrfs-tools 2024-08-17T02:22:57.752 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-08-17T02:22:57.752 INFO:teuthology.orchestra.run.smithi119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:22:57.752 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:22:57.752 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:22:57.752 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:22:57.753 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:57.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:57.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:22:57.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:22:57.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:57.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:57.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:57.755 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:57.755 INFO:teuthology.orchestra.run.smithi119.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:22:57.755 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2024-08-17T02:22:57.756 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 librbd1 2024-08-17T02:22:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:22:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 201 MB of archives. 2024-08-17T02:22:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:22:57.821 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:22:57.840 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:22:57.848 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:22:57.871 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2024-08-17T02:22:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:22:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:22:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:22:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:22:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:22:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:22:57.872 INFO:teuthology.orchestra.run.smithi019.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:22:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:22:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:22:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:22:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:22:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:22:57.873 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:22:57.874 INFO:teuthology.orchestra.run.smithi019.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:22:57.875 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:22:57.875 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages will be upgraded: 2024-08-17T02:22:57.875 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 librbd1 2024-08-17T02:22:57.902 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:22:57.904 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:22:57.905 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:22:57.914 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:22:57.917 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:22:57.935 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:22:57.936 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:22:57.939 INFO:teuthology.orchestra.run.smithi019.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:22:57.939 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 201 MB of archives. 2024-08-17T02:22:57.939 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:22:57.940 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:22:57.940 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:22:57.959 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:22:57.966 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:22:57.967 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:22:57.969 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:22:57.975 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:22:57.977 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:22:57.977 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:22:57.980 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:22:57.980 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:22:57.980 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:22:57.980 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:22:57.992 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:22:57.992 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:22:57.992 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:22:58.008 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:22:58.009 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:22:58.009 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:22:58.011 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:22:58.011 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:22:58.012 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:22:58.013 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:22:58.014 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:22:58.021 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:22:58.023 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:22:58.023 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:22:58.025 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:22:58.028 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:22:58.033 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:22:58.035 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:22:58.042 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:22:58.050 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:22:58.050 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:22:58.050 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:22:58.051 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:22:58.052 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:22:58.053 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:22:58.054 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:22:58.055 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:22:58.056 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:22:58.059 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:22:58.059 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:22:58.060 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:22:58.076 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:22:58.077 INFO:teuthology.orchestra.run.smithi119.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:22:58.077 INFO:teuthology.orchestra.run.smithi119.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:22:58.078 INFO:teuthology.orchestra.run.smithi119.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:22:58.088 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:22:58.090 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:22:58.093 INFO:teuthology.orchestra.run.smithi119.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:22:58.096 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:22:58.098 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:22:58.099 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:22:58.101 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:22:58.101 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:22:58.102 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:22:58.102 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:22:58.108 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:22:58.109 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:22:58.125 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:22:58.126 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:22:58.127 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:22:58.128 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:22:58.129 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:22:58.130 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:22:58.132 INFO:teuthology.orchestra.run.smithi019.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:22:58.133 INFO:teuthology.orchestra.run.smithi019.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:22:58.142 INFO:teuthology.orchestra.run.smithi019.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:22:58.144 INFO:teuthology.orchestra.run.smithi019.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:22:58.157 INFO:teuthology.orchestra.run.smithi119.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:22:58.159 INFO:teuthology.orchestra.run.smithi019.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:22:58.166 INFO:teuthology.orchestra.run.smithi019.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:22:58.167 INFO:teuthology.orchestra.run.smithi019.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:22:58.168 INFO:teuthology.orchestra.run.smithi019.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:22:58.169 INFO:teuthology.orchestra.run.smithi019.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:22:58.171 INFO:teuthology.orchestra.run.smithi019.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:22:58.174 INFO:teuthology.orchestra.run.smithi019.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:22:58.175 INFO:teuthology.orchestra.run.smithi019.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:22:58.176 INFO:teuthology.orchestra.run.smithi019.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:22:58.177 INFO:teuthology.orchestra.run.smithi019.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:22:58.193 INFO:teuthology.orchestra.run.smithi019.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi019.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:22:58.195 INFO:teuthology.orchestra.run.smithi019.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:22:58.196 INFO:teuthology.orchestra.run.smithi019.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:22:58.232 INFO:teuthology.orchestra.run.smithi119.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:22:58.232 INFO:teuthology.orchestra.run.smithi119.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:22:58.233 INFO:teuthology.orchestra.run.smithi119.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:22:58.243 INFO:teuthology.orchestra.run.smithi119.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:22:58.247 INFO:teuthology.orchestra.run.smithi019.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:22:58.248 INFO:teuthology.orchestra.run.smithi119.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:22:58.249 INFO:teuthology.orchestra.run.smithi119.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:22:58.249 INFO:teuthology.orchestra.run.smithi119.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:22:58.249 INFO:teuthology.orchestra.run.smithi119.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:22:58.250 INFO:teuthology.orchestra.run.smithi119.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:22:58.251 INFO:teuthology.orchestra.run.smithi119.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:22:58.251 INFO:teuthology.orchestra.run.smithi119.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:22:58.251 INFO:teuthology.orchestra.run.smithi119.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:22:58.251 INFO:teuthology.orchestra.run.smithi119.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:22:58.251 INFO:teuthology.orchestra.run.smithi119.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:22:58.252 INFO:teuthology.orchestra.run.smithi119.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:22:58.252 INFO:teuthology.orchestra.run.smithi119.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:22:58.253 INFO:teuthology.orchestra.run.smithi119.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:22:58.266 INFO:teuthology.orchestra.run.smithi119.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:22:58.269 INFO:teuthology.orchestra.run.smithi119.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:22:58.272 INFO:teuthology.orchestra.run.smithi119.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:22:58.274 INFO:teuthology.orchestra.run.smithi119.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:22:58.277 INFO:teuthology.orchestra.run.smithi119.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:22:58.278 INFO:teuthology.orchestra.run.smithi119.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:22:58.284 INFO:teuthology.orchestra.run.smithi019.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:22:58.285 INFO:teuthology.orchestra.run.smithi119.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:22:58.287 INFO:teuthology.orchestra.run.smithi119.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:22:58.287 INFO:teuthology.orchestra.run.smithi119.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:22:58.300 INFO:teuthology.orchestra.run.smithi019.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:22:58.301 INFO:teuthology.orchestra.run.smithi019.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:22:58.303 INFO:teuthology.orchestra.run.smithi119.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:22:58.305 INFO:teuthology.orchestra.run.smithi119.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:22:58.315 INFO:teuthology.orchestra.run.smithi019.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:22:58.315 INFO:teuthology.orchestra.run.smithi019.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:22:58.341 INFO:teuthology.orchestra.run.smithi119.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:22:58.342 INFO:teuthology.orchestra.run.smithi119.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:22:58.342 INFO:teuthology.orchestra.run.smithi119.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:22:58.342 INFO:teuthology.orchestra.run.smithi119.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:22:58.342 INFO:teuthology.orchestra.run.smithi119.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:22:58.343 INFO:teuthology.orchestra.run.smithi119.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:22:58.354 INFO:teuthology.orchestra.run.smithi119.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:22:58.355 INFO:teuthology.orchestra.run.smithi119.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:22:58.355 INFO:teuthology.orchestra.run.smithi119.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:22:58.358 INFO:teuthology.orchestra.run.smithi119.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:22:58.371 INFO:teuthology.orchestra.run.smithi019.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:22:58.373 INFO:teuthology.orchestra.run.smithi019.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:22:58.374 INFO:teuthology.orchestra.run.smithi019.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:22:58.375 INFO:teuthology.orchestra.run.smithi019.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:22:58.375 INFO:teuthology.orchestra.run.smithi119.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:22:58.376 INFO:teuthology.orchestra.run.smithi019.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:22:58.378 INFO:teuthology.orchestra.run.smithi019.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:22:58.379 INFO:teuthology.orchestra.run.smithi019.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:22:58.380 INFO:teuthology.orchestra.run.smithi019.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:22:58.386 INFO:teuthology.orchestra.run.smithi019.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:22:58.390 INFO:teuthology.orchestra.run.smithi019.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:22:58.391 INFO:teuthology.orchestra.run.smithi019.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:22:58.406 INFO:teuthology.orchestra.run.smithi019.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:22:58.407 INFO:teuthology.orchestra.run.smithi019.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:22:58.411 INFO:teuthology.orchestra.run.smithi019.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:22:58.416 INFO:teuthology.orchestra.run.smithi019.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:22:58.417 INFO:teuthology.orchestra.run.smithi019.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:22:58.417 INFO:teuthology.orchestra.run.smithi019.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:22:58.431 INFO:teuthology.orchestra.run.smithi119.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:22:58.431 INFO:teuthology.orchestra.run.smithi119.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:22:58.434 INFO:teuthology.orchestra.run.smithi119.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:22:58.434 INFO:teuthology.orchestra.run.smithi119.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:22:58.435 INFO:teuthology.orchestra.run.smithi019.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:22:58.436 INFO:teuthology.orchestra.run.smithi119.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:22:58.438 INFO:teuthology.orchestra.run.smithi019.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:22:58.443 INFO:teuthology.orchestra.run.smithi119.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:22:58.451 INFO:teuthology.orchestra.run.smithi019.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:22:58.452 INFO:teuthology.orchestra.run.smithi019.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:22:58.456 INFO:teuthology.orchestra.run.smithi019.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:22:58.457 INFO:teuthology.orchestra.run.smithi019.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:22:58.464 INFO:teuthology.orchestra.run.smithi019.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:22:58.477 INFO:teuthology.orchestra.run.smithi019.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:22:58.478 INFO:teuthology.orchestra.run.smithi019.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:22:58.479 INFO:teuthology.orchestra.run.smithi019.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:22:58.479 INFO:teuthology.orchestra.run.smithi019.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:22:58.480 INFO:teuthology.orchestra.run.smithi019.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:22:58.480 INFO:teuthology.orchestra.run.smithi019.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:22:58.492 INFO:teuthology.orchestra.run.smithi019.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:22:58.492 INFO:teuthology.orchestra.run.smithi019.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:22:58.493 INFO:teuthology.orchestra.run.smithi019.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:22:58.497 INFO:teuthology.orchestra.run.smithi019.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:22:58.513 INFO:teuthology.orchestra.run.smithi019.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:22:58.514 INFO:teuthology.orchestra.run.smithi019.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:22:58.517 INFO:teuthology.orchestra.run.smithi019.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:22:58.518 INFO:teuthology.orchestra.run.smithi019.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:22:58.703 INFO:teuthology.orchestra.run.smithi019.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:22:58.704 INFO:teuthology.orchestra.run.smithi019.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:22:58.711 INFO:teuthology.orchestra.run.smithi019.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:22:59.229 INFO:teuthology.orchestra.run.smithi119.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:22:59.319 INFO:teuthology.orchestra.run.smithi119.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:22:59.323 INFO:teuthology.orchestra.run.smithi119.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:22:59.325 INFO:teuthology.orchestra.run.smithi119.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:22:59.373 INFO:teuthology.orchestra.run.smithi119.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:22:59.509 INFO:teuthology.orchestra.run.smithi119.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:22:59.783 INFO:teuthology.orchestra.run.smithi019.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:22:59.908 INFO:teuthology.orchestra.run.smithi019.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:22:59.911 INFO:teuthology.orchestra.run.smithi019.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:22:59.942 INFO:teuthology.orchestra.run.smithi019.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:22:59.999 INFO:teuthology.orchestra.run.smithi019.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:23:00.171 INFO:teuthology.orchestra.run.smithi019.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:23:00.242 INFO:teuthology.orchestra.run.smithi119.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:23:00.242 INFO:teuthology.orchestra.run.smithi119.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:23:00.251 INFO:teuthology.orchestra.run.smithi119.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:23:00.284 INFO:teuthology.orchestra.run.smithi119.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:23:00.285 INFO:teuthology.orchestra.run.smithi119.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:23:00.287 INFO:teuthology.orchestra.run.smithi119.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:23:00.515 INFO:teuthology.orchestra.run.smithi119.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:23:00.704 INFO:teuthology.orchestra.run.smithi119.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:23:00.704 INFO:teuthology.orchestra.run.smithi119.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:23:01.118 INFO:teuthology.orchestra.run.smithi019.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:23:01.118 INFO:teuthology.orchestra.run.smithi019.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:23:01.131 INFO:teuthology.orchestra.run.smithi019.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:23:01.181 INFO:teuthology.orchestra.run.smithi019.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:23:01.183 INFO:teuthology.orchestra.run.smithi019.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:23:01.185 INFO:teuthology.orchestra.run.smithi019.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:23:01.440 INFO:teuthology.orchestra.run.smithi019.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:23:01.762 INFO:teuthology.orchestra.run.smithi019.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:23:01.762 INFO:teuthology.orchestra.run.smithi019.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:23:02.447 INFO:teuthology.orchestra.run.smithi119.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:23:02.451 INFO:teuthology.orchestra.run.smithi119.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:23:02.454 INFO:teuthology.orchestra.run.smithi119.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:23:02.455 INFO:teuthology.orchestra.run.smithi119.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:23:02.455 INFO:teuthology.orchestra.run.smithi119.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:23:02.456 INFO:teuthology.orchestra.run.smithi119.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:23:02.941 INFO:teuthology.orchestra.run.smithi119.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:23:03.462 INFO:teuthology.orchestra.run.smithi019.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:23:03.467 INFO:teuthology.orchestra.run.smithi019.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:23:03.472 INFO:teuthology.orchestra.run.smithi019.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:23:03.472 INFO:teuthology.orchestra.run.smithi019.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:23:03.473 INFO:teuthology.orchestra.run.smithi019.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:23:03.474 INFO:teuthology.orchestra.run.smithi019.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:23:03.587 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 201 MB in 5s (38.8 MB/s) 2024-08-17T02:23:03.729 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:23:03.784 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:23:03.788 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:23:03.796 INFO:teuthology.orchestra.run.smithi019.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:23:03.818 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:23:04.146 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:23:04.163 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:23:04.204 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:23:04.452 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 201 MB in 6s (34.0 MB/s) 2024-08-17T02:23:04.524 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:23:04.542 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:23:04.582 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:23:04.640 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:23:04.696 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:23:04.701 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:23:04.738 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:23:04.951 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:23:04.967 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:23:05.052 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:23:05.057 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:23:05.078 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:23:05.116 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:23:05.381 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:05.427 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:23:05.444 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:23:05.481 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:23:05.485 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:23:05.829 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:23:05.850 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:23:05.930 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:23:06.184 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:06.286 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:06.343 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:23:06.409 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:23:07.014 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:23:07.031 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:07.072 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:07.130 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:07.238 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:23:07.400 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:23:07.416 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:07.449 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:07.810 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:23:07.827 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:07.868 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:07.917 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:23:07.935 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:07.975 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:08.129 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:23:08.145 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:08.188 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:08.344 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:23:08.360 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:08.402 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:08.490 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:23:08.507 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:08.573 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:08.697 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:23:08.713 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:08.747 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:08.851 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:23:08.868 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:23:08.901 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:23:08.974 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:23:08.992 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:09.058 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:09.154 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:23:09.170 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:09.212 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:09.385 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:23:09.401 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:09.443 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:09.582 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:23:09.597 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:23:09.632 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:23:09.796 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:23:09.813 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:23:09.855 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:23:10.010 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:23:10.025 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:23:10.068 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:23:10.076 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:23:10.092 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:10.134 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:10.421 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:23:10.439 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:23:10.479 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:23:10.520 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:23:10.539 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:23:10.578 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:23:10.866 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:23:10.881 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:23:10.924 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:23:10.931 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:23:10.948 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:23:10.989 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:23:11.243 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:23:11.259 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:23:11.318 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:23:11.343 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:23:11.362 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:23:11.401 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:23:11.704 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:23:11.723 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:23:11.762 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:23:11.805 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:23:11.823 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:23:11.874 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:12.115 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:23:12.132 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:23:12.173 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:23:12.391 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:23:12.410 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:23:12.450 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:12.635 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:23:12.654 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:23:12.722 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:12.845 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:23:12.860 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:23:12.903 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:13.188 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:23:13.207 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:23:13.246 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:13.314 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:23:13.331 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:23:13.372 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:23:13.616 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:23:13.635 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:23:13.674 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:23:13.750 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:23:13.767 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:13.800 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:14.027 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:23:14.044 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:23:14.077 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:23:14.438 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:23:14.454 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:14.496 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:14.711 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:23:14.728 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:14.769 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:15.147 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:23:15.164 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:23:15.205 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:23:15.274 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:23:15.293 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:15.332 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:15.533 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:23:15.549 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:15.583 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:15.710 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:23:15.726 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:23:15.760 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:23:15.994 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:23:16.012 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:23:16.014 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:16.030 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:16.061 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:16.071 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:16.566 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:23:16.584 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:16.624 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:18.625 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:23:18.643 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:18.693 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:19.188 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:23:19.204 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:19.256 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:19.596 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:23:19.615 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:23:19.654 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:23:20.091 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:23:20.108 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:23:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:23:20.158 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:23:20.176 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:23:20.225 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:23:20.485 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:23:20.501 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:23:20.543 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:23:20.579 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:23:20.598 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:23:20.637 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:23:20.804 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:23:20.822 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:20.862 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:20.973 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:23:20.989 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:23:21.027 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:23:21.242 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:23:21.259 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:23:21.259 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:21.276 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:23:21.292 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:21.317 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:23:21.662 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:23:21.677 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:23:21.689 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:23:21.705 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:23:21.720 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:23:21.747 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:23:22.041 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:23:22.057 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:23:22.081 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:23:22.099 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:23:22.101 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:23:22.139 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:23:22.461 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:23:22.478 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:23:22.484 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:23:22.500 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:23:22.520 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:23:22.542 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:23:22.822 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:23:22.840 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:23:22.871 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:23:22.882 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:23:22.890 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:23:22.929 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:23:23.234 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:23:23.248 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:23:23.254 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:23:23.264 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:23:23.292 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:23:23.306 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:23:23.603 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:23:23.620 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:23:23.626 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:23:23.645 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:23:23.661 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:23:23.684 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:23:23.998 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:23:24.004 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:23:24.013 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:23:24.020 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:23:24.056 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:23:24.079 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:23:24.350 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:23:24.368 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:23:24.382 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:23:24.397 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:23:24.408 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:23:24.440 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:23:24.703 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:23:24.723 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:23:24.762 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:23:24.776 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:23:24.793 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:23:24.834 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:23:25.081 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:23:25.097 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:23:25.139 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:23:25.179 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:23:25.198 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:23:25.237 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:23:25.484 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:23:25.500 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:23:25.541 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:23:25.565 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:23:25.582 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:23:25.623 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:23:25.845 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:23:25.861 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:23:25.903 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:23:26.009 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:23:26.027 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:23:26.070 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:23:26.264 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:23:26.281 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:23:26.317 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:23:26.420 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:23:26.436 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:23:26.479 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:23:26.634 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:23:26.650 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:23:26.683 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:23:26.790 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:23:26.806 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:23:26.839 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:23:27.028 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:23:27.044 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:23:27.086 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:23:27.178 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:23:27.198 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:23:27.242 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:23:27.423 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:23:27.440 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:23:27.497 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:23:27.544 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:23:27.563 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:23:27.602 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:23:27.798 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:23:27.818 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:23:27.856 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:23:27.931 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:23:27.948 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:23:27.989 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:23:28.159 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:23:28.177 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:23:28.234 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:23:28.333 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:23:28.353 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:23:28.391 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:23:28.546 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:23:28.564 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:23:28.603 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:23:28.746 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:23:28.766 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:23:28.804 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:23:28.983 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:23:29.002 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:23:29.041 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:23:29.208 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:23:29.224 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:29.266 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:29.395 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:23:29.412 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:29.453 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:29.652 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:23:29.668 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:29.710 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:29.815 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:23:29.832 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:29.873 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:31.064 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:23:31.080 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:31.122 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:31.234 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:23:31.253 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:31.292 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:31.986 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:23:32.001 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:32.044 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:32.167 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:23:32.183 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:32.225 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:34.074 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph. 2024-08-17T02:23:34.091 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:34.133 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:34.361 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph. 2024-08-17T02:23:34.379 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:34.419 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:34.468 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:23:34.486 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:34.526 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:34.738 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:23:34.753 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:34.795 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:34.962 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:23:34.982 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:35.019 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:35.232 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:23:35.249 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:35.290 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:35.531 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:23:35.550 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:35.580 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:35.834 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:23:35.850 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:35.859 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:23:35.878 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:23:35.916 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:35.926 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:36.262 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:23:36.282 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:23:36.303 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:36.320 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:23:36.362 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:36.674 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:23:36.692 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:36.732 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:36.757 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:23:36.773 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:23:36.815 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:37.093 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:23:37.109 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:23:37.127 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:23:37.143 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:23:37.150 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:37.185 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:23:37.421 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:23:37.436 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:23:37.439 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:23:37.455 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:23:37.479 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:23:37.494 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:23:37.748 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:23:37.765 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:23:37.827 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:23:37.847 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:23:37.864 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:23:37.905 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:23:38.142 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:23:38.162 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:23:38.200 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:23:38.242 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:23:38.262 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:38.300 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:38.563 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:23:38.583 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:38.628 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:39.672 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:23:39.688 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:23:39.729 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:39.942 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:23:39.958 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:23:40.000 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:23:40.058 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:23:40.078 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:23:40.116 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:40.312 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:23:40.331 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:23:40.369 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:23:40.452 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:23:40.468 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:23:40.509 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:23:40.672 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:23:40.691 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:23:40.730 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:23:41.893 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:23:41.910 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:23:41.951 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:42.022 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:23:42.040 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:23:42.080 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:42.506 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:23:42.524 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:23:42.573 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:23:42.618 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:23:42.635 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:23:42.676 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:23:42.968 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:23:42.984 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:23:43.026 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:43.080 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:23:43.097 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:23:43.138 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:23:43.734 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:23:43.752 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:43.792 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:43.838 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:23:43.857 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:43.896 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:44.954 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:23:44.974 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:23:44.991 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:23:45.011 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:23:45.012 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:45.049 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:23:45.322 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:23:45.343 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:23:45.377 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:23:45.380 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:45.393 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:23:45.435 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:23:45.734 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:23:45.750 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:23:45.764 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:23:45.784 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:23:45.800 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:23:45.821 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:23:46.137 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:23:46.153 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:23:46.303 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:23:46.516 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:23:46.533 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:23:46.574 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:23:46.837 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:23:46.855 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:23:46.906 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:23:46.910 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:23:46.931 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:23:46.968 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:23:47.234 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:23:47.254 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:23:47.297 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:23:47.314 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:23:47.317 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:23:47.355 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:23:47.620 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:23:47.637 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:23:47.678 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:23:47.691 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:23:47.709 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:23:47.749 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:23:48.117 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:23:48.134 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:23:48.190 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:23:48.200 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:23:48.206 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:23:48.248 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:23:48.512 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:23:48.529 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:23:48.544 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:23:48.564 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:23:48.571 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:48.602 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:23:48.875 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:23:48.892 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:23:48.924 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:23:48.940 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:23:48.960 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:23:48.998 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:23:49.488 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:23:49.510 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:49.536 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:23:49.546 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:49.554 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:49.607 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:49.883 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:23:49.903 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:23:49.934 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:23:49.941 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:49.949 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:23:49.990 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:23:50.319 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:23:50.336 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:50.376 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:23:50.377 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:50.396 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:50.434 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:50.672 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package jq. 2024-08-17T02:23:50.690 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:50.704 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package jq. 2024-08-17T02:23:50.724 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:50.730 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:50.753 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:23:50.993 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package socat. 2024-08-17T02:23:51.012 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:23:51.028 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package socat. 2024-08-17T02:23:51.045 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:23:51.051 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:23:51.086 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:23:51.374 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:23:51.380 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:23:51.389 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:23:51.397 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:23:51.438 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:51.464 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:23:51.785 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:23:51.801 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:23:51.802 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:51.819 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:51.851 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:51.859 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:56.180 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:23:56.199 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:56.238 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:56.480 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:23:56.500 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:56.538 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:56.677 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:23:56.696 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:56.735 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:56.936 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:23:56.956 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:57.019 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:57.105 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:23:57.126 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:23:57.163 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:57.355 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:23:57.373 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:23:57.409 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:23:57.444 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:23:57.461 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:57.502 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:57.653 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:23:57.671 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:57.735 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:57.773 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:23:57.793 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:57.838 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:57.982 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:23:57.998 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:23:58.040 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:58.093 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:23:58.109 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:58.151 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:58.294 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:23:58.314 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:58.350 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:58.705 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:23:58.724 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:58.779 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:58.856 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:23:58.873 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:23:58.923 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:59.183 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:23:59.203 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:59.259 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:59.343 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:23:59.359 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:59.419 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:23:59.596 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:23:59.613 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:59.653 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:23:59.731 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:23:59.751 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:23:59.789 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:24:01.266 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:24:01.285 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:24:01.324 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:24:01.444 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:24:01.463 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:24:01.502 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:24:01.685 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:24:01.704 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:24:01.743 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:24:01.847 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:24:01.867 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:24:01.905 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:24:02.071 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:24:02.091 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:24:02.121 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:24:02.191 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:24:02.212 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:24:02.249 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:24:02.474 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:24:02.492 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:24:02.532 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:24:02.611 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:24:02.631 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:24:02.669 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:24:02.818 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:24:02.839 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:24:02.895 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:24:02.955 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:24:02.972 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:24:03.046 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:24:03.229 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:24:03.246 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:24:03.287 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:24:03.375 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:24:03.392 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:24:03.433 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:24:03.749 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:24:03.766 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:24:03.832 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:24:03.903 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:24:03.924 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:24:03.961 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:24:04.152 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:24:04.169 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:24:04.210 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:24:04.281 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:24:04.298 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:24:04.339 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:24:04.539 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:24:04.556 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:24:04.596 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:24:04.676 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:24:04.696 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:24:04.742 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:24:04.958 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:24:04.974 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:24:05.016 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:24:05.054 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:24:05.073 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:24:05.111 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:24:05.369 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:24:05.386 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:24:05.427 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:24:05.431 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:24:05.452 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:24:05.490 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:24:05.764 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:24:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:24:05.801 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:24:05.819 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:24:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:24:05.867 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:24:06.175 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:24:06.193 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:24:06.233 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:24:06.237 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:24:06.254 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:24:06.295 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:24:06.536 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:24:06.554 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:24:06.565 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:24:06.583 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:24:06.594 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:24:06.623 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:24:07.348 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:24:07.367 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:07.414 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:07.444 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:24:07.465 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:07.502 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.193 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:24:09.214 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:09.254 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.275 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:24:09.296 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:24:09.333 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:09.562 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:24:09.638 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:24:09.859 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:24:09.939 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:24:09.985 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:24:10.065 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:24:10.127 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:24:10.191 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:24:10.287 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:10.401 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:10.874 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user cephadm....done 2024-08-17T02:24:11.061 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:24:11.062 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user cephadm....done 2024-08-17T02:24:11.172 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:24:11.242 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:24:11.369 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:24:11.515 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:24:11.712 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:24:11.808 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:24:11.959 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:24:12.030 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:24:12.093 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:24:12.156 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:24:12.282 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:24:12.420 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:24:12.626 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:24:12.819 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:24:13.078 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:24:13.107 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:24:13.364 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:24:13.393 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:24:13.677 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:24:13.681 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:24:13.966 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:24:13.978 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:24:14.254 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:14.267 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:24:14.514 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:14.568 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:14.673 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:24:14.869 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:14.958 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:24:15.020 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:24:15.267 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:24:15.296 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:24:15.560 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:24:15.589 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:24:15.686 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:24:16.025 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:24:16.045 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:24:16.314 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:24:16.443 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:24:16.623 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:24:16.744 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:24:16.974 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:24:17.045 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:24:17.625 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:24:17.705 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:24:17.976 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:24:18.006 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:24:18.253 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:24:18.340 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:24:18.537 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:24:18.638 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:24:18.666 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:24:18.748 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:24:18.959 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:24:19.065 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:24:19.070 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:24:19.171 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:24:19.448 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:24:19.450 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:24:19.768 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:24:19.841 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:24:20.128 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:24:20.142 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:24:20.497 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:24:20.518 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:24:20.606 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:20.895 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:24:20.957 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:20.996 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:21.125 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:24:21.306 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:21.440 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:24:21.451 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:24:21.611 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:24:21.754 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:24:21.800 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:24:21.926 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:24:22.030 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:24:22.052 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:24:22.323 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:22.361 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:24:22.608 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:24:22.654 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:22.755 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:24:22.865 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:24:22.951 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:24:23.191 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:24:23.244 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:24:23.475 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:24:23.537 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:24:23.638 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:24:23.818 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:24:23.881 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:24:23.944 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:24:24.174 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:24:24.246 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:24:24.492 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:24:24.547 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:24:24.831 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:24:24.897 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:24:25.203 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:24:25.223 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:24:25.321 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:24:25.500 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:24:25.613 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:24:25.626 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:24:25.952 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:24:25.973 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:24:26.141 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:24:26.267 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:24:26.346 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:24:26.446 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:24:26.547 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:24:26.618 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:24:26.857 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:24:26.903 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:27.054 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:24:27.125 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:27.242 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:24:28.493 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:28.619 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:28.723 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:28.753 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:24:28.824 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:28.958 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:24:29.146 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:24:29.310 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:24:29.414 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:24:29.611 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:24:29.707 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:29.858 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:24:29.937 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:24:30.063 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:24:30.176 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:30.327 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:24:30.381 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:30.507 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:24:30.669 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:30.780 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:24:30.834 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:30.960 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:24:31.090 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:24:32.162 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:32.271 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:24:32.366 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:32.372 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:24:32.476 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:24:32.506 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:32.626 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:24:32.632 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:24:32.778 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:24:32.904 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:24:32.951 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:24:33.085 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:24:33.205 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:24:33.355 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:24:33.472 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:33.573 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:33.717 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:33.793 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:33.793 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:33.860 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:34.089 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:34.089 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:24:34.274 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:34.383 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:24:34.537 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:34.662 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:24:34.668 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:24:34.947 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:24:35.020 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:24:35.274 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:24:35.372 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:35.498 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:35.617 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:35.649 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:35.743 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:35.775 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:35.869 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:35.901 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:36.004 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:36.049 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:24:36.130 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:36.256 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:24:36.354 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:24:36.574 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:24:36.664 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:36.790 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:36.883 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:36.915 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:37.030 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:37.058 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:24:37.135 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:37.236 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:24:37.962 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:38.182 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:38.539 INFO:teuthology.orchestra.run.smithi119.stdout:Adding group ceph....done 2024-08-17T02:24:38.751 INFO:teuthology.orchestra.run.smithi019.stdout:Adding group ceph....done 2024-08-17T02:24:38.941 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user ceph....done 2024-08-17T02:24:39.092 INFO:teuthology.orchestra.run.smithi119.stdout:Setting system user ceph properties....done 2024-08-17T02:24:39.112 INFO:teuthology.orchestra.run.smithi119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:24:39.128 INFO:teuthology.orchestra.run.smithi019.stdout:Adding system user ceph....done 2024-08-17T02:24:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:24:39.329 INFO:teuthology.orchestra.run.smithi019.stdout:Setting system user ceph properties....done 2024-08-17T02:24:39.357 INFO:teuthology.orchestra.run.smithi019.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:24:39.566 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:24:39.846 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:24:39.996 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:40.235 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:40.236 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:40.308 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:40.541 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:40.541 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:40.656 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:40.782 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:40.992 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:41.046 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:41.046 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:41.102 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:41.353 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:41.353 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:41.701 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:42.004 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:42.077 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:42.418 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:42.511 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:42.750 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:42.750 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:42.872 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:43.188 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:43.230 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:43.230 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:43.600 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:43.600 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:43.700 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:43.932 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:43.933 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:44.081 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:44.392 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:44.637 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:44.637 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:44.884 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:44.884 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:45.092 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:45.201 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:45.328 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:45.346 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:45.454 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:45.571 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:45.571 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:45.596 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:45.828 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:45.829 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:46.023 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:46.165 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:46.291 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:46.407 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:46.451 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:46.508 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:46.578 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:46.667 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:24:46.729 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:46.794 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:24:46.946 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:24:46.997 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:47.231 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:24:49.879 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:24:50.194 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:24:50.473 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:50.475 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:24:50.557 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-08-17T02:24:50.776 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-08-17T02:24:50.777 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-08-17T02:24:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:24:50.807 DEBUG:teuthology.orchestra.run.smithi019:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:24:50.884 INFO:teuthology.orchestra.run.smithi019.stdout:Reading package lists... 2024-08-17T02:24:50.992 INFO:teuthology.orchestra.run.smithi119.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:24:50.992 INFO:teuthology.orchestra.run.smithi119.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:24:50.992 INFO:teuthology.orchestra.run.smithi119.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:24:50.993 INFO:teuthology.orchestra.run.smithi119.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:24:50.993 INFO:teuthology.orchestra.run.smithi119.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:24:50.993 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:24:50.994 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:24:50.994 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:24:50.994 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-08-17T02:24:50.995 INFO:teuthology.orchestra.run.smithi119.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:24:50.995 INFO:teuthology.orchestra.run.smithi119.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:24:50.995 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:24:50.995 INFO:teuthology.orchestra.run.smithi119.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:24:50.996 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-08-17T02:24:50.996 INFO:teuthology.orchestra.run.smithi119.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:24:50.996 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:24:51.047 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-08-17T02:24:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:24:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:24:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:24:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:24:51.049 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2024-08-17T02:24:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:24:51.108 INFO:teuthology.orchestra.run.smithi019.stdout:Building dependency tree... 2024-08-17T02:24:51.108 INFO:teuthology.orchestra.run.smithi019.stdout:Reading state information... 2024-08-17T02:24:51.234 INFO:teuthology.orchestra.run.smithi119.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:24:51.235 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:24:51.235 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:24:51.235 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:24:51.337 INFO:teuthology.orchestra.run.smithi019.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:24:51.337 INFO:teuthology.orchestra.run.smithi019.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:24:51.337 INFO:teuthology.orchestra.run.smithi019.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:24:51.337 INFO:teuthology.orchestra.run.smithi019.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:24:51.337 INFO:teuthology.orchestra.run.smithi019.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:24:51.337 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:24:51.338 INFO:teuthology.orchestra.run.smithi019.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:24:51.338 INFO:teuthology.orchestra.run.smithi019.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:24:51.338 INFO:teuthology.orchestra.run.smithi019.stdout:The following additional packages will be installed: 2024-08-17T02:24:51.339 INFO:teuthology.orchestra.run.smithi019.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:24:51.339 INFO:teuthology.orchestra.run.smithi019.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:24:51.339 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:24:51.339 INFO:teuthology.orchestra.run.smithi019.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:24:51.341 INFO:teuthology.orchestra.run.smithi019.stdout:Suggested packages: 2024-08-17T02:24:51.341 INFO:teuthology.orchestra.run.smithi019.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:24:51.341 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:24:51.394 INFO:teuthology.orchestra.run.smithi019.stdout:The following NEW packages will be installed: 2024-08-17T02:24:51.395 INFO:teuthology.orchestra.run.smithi019.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:24:51.395 INFO:teuthology.orchestra.run.smithi019.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:24:51.395 INFO:teuthology.orchestra.run.smithi019.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:24:51.396 INFO:teuthology.orchestra.run.smithi019.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:24:51.397 INFO:teuthology.orchestra.run.smithi019.stdout:The following packages will be upgraded: 2024-08-17T02:24:51.398 INFO:teuthology.orchestra.run.smithi019.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:24:51.582 INFO:teuthology.orchestra.run.smithi019.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:24:51.582 INFO:teuthology.orchestra.run.smithi019.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:24:51.582 INFO:teuthology.orchestra.run.smithi019.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:24:51.583 INFO:teuthology.orchestra.run.smithi019.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:24:51.850 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:24:51.851 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:24:51.852 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:24:51.865 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:24:51.867 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:24:51.964 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:24:51.967 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:24:51.974 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:24:51.978 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:24:51.979 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:24:52.012 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:24:52.014 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:24:52.017 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:24:52.018 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:24:52.093 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:24:52.094 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:24:52.103 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:24:52.119 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:24:52.119 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:24:52.159 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:24:52.175 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:24:52.196 INFO:teuthology.orchestra.run.smithi019.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:24:52.197 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:24:52.198 INFO:teuthology.orchestra.run.smithi019.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:24:52.199 INFO:teuthology.orchestra.run.smithi019.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:24:52.212 INFO:teuthology.orchestra.run.smithi019.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:24:52.214 INFO:teuthology.orchestra.run.smithi019.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:24:52.225 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:24:52.283 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:24:52.292 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:24:52.293 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:24:52.293 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:24:52.294 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:24:52.312 INFO:teuthology.orchestra.run.smithi019.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:24:52.314 INFO:teuthology.orchestra.run.smithi019.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:24:52.321 INFO:teuthology.orchestra.run.smithi019.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:24:52.326 INFO:teuthology.orchestra.run.smithi019.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:24:52.327 INFO:teuthology.orchestra.run.smithi019.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:24:52.359 INFO:teuthology.orchestra.run.smithi019.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:24:52.360 INFO:teuthology.orchestra.run.smithi019.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:24:52.364 INFO:teuthology.orchestra.run.smithi019.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:24:52.364 INFO:teuthology.orchestra.run.smithi019.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:24:52.440 INFO:teuthology.orchestra.run.smithi019.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:24:52.441 INFO:teuthology.orchestra.run.smithi019.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:24:52.450 INFO:teuthology.orchestra.run.smithi019.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:24:52.466 INFO:teuthology.orchestra.run.smithi019.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:24:52.466 INFO:teuthology.orchestra.run.smithi019.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:24:52.504 INFO:teuthology.orchestra.run.smithi019.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:24:52.521 INFO:teuthology.orchestra.run.smithi019.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:24:52.543 INFO:teuthology.orchestra.run.smithi019.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:24:52.571 INFO:teuthology.orchestra.run.smithi019.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:24:52.621 INFO:teuthology.orchestra.run.smithi119.stdout:Preconfiguring packages ... 2024-08-17T02:24:52.631 INFO:teuthology.orchestra.run.smithi019.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:24:52.638 INFO:teuthology.orchestra.run.smithi019.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:24:52.639 INFO:teuthology.orchestra.run.smithi019.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:24:52.640 INFO:teuthology.orchestra.run.smithi019.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:24:52.641 INFO:teuthology.orchestra.run.smithi019.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:24:52.762 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 10.4 MB in 1s (8,442 kB/s) 2024-08-17T02:24:52.979 INFO:teuthology.orchestra.run.smithi019.stdout:Preconfiguring packages ... 2024-08-17T02:24:53.042 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:53.046 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:53.123 INFO:teuthology.orchestra.run.smithi019.stdout:Fetched 10.4 MB in 1s (8,441 kB/s) 2024-08-17T02:24:53.219 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:53.434 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:53.439 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:53.753 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:54.384 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:54.994 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:55.788 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:55.793 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:55.925 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:56.357 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:56.453 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:56.458 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:56.523 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:56.591 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:56.876 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:57.039 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:24:57.205 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:24:57.343 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:57.348 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:57.481 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:57.534 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:24:57.971 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:57.992 INFO:teuthology.orchestra.run.smithi019.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:58.111 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:58.129 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:58.595 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:24:58.724 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:24:58.751 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:24:59.586 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:24:59.608 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:24:59.675 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:24:59.788 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:24:59.815 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:25:00.158 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package dump. 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:25:00.216 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:25:00.302 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:25:00.319 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:25:00.360 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:25:00.528 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package indent. 2024-08-17T02:25:00.547 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:25:00.586 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:25:00.730 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package dump. 2024-08-17T02:25:00.747 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:25:00.788 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:25:00.923 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:25:00.943 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:25:00.981 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:25:01.084 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package indent. 2024-08-17T02:25:01.101 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:25:01.142 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:25:01.335 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:25:01.392 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:25:01.470 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:25:01.489 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:25:01.528 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:25:01.662 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:25:01.680 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:25:01.754 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:25:01.873 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:25:01.890 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:25:01.931 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:25:02.090 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:25:02.108 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:02.173 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:25:02.234 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:25:02.251 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:25:02.292 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:25:02.451 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:25:02.468 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:02.509 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:25:02.645 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:25:02.665 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:02.703 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:25:02.862 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:25:02.880 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:02.929 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:25:02.998 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:25:03.017 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:03.056 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:25:03.299 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:25:03.319 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:25:03.357 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:25:03.384 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:25:03.402 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:03.442 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:25:03.710 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:25:03.726 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:25:03.768 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:25:03.820 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:25:03.838 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:25:03.887 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:25:04.171 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:25:04.189 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:04.198 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:25:04.217 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:25:04.229 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:25:04.256 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:25:04.590 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:25:04.607 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:04.648 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:25:04.869 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:25:04.886 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:04.927 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:25:05.263 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:25:05.283 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:05.286 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:25:05.307 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:25:05.321 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:25:05.361 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:25:05.574 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:25:05.591 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:25:05.632 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:25:05.873 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:25:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:25:05.931 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:25:06.094 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:25:06.111 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:25:06.143 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:25:06.293 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:25:06.312 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:06.361 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:25:06.547 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:25:06.563 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:25:06.615 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:25:06.999 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:25:07.016 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:25:07.057 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:25:07.202 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:25:07.219 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:25:07.285 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:25:07.612 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:25:07.629 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:25:07.695 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:25:07.809 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:25:07.827 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:25:07.891 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:25:08.436 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ppp. 2024-08-17T02:25:08.455 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:25:08.591 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package ppp. 2024-08-17T02:25:08.610 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:25:08.734 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:25:08.880 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:25:09.092 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:25:09.111 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:25:09.150 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:25:09.212 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:25:09.233 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:25:09.270 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:25:09.520 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:25:09.537 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:25:09.595 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:25:09.674 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:25:09.691 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:25:09.750 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:25:09.881 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:25:09.898 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:25:09.939 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:25:10.220 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:25:10.238 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:25:10.278 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:25:10.326 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:25:10.346 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:25:10.395 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:25:10.632 INFO:teuthology.orchestra.run.smithi019.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:25:10.653 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:25:10.700 INFO:teuthology.orchestra.run.smithi019.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:25:10.958 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:25:11.026 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:25:11.283 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:25:11.345 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:25:11.409 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:25:11.471 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:25:11.535 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:25:11.597 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:25:11.961 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:25:11.962 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:25:12.022 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:25:12.022 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:25:12.430 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:25:12.492 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:25:12.589 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:25:12.618 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:25:12.715 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:25:12.744 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:25:12.841 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:25:12.870 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:25:12.967 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:25:12.996 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:25:13.110 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:25:13.155 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:25:14.033 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:25:14.100 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:25:14.274 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:25:14.328 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:25:14.394 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:25:14.423 INFO:teuthology.orchestra.run.smithi019.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:25:14.476 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:25:14.487 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:25:14.602 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:25:14.647 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:25:14.728 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:25:14.773 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:25:14.879 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:25:14.899 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:25:15.067 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:25:15.182 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:25:15.202 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:25:15.333 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:25:15.378 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:25:15.459 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:25:15.487 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:25:15.627 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:25:15.655 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:25:15.790 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:25:15.795 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:25:16.494 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:16.494 INFO:teuthology.orchestra.run.smithi119.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:25:16.494 INFO:teuthology.orchestra.run.smithi119.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:25:16.494 INFO:teuthology.orchestra.run.smithi119.stdout:- enp3s0f1 2024-08-17T02:25:16.495 INFO:teuthology.orchestra.run.smithi119.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:25:16.495 INFO:teuthology.orchestra.run.smithi119.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:25:16.495 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:16.512 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:16.512 INFO:teuthology.orchestra.run.smithi019.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:25:16.512 INFO:teuthology.orchestra.run.smithi019.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:25:16.512 INFO:teuthology.orchestra.run.smithi019.stdout:- ens1f0 2024-08-17T02:25:16.512 INFO:teuthology.orchestra.run.smithi019.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:25:16.512 INFO:teuthology.orchestra.run.smithi019.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:25:16.512 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:16.653 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:25:16.686 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:25:16.965 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:25:17.017 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:25:17.440 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:25:17.555 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:25:17.898 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:25:18.035 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:25:18.066 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:25:18.169 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:25:18.209 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:25:18.318 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:25:18.328 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:25:18.419 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:25:18.454 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:25:18.562 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:25:18.580 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:25:18.715 INFO:teuthology.orchestra.run.smithi019.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:25:18.833 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:25:18.833 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:25:18.991 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:25:18.992 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:25:19.346 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:25:19.449 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:25:19.509 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:25:19.575 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:25:19.610 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:25:19.727 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:25:19.758 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:25:19.929 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:25:20.020 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:25:20.222 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:25:24.050 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:25:24.139 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:25:24.170 INFO:teuthology.orchestra.run.smithi019.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:25:24.239 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:25:25.012 INFO:teuthology.orchestra.run.smithi019.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:25:25.018 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:25.166 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:25:25.171 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:25.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:25:25.310 DEBUG:teuthology.orchestra.run.smithi019:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:25:25.336 INFO:teuthology.orchestra.run.smithi019.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:25:25.336 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:25:25.336 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:25:25.338 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:25:25.483 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:25:25.506 INFO:teuthology.orchestra.run.smithi119.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:25:25.506 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:25:25.506 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:25:25.508 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:25:25.508 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:25.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:25:25.525 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:25.525 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:25:25.562 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:25:25.563 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:25.563 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:25:25.583 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:25:25.598 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:25.598 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:25:25.613 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:25:25.628 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:25:25.629 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:25.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:25:25.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:25:25.702 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:25.702 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:25:25.718 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:25:25.778 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:25:25.779 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:25.779 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:25:25.795 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:25:25.806 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:25.806 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:25:25.821 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:25:25.836 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:25:25.914 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:25:25.915 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-08-17T02:25:25.917 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-08-17T02:25:25.932 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:25:25.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:25:25.934 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:25:25.991 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:25:25.991 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:25:25.993 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:25:26.012 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:25:26.013 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:25:26.013 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:25:26.013 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:26.013 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:25:26.018 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:26.056 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:26.056 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:25:26.063 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:26.105 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:25:26.105 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:25:26.105 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858250', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:25:26.106 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:25:26.108 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:25:26.113 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:25:26.115 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:25:26.172 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:26.172 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:25:26.179 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:25:26.179 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-08-17T02:25:26.230 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:25:26.230 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:26.230 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 345 Links: 1 2024-08-17T02:25:26.230 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:26.230 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-08-17 02:21:21.547343767 +0000 2024-08-17T02:25:26.230 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-08-17 02:21:21.543343860 +0000 2024-08-17T02:25:26.230 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-08-17 02:21:21.543343860 +0000 2024-08-17T02:25:26.230 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-08-17T02:25:26.231 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:25:26.241 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-08-17T02:25:26.241 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-08-17T02:25:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000431497 s, 1.2 MB/s 2024-08-17T02:25:26.243 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:25:26.250 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-08-17T02:25:26.297 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:25:26.297 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:26.297 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 349 Links: 1 2024-08-17T02:25:26.297 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:26.298 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-08-17 02:21:22.223328185 +0000 2024-08-17T02:25:26.298 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-08-17 02:21:22.007333164 +0000 2024-08-17T02:25:26.298 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-08-17 02:21:22.007333164 +0000 2024-08-17T02:25:26.298 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-08-17T02:25:26.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000442911 s, 1.2 MB/s 2024-08-17T02:25:26.312 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:25:26.321 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-08-17T02:25:26.373 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:25:26.374 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:26.374 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-08-17T02:25:26.374 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:26.374 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-08-17 02:21:22.651318321 +0000 2024-08-17T02:25:26.374 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-08-17 02:21:22.439323207 +0000 2024-08-17T02:25:26.374 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-08-17 02:21:22.439323207 +0000 2024-08-17T02:25:26.374 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-08-17T02:25:26.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:25:26.386 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-08-17T02:25:26.387 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-08-17T02:25:26.387 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000397541 s, 1.3 MB/s 2024-08-17T02:25:26.388 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:25:26.396 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-08-17T02:25:26.445 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:25:26.445 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:26.446 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 362 Links: 1 2024-08-17T02:25:26.446 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:26.446 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-08-17 02:21:22.867313341 +0000 2024-08-17T02:25:26.446 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-08-17 02:21:22.863313433 +0000 2024-08-17T02:25:26.446 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-08-17 02:21:22.863313433 +0000 2024-08-17T02:25:26.446 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-08-17T02:25:26.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:25:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-08-17T02:25:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-08-17T02:25:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000362141 s, 1.4 MB/s 2024-08-17T02:25:26.459 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:25:26.467 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:26.467 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:26.468 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:25:26.474 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:25:26.475 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-08-17T02:25:26.482 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:25:26.483 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:26.483 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-08-17T02:25:26.483 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:26.483 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-08-17 02:21:17.933338314 +0000 2024-08-17T02:25:26.483 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-08-17 02:21:17.725343098 +0000 2024-08-17T02:25:26.483 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-08-17 02:21:17.725343098 +0000 2024-08-17T02:25:26.483 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-08-17T02:25:26.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:25:26.492 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-08-17T02:25:26.492 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-08-17T02:25:26.492 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.0004284 s, 1.2 MB/s 2024-08-17T02:25:26.493 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:25:26.544 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-08-17T02:25:26.552 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:25:26.552 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:26.552 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 365 Links: 1 2024-08-17T02:25:26.552 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:26.552 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-08-17 02:21:18.337329019 +0000 2024-08-17T02:25:26.552 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-08-17 02:21:18.129333804 +0000 2024-08-17T02:25:26.552 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-08-17 02:21:18.129333804 +0000 2024-08-17T02:25:26.552 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-08-17T02:25:26.552 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:25:26.564 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-08-17T02:25:26.564 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-08-17T02:25:26.564 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000422645 s, 1.2 MB/s 2024-08-17T02:25:26.565 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:25:26.616 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-08-17T02:25:26.623 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:25:26.624 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:26.624 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-08-17T02:25:26.624 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:26.624 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-08-17 02:21:18.585323313 +0000 2024-08-17T02:25:26.624 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-08-17 02:21:18.581323405 +0000 2024-08-17T02:25:26.624 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-08-17 02:21:18.581323405 +0000 2024-08-17T02:25:26.624 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-08-17T02:25:26.624 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:25:26.635 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-08-17T02:25:26.635 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-08-17T02:25:26.636 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000392198 s, 1.3 MB/s 2024-08-17T02:25:26.637 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:25:26.688 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-08-17T02:25:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:25:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:26.696 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 6h/6d Inode: 376 Links: 1 2024-08-17T02:25:26.696 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:26.696 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-08-17 02:21:19.265307668 +0000 2024-08-17T02:25:26.696 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-08-17 02:21:19.029313098 +0000 2024-08-17T02:25:26.696 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-08-17 02:21:19.029313098 +0000 2024-08-17T02:25:26.696 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-08-17T02:25:26.696 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:25:26.706 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-08-17T02:25:26.706 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-08-17T02:25:26.706 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000366506 s, 1.4 MB/s 2024-08-17T02:25:26.707 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:25:26.756 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:26.757 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:25:26.757 INFO:tasks.ceph:Generating config... 2024-08-17T02:25:26.758 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:25:26.758 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:25:26.758 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:25:26.758 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:25:26.758 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:25:26.758 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:25:26.759 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:25:26.760 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:25:26.760 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:25:26.760 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:25:26.760 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:25:26.760 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:25:26.760 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:25:26.761 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:26.761 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:25:26.761 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:25:26.761 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:25:26.761 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:25:26.761 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:25:26.761 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:25:26.761 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:26.796 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:25:26.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:25:26.881 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:26.895 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '172.21.15.119'), ('mon.c', '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]')] 2024-08-17T02:25:26.896 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:25:26.897 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:26.897 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:25:26.903 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --add b 172.21.15.119 --addv c '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:26.940 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid 1a630ac0-5cc8-463b-a63c-db2f048e27a8 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = octopus 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 1a630ac0-5cc8-463b-a63c-db2f048e27a8 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2024-08-17T02:25:26.939272+0000 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-08-17T02:25:26.939272+0000 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 15 (octopus) 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-08-17T02:25:26.941 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:25:26.942 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:25:26.947 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1a630ac0-5cc8-463b-a63c-db2f048e27a8... 2024-08-17T02:25:26.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:26.992 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:27.020 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-08-17T02:25:27.020 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-08-17T02:25:27.020 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:27.020 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:27.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-08-17T02:25:27.022 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2024-08-17T02:25:27.023 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 1a630ac0-5cc8-463b-a63c-db2f048e27a8 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:27.024 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-08-17T02:25:27.025 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: bdev async discard = True 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: bdev enable discard = True 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = bitmap 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 1/20 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 1/20 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 4/10 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:27.026 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: debug finisher = 20 2024-08-17T02:25:27.027 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.028 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: mon op complaint time = 120 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-08-17T02:25:27.029 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: client mount timeout = 600 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = "" 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-08-17T02:25:27.030 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout:[mds] 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds = 20 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds balancer = 20 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug frag = True 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug scatterstat = True 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout: mds op complaint time = 180 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout: mds verify scatter = True 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-08-17T02:25:27.031 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-08-17T02:25:27.032 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-08-17T02:25:27.032 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-08-17T02:25:27.032 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-08-17T02:25:27.032 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:27.032 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-08-17T02:25:27.032 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.032 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-08-17T02:25:27.032 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.032 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-08-17T02:25:27.033 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.034 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.19,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 1a630ac0-5cc8-463b-a63c-db2f048e27a8 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-08-17T02:25:27.035 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-08-17T02:25:27.036 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2024-08-17T02:25:27.037 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:27.038 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: debug finisher = 20 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-08-17T02:25:27.039 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:27.040 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:27.041 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2024-08-17T02:25:27.042 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2024-08-17T02:25:27.043 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-08-17T02:25:27.043 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2024-08-17T02:25:27.043 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2024-08-17T02:25:27.043 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2024-08-17T02:25:27.043 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2024-08-17T02:25:27.043 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-08-17T02:25:27.043 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-08-17T02:25:27.043 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-08-17T02:25:27.044 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:25:27.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:25:27.092 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:25:27.093 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:27.093 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:25:27.099 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:27.099 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:25:27.106 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:25:27.106 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:27.106 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:27.106 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:27.126 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:27.126 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:27.132 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:25:27.132 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:27.132 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:27.132 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:27.159 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:27.160 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:27.206 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:25:27.207 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:25:27.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:27.253 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:27.255 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:27.300 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:27.302 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:25:27.303 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:27.347 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:27.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:25:27.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:27.400 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:27.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:25:27.464 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:27.507 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:27.510 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:25:27.566 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:27.604 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:27.607 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:25:27.617 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:25:27.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:27.653 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:27.666 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:27.697 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:27.708 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:27.745 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:27.757 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:27.836 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:27.850 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:25:27.851 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:25:27.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:27.868 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:27.868 INFO:tasks.ceph:role: osd.0 2024-08-17T02:25:27.868 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:25:27.868 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:28.430 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:28.431 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:28.433 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-08-17T02:25:28.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:28.500 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:28.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:28.510 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:28.510 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:28.522 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:28.522 INFO:tasks.ceph:role: osd.1 2024-08-17T02:25:28.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:25:28.522 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:29.105 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:29.107 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-08-17T02:25:29.107 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:29.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:29.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:29.153 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:29.153 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:29.164 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:29.164 INFO:tasks.ceph:role: osd.2 2024-08-17T02:25:29.165 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:25:29.165 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:29.661 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:29.661 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:29.661 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:29.662 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 2024-08-17T02:25:29.662 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:29.662 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:29.662 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:29.662 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:29.662 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:29.662 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:29.663 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-08-17T02:25:29.663 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:29.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:29.738 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:29.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:29.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:29.798 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:29.798 INFO:tasks.ceph:role: osd.3 2024-08-17T02:25:29.799 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:25:29.799 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:30.314 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:30.314 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:30.314 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:30.314 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 2024-08-17T02:25:30.314 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:30.314 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:30.314 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:30.315 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:30.315 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:30.315 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:30.316 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-08-17T02:25:30.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:30.377 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:30.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:30.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:30.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:30.460+0000 7f36842473c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:25:30.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:30.460+0000 7f36842473c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:25:30.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:30.460+0000 7f36842473c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:30.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:30.460+0000 7f36842473c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:30.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:30.460+0000 7f36842473c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:30.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:30.468+0000 7f36842473c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:25:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:31.044+0000 7f36842473c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:31.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:31.823+0000 7f36842473c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:32.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:32.611+0000 7f36842473c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:33.463 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:33.478 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:33.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:33.555+0000 7f734e7943c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:25:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:33.555+0000 7f734e7943c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:25:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:33.555+0000 7f734e7943c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:33.555+0000 7f734e7943c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:33.555+0000 7f734e7943c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:33.555+0000 7f734e7943c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:25:34.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:34.115+0000 7f734e7943c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:34.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:34.899+0000 7f734e7943c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:35.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:35.695+0000 7f734e7943c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:36.555 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:36.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:36.599+0000 7fd6bc3793c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:36.599+0000 7fd6bc3793c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:36.599+0000 7fd6bc3793c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:36.599+0000 7fd6bc3793c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:36.599+0000 7fd6bc3793c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:36.603+0000 7fd6bc3793c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:25:37.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:37.155+0000 7fd6bc3793c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:37.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:37.943+0000 7fd6bc3793c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:38.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:38.723+0000 7fd6bc3793c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:39.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:39.637 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:39.671+0000 7f4e2bf2c3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:25:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:39.671+0000 7f4e2bf2c3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:25:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:39.671+0000 7f4e2bf2c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:39.671+0000 7f4e2bf2c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:39.671+0000 7f4e2bf2c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:39.671+0000 7f4e2bf2c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:25:40.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:40.235+0000 7f4e2bf2c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:41.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:41.027+0000 7f4e2bf2c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:41.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:41.807+0000 7f4e2bf2c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:42.670 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:42.687 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:42.704 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:42.704 INFO:tasks.ceph:role: osd.4 2024-08-17T02:25:42.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:25:42.704 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:43.269 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:43.269 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:43.269 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:43.269 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 2024-08-17T02:25:43.269 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:43.270 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:43.270 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:43.270 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:43.270 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:43.270 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:43.272 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-08-17T02:25:43.272 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:43.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:43.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:43.370 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:43.370 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:43.428 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:43.428 INFO:tasks.ceph:role: osd.5 2024-08-17T02:25:43.428 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:25:43.428 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:43.954 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:43.954 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:43.954 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:43.954 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 2024-08-17T02:25:43.954 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:43.954 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:43.954 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:43.954 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:43.955 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:43.955 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:43.956 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-08-17T02:25:43.956 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:43.991 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:44.043 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:44.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:44.044 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:44.055 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:44.055 INFO:tasks.ceph:role: osd.6 2024-08-17T02:25:44.055 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:25:44.055 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:44.516 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:44.517 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:44.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-08-17T02:25:44.519 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:44.574 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:44.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:44.586 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:44.586 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:44.596 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:44.596 INFO:tasks.ceph:role: osd.7 2024-08-17T02:25:44.596 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:25:44.596 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:45.116 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:45.117 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:45.117 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:45.117 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 2024-08-17T02:25:45.117 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:45.117 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:45.117 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:45.117 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:25:45.117 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:45.117 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:45.118 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-08-17T02:25:45.119 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:45.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:45.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:45.194 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:25:45.194 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:45.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:45.270+0000 7fba54cc23c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:25:45.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:45.270+0000 7fba54cc23c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:25:45.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:45.270+0000 7fba54cc23c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:45.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:45.270+0000 7fba54cc23c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:45.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:45.270+0000 7fba54cc23c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:45.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:45.274+0000 7fba54cc23c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:25:45.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:45.850+0000 7fba54cc23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:46.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:46.634+0000 7fba54cc23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:47.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:47.414+0000 7fba54cc23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:48.276 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:48.293 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:48.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:48.326+0000 7fbfd41563c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:25:48.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:48.326+0000 7fbfd41563c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:25:48.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:48.326+0000 7fbfd41563c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:48.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:48.326+0000 7fbfd41563c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:48.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:48.326+0000 7fbfd41563c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:48.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:48.326+0000 7fbfd41563c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:25:48.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:48.878+0000 7fbfd41563c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:49.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:49.670+0000 7fbfd41563c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:50.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:50.450+0000 7fbfd41563c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:51.296 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:51.310 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:51.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:51.386+0000 7f01cbc7c3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:25:51.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:51.386+0000 7f01cbc7c3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:25:51.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:51.386+0000 7f01cbc7c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:51.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:51.386+0000 7f01cbc7c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:51.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:51.386+0000 7f01cbc7c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:51.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:51.390+0000 7f01cbc7c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:25:51.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:51.946+0000 7f01cbc7c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:52.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:52.726+0000 7f01cbc7c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:53.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:53.522+0000 7f01cbc7c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:54.371 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:54.387 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:54.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:54.422+0000 7f2dd5aca3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:25:54.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:54.422+0000 7f2dd5aca3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:25:54.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:54.422+0000 7f2dd5aca3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:54.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:54.422+0000 7f2dd5aca3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:54.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:54.422+0000 7f2dd5aca3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:54.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:54.422+0000 7f2dd5aca3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:25:54.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:54.978+0000 7f2dd5aca3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:55.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:55.766+0000 7f2dd5aca3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:56.107 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:56.109 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:56.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:25:56.546+0000 7f2dd5aca3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:57.391 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:57.408 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:25:57.408 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:57.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:25:57.425 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:57.425 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:25:57.435 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:57.435 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:25:57.446 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:57.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:25:57.508 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:57.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:25:57.518 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:57.518 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:25:57.576 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:57.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:25:57.590 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:57.590 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:25:57.607 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:57.607 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:25:57.621 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:57.621 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:25:57.637 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:57.637 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:25:57.696 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:57.697 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:25:57.706 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:57.706 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:25:57.719 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:57.719 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:25:57.731 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:57.731 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:25:57.738 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:25:57.738 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:25:57.785 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:57.785 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:25:57.792 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:25:57.792 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:25:57.842 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:25:57.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:25:57.844 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:25:57.855 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2024-08-17T02:25:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBmuzf/DhAAJCJahs3RRlj4feLvV3Onwg== 2024-08-17T02:25:57.855 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-08-17T02:25:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBmsTqgFBAAOCc/W/y5ACbhtPW7ZLxUow== 2024-08-17T02:25:57.855 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-08-17T02:25:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBmsaTLFxAA0Eymepj447cXeSPRLhO8og== 2024-08-17T02:25:57.855 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAaCsBm4oOFGxAAN2sqMKdl9o4RRUoUj8Qm8w== 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAdCsBmSZBdIRAAZTjzmDVqLZH37I6W1Qzimw== 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAgCsBm1FsIJBAAawsul20jbbS9SljQCvXcBw== 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAjCsBmglZMKBAAPVjEYoRcl9ugMp5/VyEt7g== 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBmAQf0ERAA6IlHB7pw++p3D2Qq+V/grA== 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBm5JtVHhAAMbDT3w/B4uNGt3TmC8IJbA== 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2024-08-17T02:25:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBmsLceJBAADLw/M5zQ6mURSEplnKFe2w== 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQApCsBmzJx3EBAAF/MJkuNrSQ2utKEpx+BS+w== 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAsCsBmsaKmExAAD8ntQBy9sM9a2rCXmAR2+g== 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAvCsBmixRnFxAAUMKYGYh9D0wNmbO8Q74Wkg== 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAyCsBmyShpGRAA73boEmYCqOn5ehFJ+zYqgw== 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBmO43SJhAAxpOvqiDeKys6AuR/VE1qBw== 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout:[client.2] 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBmicJ+KRAA+tiwA/x7dWAU6QspLPxGHw== 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout:[client.1] 2024-08-17T02:25:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBmyAN8LBAACo9oXCnD1D/T9secJCDHTQ== 2024-08-17T02:25:57.858 INFO:teuthology.orchestra.run.smithi119.stdout:[client.3] 2024-08-17T02:25:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXCsBmAdnwMRAAj0WBwS1rtHYxb7w2xkVULw== 2024-08-17T02:25:57.859 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-08-17T02:25:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBmuzf/DhAAJCJahs3RRlj4feLvV3Onwg== 2024-08-17T02:25:57.859 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-08-17T02:25:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBmsTqgFBAAOCc/W/y5ACbhtPW7ZLxUow== 2024-08-17T02:25:57.859 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-08-17T02:25:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBmsaTLFxAA0Eymepj447cXeSPRLhO8og== 2024-08-17T02:25:57.859 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-08-17T02:25:57.859 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAaCsBm4oOFGxAAN2sqMKdl9o4RRUoUj8Qm8w== 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAdCsBmSZBdIRAAZTjzmDVqLZH37I6W1Qzimw== 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAgCsBm1FsIJBAAawsul20jbbS9SljQCvXcBw== 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAjCsBmglZMKBAAPVjEYoRcl9ugMp5/VyEt7g== 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBmAQf0ERAA6IlHB7pw++p3D2Qq+V/grA== 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBm5JtVHhAAMbDT3w/B4uNGt3TmC8IJbA== 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBmsLceJBAADLw/M5zQ6mURSEplnKFe2w== 2024-08-17T02:25:57.860 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQApCsBmzJx3EBAAF/MJkuNrSQ2utKEpx+BS+w== 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAsCsBmsaKmExAAD8ntQBy9sM9a2rCXmAR2+g== 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAvCsBmixRnFxAAUMKYGYh9D0wNmbO8Q74Wkg== 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAyCsBmyShpGRAA73boEmYCqOn5ehFJ+zYqgw== 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBmO43SJhAAxpOvqiDeKys6AuR/VE1qBw== 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout:[client.2] 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBmicJ+KRAA+tiwA/x7dWAU6QspLPxGHw== 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout:[client.1] 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBmyAN8LBAACo9oXCnD1D/T9secJCDHTQ== 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout:[client.3] 2024-08-17T02:25:57.861 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAXCsBmAdnwMRAAj0WBwS1rtHYxb7w2xkVULw== 2024-08-17T02:25:57.862 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:57.905 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:57.950 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:57.952 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:57.999 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:58.001 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:58.048 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.050 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.095 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.182 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.184 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.230 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.232 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.274 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:58.276 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:58.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:58.361 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:58.407 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:58.409 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:58.454 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.456 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.539 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.545 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.590 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.592 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.671 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.673 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:58.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:58.719 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:58.766 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:58.769 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:58.855 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:58.857 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:58.906 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:58.908 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:58.954 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:25:58.954 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:25:58.967 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:59.018 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:25:59.030 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:25:59.046 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:59.096 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:25:59.108 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:25:59.168 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:59.223 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:25:59.236 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:59.239 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:59.286 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:25:59.286 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:25:59.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:25:59.288 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:25:59.289 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:25:59.289 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:25:59.291 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:25:59.291 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:25:59.291 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:25:59.293 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:25:59.293 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:25:59.293 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:25:59.293 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:25:59.295 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:25:59.295 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:25:59.295 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:25:59.297 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:25:59.298 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:25:59.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:25:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b7a9e6700 1 Processor -- start 2024-08-17T02:25:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b7a9e6700 1 -- start start 2024-08-17T02:25:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b7a9e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b7a9e6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740b0ad0 con 0x7f6b7406f350 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b7a9e6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7415a940 con 0x7f6b741538e0 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b7a9e6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740b01a0 con 0x7f6b74153cb0 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b737fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6b7406f350 0x7f6b74159bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48926/0 (socket says 172.21.15.19:48926) 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 learned_addr learned my addr 172.21.15.19:0/1118677935 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 msgr2=0x7f6b740b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 msgr2=0x7f6b740b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.395+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:59.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.599+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.599+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 msgr2=0x7f6b740b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:25:59.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.599+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 msgr2=0x7f6b740b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.599+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:59.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:25:59.599+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:26:00.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.003+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.003+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 msgr2=0x7f6b740b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:00.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.003+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 msgr2=0x7f6b740b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:00.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.003+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:00.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.003+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:26:00.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.807+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.807+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 msgr2=0x7f6b740b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:00.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.807+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 msgr2=0x7f6b740b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:00.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.807+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:00.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:00.807+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:26:02.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 msgr2=0x7f6b740b0f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:02.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b71ffb700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74153cb0 0x7f6b740b0f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 >> v1:172.21.15.119:6789/0 conn(0x7f6b741538e0 legacy=0x7f6b7406ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 >> v1:172.21.15.19:6789/0 conn(0x7f6b7406f350 legacy=0x7f6b74159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b71ffb700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b71ffb700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740b01a0 con 0x7f6b54003760 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b54008d20 con 0x7f6b54006200 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b73fff700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 msgr2=0x7f6b54005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b73fff700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 msgr2=0x7f6b54005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 msgr2=0x7f6b54008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 msgr2=0x7f6b54008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:02.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.395+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:02.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b73fff700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 msgr2=0x7f6b54005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:26:02.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b73fff700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 msgr2=0x7f6b54005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:26:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 msgr2=0x7f6b54008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 msgr2=0x7f6b54008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:02.599+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:26:03.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b73fff700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 msgr2=0x7f6b54005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b73fff700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 msgr2=0x7f6b54005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:26:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 msgr2=0x7f6b54008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:26:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 msgr2=0x7f6b54008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.003+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:26:03.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b73fff700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 msgr2=0x7f6b54005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:26:03.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b73fff700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 msgr2=0x7f6b54005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:03.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:03.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:26:03.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 msgr2=0x7f6b54008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:03.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 msgr2=0x7f6b54008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:03.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:03.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:03.807+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:26:04.645 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:04.642+0000 7f6698647000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:26:05.348 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:05.346+0000 7f6698647000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:26:05.400 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:05.394+0000 7f6698647000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:26:05.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.395+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 msgr2=0x7f6b54008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:05.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.395+0000 7f6b71ffb700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.119:3300/0 conn(0x7f6b54006200 0x7f6b54008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.395+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 msgr2=0x7f6b54005bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:05.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.395+0000 7f6b71ffb700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003760 0x7f6b54005bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.395+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 reap_dead start 2024-08-17T02:26:05.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.395+0000 7f6b71ffb700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003ba0 0x7f6b5400ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.395+0000 7f6b71ffb700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5400cf40 0x7f6b5400f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.395+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740b0480 con 0x7f6b54006660 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740b01a0 con 0x7f6b54003ba0 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b71ffb700 1 -- 172.21.15.19:0/1118677935 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b54008d20 con 0x7f6b5400cf40 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> v2:172.21.15.19:3300/0 conn(0x7f6b54003ba0 0x7f6b5400ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5400cf40 0x7f6b5400f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5400cf40 msgr2=0x7f6b5400f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b72ffd700 1 -- 172.21.15.19:0/1118677935 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249391269 0 0) 0x7f6b740b0480 con 0x7f6b54006660 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b78f83700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5400cf40 msgr2=0x7f6b5400f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5400cf40 0x7f6b5400f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b72ffd700 1 -- 172.21.15.19:0/1118677935 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b60003570 con 0x7f6b54006660 2024-08-17T02:26:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5400cf40 0x7f6b5400f320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5400cf40 msgr2=0x7f6b5400f320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5400cf40 0x7f6b5400f320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 >> v1:172.21.15.19:6789/0 conn(0x7f6b54006660 legacy=0x7f6b5400b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b737fe700 1 -- 172.21.15.19:0/1118677935 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b54010bc0 con 0x7f6b54003ba0 2024-08-17T02:26:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 0x7f6b5400ca00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b7406f750 tx=0x7f6b6c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876995112bcf205b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b72ffd700 1 -- 172.21.15.19:0/1118677935 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c017460 con 0x7f6b54003ba0 2024-08-17T02:26:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b72ffd700 1 -- 172.21.15.19:0/1118677935 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c0175c0 con 0x7f6b54003ba0 2024-08-17T02:26:05.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b72ffd700 1 -- 172.21.15.19:0/1118677935 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c017980 con 0x7f6b54003ba0 2024-08-17T02:26:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1118677935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 msgr2=0x7f6b5400ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.399+0000 7f6b7a9e6700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 0x7f6b5400ca00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b7406f750 tx=0x7f6b6c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1118677935 shutdown_connections 2024-08-17T02:26:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5400cf40 0x7f6b5400f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 --2- 172.21.15.19:0/1118677935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 0x7f6b5400ca00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1118677935 >> 172.21.15.19:0/1118677935 conn(0x7f6b74066e00 msgr2=0x7f6b74067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1118677935 shutdown_connections 2024-08-17T02:26:05.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1118677935 wait complete. 2024-08-17T02:26:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 Processor -- start 2024-08-17T02:26:05.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 -- start start 2024-08-17T02:26:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 0x7f6b74154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b54006660 0x7f6b741424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b5400cf40 0x7f6b741429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74156590 con 0x7f6b54003ba0 2024-08-17T02:26:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74099020 con 0x7f6b5400cf40 2024-08-17T02:26:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.403+0000 7f6b7a9e6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74156830 con 0x7f6b54006660 2024-08-17T02:26:05.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b73fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 0x7f6b74154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b73fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 0x7f6b74154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46406/0 (socket says 172.21.15.19:46406) 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b73fff700 1 -- 172.21.15.19:0/1690706980 learned_addr learned my addr 172.21.15.19:0/1690706980 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b78f83700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b5400cf40 0x7f6b741429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b54006660 0x7f6b741424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b737fe700 1 -- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b54006660 msgr2=0x7f6b741424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b737fe700 1 -- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b54006660 msgr2=0x7f6b741424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b73fff700 1 -- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b54006660 msgr2=0x7f6b741424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b54006660 0x7f6b741424a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b737fe700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b54006660 0x7f6b741424a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b54006660 0x7f6b741424a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b73fff700 1 -- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b5400cf40 msgr2=0x7f6b741429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b5400cf40 0x7f6b741429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b73fff700 1 -- 172.21.15.19:0/1690706980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c00f040 con 0x7f6b54003ba0 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b73fff700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 0x7f6b74154dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6b640012e0 tx=0x7f6b64009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b6bfff700 1 -- 172.21.15.19:0/1690706980 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640032e0 con 0x7f6b54003ba0 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b6bfff700 1 -- 172.21.15.19:0/1690706980 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64003440 con 0x7f6b54003ba0 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1690706980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b74156b10 con 0x7f6b54003ba0 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b6bfff700 1 -- 172.21.15.19:0/1690706980 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64001840 con 0x7f6b54003ba0 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1690706980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b74155310 con 0x7f6b54003ba0 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b6bfff700 1 -- 172.21.15.19:0/1690706980 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6b64001c30 con 0x7f6b54003ba0 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b6bfff700 1 -- 172.21.15.19:0/1690706980 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6b64013b60 con 0x7f6b54003ba0 2024-08-17T02:26:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.407+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1690706980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b740645c0 con 0x7f6b54003ba0 2024-08-17T02:26:05.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.411+0000 7f6b6bfff700 1 -- 172.21.15.19:0/1690706980 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6b6403c7a0 con 0x7f6b54003ba0 2024-08-17T02:26:05.506 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:05.502+0000 7f6698647000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:26:05.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.515+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1690706980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6b7406d7c0 con 0x7f6b54003ba0 2024-08-17T02:26:05.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b6bfff700 1 -- 172.21.15.19:0/1690706980 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6b6402b020 con 0x7f6b54003ba0 2024-08-17T02:26:05.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1690706980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 msgr2=0x7f6b74154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b7a9e6700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 0x7f6b74154dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6b640012e0 tx=0x7f6b64009040 comp rx=0 tx=0).stop 2024-08-17T02:26:05.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1690706980 shutdown_connections 2024-08-17T02:26:05.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b7a9e6700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b5400cf40 0x7f6b741429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b7a9e6700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b54006660 0x7f6b741424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b7a9e6700 1 --2- 172.21.15.19:0/1690706980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b54003ba0 0x7f6b74154dd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1690706980 >> 172.21.15.19:0/1690706980 conn(0x7f6b74066e00 msgr2=0x7f6b74152610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1690706980 shutdown_connections 2024-08-17T02:26:05.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:05.519+0000 7f6b7a9e6700 1 -- 172.21.15.19:0/1690706980 wait complete. 2024-08-17T02:26:05.528 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-08-17T02:26:05.539 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:26:05.539 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:26:05.539 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:26:05.553 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:26:05.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:26:05.565 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:26:05.565 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:26:05.581 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-08-17T02:26:05.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:26:05.605 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:05.599+0000 7f77a51f3000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:26:05.618 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:26:05.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:26:05.632 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:26:05.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:26:05.689 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:26:05.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:26:05.700 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-08-17T02:26:05.701 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:26:05.712 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new c6e9266d-5f6c-4327-aaec-6938eacc3f25 0 2024-08-17T02:26:05.726 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:05.722+0000 7f6698647000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:26:05.776 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:05.770+0000 7f6698647000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:26:05.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed2290700 1 Processor -- start 2024-08-17T02:26:05.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed2290700 1 -- start start 2024-08-17T02:26:05.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed2290700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 0x7f9ecc0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed2290700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ecc157220 0x7f9ecc0b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed2290700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc0afa80 con 0x7f9ecc0ae9e0 2024-08-17T02:26:05.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed2290700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc0b24c0 con 0x7f9ecc157220 2024-08-17T02:26:05.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed2290700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0aee70 con 0x7f9ecc156e50 2024-08-17T02:26:05.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed128e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 0x7f9ecc0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed128e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 0x7f9ecc0aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:50748/0 (socket says 172.21.15.119:50748) 2024-08-17T02:26:05.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed1a8f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ecc157220 0x7f9ecc0b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed128e700 1 -- 172.21.15.119:0/1415230534 learned_addr learned my addr 172.21.15.119:0/1415230534 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed128e700 1 -- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 msgr2=0x7f9ecc0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed128e700 1 -- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 msgr2=0x7f9ecc0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed128e700 1 --2- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 0x7f9ecc0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ec3fff700 1 -- 172.21.15.119:0/1415230534 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429893888 0 0) 0x7f9ecc0afa80 con 0x7f9ecc0ae9e0 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed128e700 1 --2- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 0x7f9ecc0aff10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ec3fff700 1 -- 172.21.15.119:0/1415230534 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb8003570 con 0x7f9ecc0ae9e0 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed1a8f700 1 -- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 msgr2=0x7f9ecc0aff10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed1a8f700 1 --2- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 0x7f9ecc0aff10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ec3fff700 1 -- 172.21.15.119:0/1415230534 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3861985276 0 0) 0x7f9eb8003570 con 0x7f9ecc0ae9e0 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed1a8f700 1 -- 172.21.15.119:0/1415230534 >> v1:172.21.15.119:6789/0 conn(0x7f9ecc0ae9e0 legacy=0x7f9ecc0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed1a8f700 1 -- 172.21.15.119:0/1415230534 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0af150 con 0x7f9ecc157220 2024-08-17T02:26:05.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ed1a8f700 1 --2- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 0x7f9ecc0b2ef0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009e60 tx=0x7f9ec4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecb30be50adb6420 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ec3fff700 1 -- 172.21.15.119:0/1415230534 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400e070 con 0x7f9ecc157220 2024-08-17T02:26:05.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ec3fff700 1 -- 172.21.15.119:0/1415230534 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec400b850 con 0x7f9ecc157220 2024-08-17T02:26:05.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.810+0000 7f9ec3fff700 1 -- 172.21.15.119:0/1415230534 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc001470 con 0x7f9ecc157220 2024-08-17T02:26:05.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 msgr2=0x7f9ecc0b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 --2- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 0x7f9ecc0b2ef0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009e60 tx=0x7f9ec4009780 comp rx=0 tx=0).stop 2024-08-17T02:26:05.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- 172.21.15.119:0/1415230534 shutdown_connections 2024-08-17T02:26:05.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 --2- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 0x7f9ecc0b2ef0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 --2- 172.21.15.119:0/1415230534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc156e50 0x7f9ecc0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- 172.21.15.119:0/1415230534 >> 172.21.15.119:0/1415230534 conn(0x7f9ecc06cbe0 msgr2=0x7f9ecc06cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- 172.21.15.119:0/1415230534 shutdown_connections 2024-08-17T02:26:05.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- 172.21.15.119:0/1415230534 wait complete. 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 Processor -- start 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- start start 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 0x7f9ecc069040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ecc156e50 0x7f9ecc14fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 0x7f9ecc1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc15a420 con 0x7f9ecc156e50 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc159f90 con 0x7f9ecc157220 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc159660 con 0x7f9ecc0ae9e0 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed128e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 0x7f9ecc069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed1a8f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 0x7f9ecc1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed128e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 0x7f9ecc069040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:50750/0 (socket says 172.21.15.119:50750) 2024-08-17T02:26:05.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed1a8f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 0x7f9ecc1500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45522/0 (socket says 172.21.15.119:45522) 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed128e700 1 -- 172.21.15.119:0/2340085004 learned_addr learned my addr 172.21.15.119:0/2340085004 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed128e700 1 -- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 msgr2=0x7f9ecc069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed128e700 1 -- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 msgr2=0x7f9ecc069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed128e700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 0x7f9ecc069040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed128e700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 0x7f9ecc069040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed0a8d700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ecc156e50 0x7f9ecc14fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed1a8f700 1 -- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 msgr2=0x7f9ecc069040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed1a8f700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 0x7f9ecc069040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed1a8f700 1 -- 172.21.15.119:0/2340085004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ecc156e50 msgr2=0x7f9ecc14fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed1a8f700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ecc156e50 0x7f9ecc14fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed1a8f700 1 -- 172.21.15.119:0/2340085004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009a20 con 0x7f9ecc157220 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed0a8d700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ecc156e50 0x7f9ecc14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:05.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed1a8f700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 0x7f9ecc1500d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc06ec70 tx=0x7f9ec4018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ec17fa700 1 -- 172.21.15.119:0/2340085004 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4012d20 con 0x7f9ecc157220 2024-08-17T02:26:05.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ec17fa700 1 -- 172.21.15.119:0/2340085004 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec4012e80 con 0x7f9ecc157220 2024-08-17T02:26:05.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- 172.21.15.119:0/2340085004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc159940 con 0x7f9ecc157220 2024-08-17T02:26:05.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ec17fa700 1 -- 172.21.15.119:0/2340085004 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec401d680 con 0x7f9ecc157220 2024-08-17T02:26:05.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.814+0000 7f9ed2290700 1 -- 172.21.15.119:0/2340085004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc16ca10 con 0x7f9ecc157220 2024-08-17T02:26:05.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.818+0000 7f9ec17fa700 1 -- 172.21.15.119:0/2340085004 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9ec4024070 con 0x7f9ecc157220 2024-08-17T02:26:05.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.818+0000 7f9ec17fa700 1 -- 172.21.15.119:0/2340085004 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9ec401e820 con 0x7f9ecc157220 2024-08-17T02:26:05.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.818+0000 7f9ed2290700 1 -- 172.21.15.119:0/2340085004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc159dc0 con 0x7f9ecc157220 2024-08-17T02:26:05.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.822+0000 7f9ec17fa700 1 -- 172.21.15.119:0/2340085004 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9ec401ea30 con 0x7f9ecc157220 2024-08-17T02:26:05.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.894+0000 7f9ed2290700 1 -- 172.21.15.119:0/2340085004 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6e9266d-5f6c-4327-aaec-6938eacc3f25", "id": 0} v 0) v1 -- 0x7f9ecc0638f0 con 0x7f9ecc157220 2024-08-17T02:26:05.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ec17fa700 1 -- 172.21.15.119:0/2340085004 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6e9266d-5f6c-4327-aaec-6938eacc3f25", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ec401ebd0 con 0x7f9ecc157220 2024-08-17T02:26:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:0 2024-08-17T02:26:05.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ed2290700 1 -- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 msgr2=0x7f9ecc1500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ed2290700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 0x7f9ecc1500d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc06ec70 tx=0x7f9ec4018000 comp rx=0 tx=0).stop 2024-08-17T02:26:05.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ed2290700 1 -- 172.21.15.119:0/2340085004 shutdown_connections 2024-08-17T02:26:05.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ed2290700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ecc157220 0x7f9ecc1500d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ed2290700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ecc156e50 0x7f9ecc14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ed2290700 1 --2- 172.21.15.119:0/2340085004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ecc0ae9e0 0x7f9ecc069040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ed2290700 1 -- 172.21.15.119:0/2340085004 >> 172.21.15.119:0/2340085004 conn(0x7f9ecc06cbe0 msgr2=0x7f9ecc155d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ed2290700 1 -- 172.21.15.119:0/2340085004 shutdown_connections 2024-08-17T02:26:05.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:05.902+0000 7f9ed2290700 1 -- 172.21.15.119:0/2340085004 wait complete. 2024-08-17T02:26:05.922 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 689e83b1-86c1-4c9f-befa-a6ba82b34a98 1 2024-08-17T02:26:05.956 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:05.950+0000 7f6698647000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:26:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15221ae700 1 Processor -- start 2024-08-17T02:26:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15221ae700 1 -- start start 2024-08-17T02:26:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15221ae700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f151c0aab10 0x7f151c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15221ae700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151c0ab0f0 con 0x7f151c0688d0 2024-08-17T02:26:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15221ae700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151c0ab3d0 con 0x7f151c158b70 2024-08-17T02:26:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15221ae700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151c0ab6b0 con 0x7f151c0aab10 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15209ab700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f151c0aab10 0x7f151c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15219ad700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f151c158b70 0x7f151c158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33304/0 (socket says 172.21.15.119:33304) 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15219ad700 1 -- 172.21.15.119:0/1806823451 learned_addr learned my addr 172.21.15.119:0/1806823451 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f1513fff700 1 -- 172.21.15.119:0/1806823451 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440609719 0 0) 0x7f151c0ab3d0 con 0x7f151c158b70 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f1513fff700 1 -- 172.21.15.119:0/1806823451 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1508003570 con 0x7f151c158b70 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15209ab700 1 -- 172.21.15.119:0/1806823451 >> v1:172.21.15.119:6789/0 conn(0x7f151c158b70 legacy=0x7f151c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15209ab700 1 -- 172.21.15.119:0/1806823451 >> v1:172.21.15.19:6789/0 conn(0x7f151c0688d0 legacy=0x7f151c066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15209ab700 1 -- 172.21.15.119:0/1806823451 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c0ab990 con 0x7f151c0aab10 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15209ab700 1 --2- 172.21.15.119:0/1806823451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0aab10 0x7f151c068ca0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f150c0098e0 tx=0x7f150c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42c1bfec71398ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f1513fff700 1 -- 172.21.15.119:0/1806823451 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00b640 con 0x7f151c0aab10 2024-08-17T02:26:06.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f1513fff700 1 -- 172.21.15.119:0/1806823451 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c00b7a0 con 0x7f151c0aab10 2024-08-17T02:26:06.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f1513fff700 1 -- 172.21.15.119:0/1806823451 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00bb40 con 0x7f151c0aab10 2024-08-17T02:26:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.014+0000 7f15221ae700 1 -- 172.21.15.119:0/1806823451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0aab10 msgr2=0x7f151c068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 --2- 172.21.15.119:0/1806823451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0aab10 0x7f151c068ca0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f150c0098e0 tx=0x7f150c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 -- 172.21.15.119:0/1806823451 shutdown_connections 2024-08-17T02:26:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 --2- 172.21.15.119:0/1806823451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0aab10 0x7f151c068ca0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 -- 172.21.15.119:0/1806823451 >> 172.21.15.119:0/1806823451 conn(0x7f151c06e310 msgr2=0x7f151c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 -- 172.21.15.119:0/1806823451 shutdown_connections 2024-08-17T02:26:06.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 -- 172.21.15.119:0/1806823451 wait complete. 2024-08-17T02:26:06.023 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f6698647000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:26:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 Processor -- start 2024-08-17T02:26:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 -- start start 2024-08-17T02:26:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0688d0 0x7f151c143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f151c0aab10 0x7f151c06b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151c158b70 0x7f151c0af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c15a710 con 0x7f151c0aab10 2024-08-17T02:26:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c15aba0 con 0x7f151c0688d0 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15221ae700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c159b00 con 0x7f151c158b70 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15211ac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0688d0 0x7f151c143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15219ad700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151c158b70 0x7f151c0af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15211ac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0688d0 0x7f151c143f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45546/0 (socket says 172.21.15.119:45546) 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15211ac700 1 -- 172.21.15.119:0/1091602455 learned_addr learned my addr 172.21.15.119:0/1091602455 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15219ad700 1 -- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151c158b70 msgr2=0x7f151c0af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15219ad700 1 -- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151c158b70 msgr2=0x7f151c0af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15209ab700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f151c0aab10 0x7f151c06b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15219ad700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151c158b70 0x7f151c0af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.018+0000 7f15219ad700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151c158b70 0x7f151c0af670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15211ac700 1 -- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151c158b70 msgr2=0x7f151c0af670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15211ac700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151c158b70 0x7f151c0af670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15211ac700 1 -- 172.21.15.119:0/1091602455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f151c0aab10 msgr2=0x7f151c06b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15211ac700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f151c0aab10 0x7f151c06b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15211ac700 1 -- 172.21.15.119:0/1091602455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c009420 con 0x7f151c0688d0 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15209ab700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f151c0aab10 0x7f151c06b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15211ac700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0688d0 0x7f151c143f10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f151800c590 tx=0x7f151800c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15117fa700 1 -- 172.21.15.119:0/1091602455 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518011590 con 0x7f151c0688d0 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15117fa700 1 -- 172.21.15.119:0/1091602455 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15180116f0 con 0x7f151c0688d0 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15221ae700 1 -- 172.21.15.119:0/1091602455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c159de0 con 0x7f151c0688d0 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15117fa700 1 -- 172.21.15.119:0/1091602455 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518011ab0 con 0x7f151c0688d0 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15221ae700 1 -- 172.21.15.119:0/1091602455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c15a3a0 con 0x7f151c0688d0 2024-08-17T02:26:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15117fa700 1 -- 172.21.15.119:0/1091602455 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f151801c440 con 0x7f151c0688d0 2024-08-17T02:26:06.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15117fa700 1 -- 172.21.15.119:0/1091602455 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f15180127e0 con 0x7f151c0688d0 2024-08-17T02:26:06.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.022+0000 7f15221ae700 1 -- 172.21.15.119:0/1091602455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c0638f0 con 0x7f151c0688d0 2024-08-17T02:26:06.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.026+0000 7f15117fa700 1 -- 172.21.15.119:0/1091602455 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1518017070 con 0x7f151c0688d0 2024-08-17T02:26:06.085 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:06.082+0000 7f6698647000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:26:06.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.102+0000 7f15221ae700 1 -- 172.21.15.119:0/1091602455 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "689e83b1-86c1-4c9f-befa-a6ba82b34a98", "id": 1} v 0) v1 -- 0x7f151c0b23a0 con 0x7f151c0688d0 2024-08-17T02:26:06.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15117fa700 1 -- 172.21.15.119:0/1091602455 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "689e83b1-86c1-4c9f-befa-a6ba82b34a98", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1518011e60 con 0x7f151c0688d0 2024-08-17T02:26:06.114 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-08-17T02:26:06.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15221ae700 1 -- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0688d0 msgr2=0x7f151c143f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15221ae700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0688d0 0x7f151c143f10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f151800c590 tx=0x7f151800c950 comp rx=0 tx=0).stop 2024-08-17T02:26:06.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15221ae700 1 -- 172.21.15.119:0/1091602455 shutdown_connections 2024-08-17T02:26:06.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15221ae700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f151c158b70 0x7f151c0af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15221ae700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f151c0aab10 0x7f151c06b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15221ae700 1 --2- 172.21.15.119:0/1091602455 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f151c0688d0 0x7f151c143f10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15221ae700 1 -- 172.21.15.119:0/1091602455 >> 172.21.15.119:0/1091602455 conn(0x7f151c06e310 msgr2=0x7f151c158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15221ae700 1 -- 172.21.15.119:0/1091602455 shutdown_connections 2024-08-17T02:26:06.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.110+0000 7f15221ae700 1 -- 172.21.15.119:0/1091602455 wait complete. 2024-08-17T02:26:06.128 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 3baa2f45-afde-49eb-9956-3cb368a42cf6 2 2024-08-17T02:26:06.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f4812ede700 1 Processor -- start 2024-08-17T02:26:06.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f4812ede700 1 -- start start 2024-08-17T02:26:06.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f4812ede700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f480c142c40 0x7f480c067430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f4812ede700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f480c067970 0x7f480c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f4812ede700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480c067dd0 con 0x7f480c142870 2024-08-17T02:26:06.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f4812ede700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480c15cde0 con 0x7f480c067970 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f4812ede700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480c15d030 con 0x7f480c142c40 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480bfff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f480c142c40 0x7f480c067430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480bfff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f480c142c40 0x7f480c067430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45560/0 (socket says 172.21.15.119:45560) 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480bfff700 1 -- 172.21.15.119:0/3648990363 learned_addr learned my addr 172.21.15.119:0/3648990363 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f481147b700 1 --2- 172.21.15.119:0/3648990363 >> v2:172.21.15.19:3300/0 conn(0x7f480c067970 0x7f480c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480bfff700 1 -- 172.21.15.119:0/3648990363 >> v2:172.21.15.19:3300/0 conn(0x7f480c067970 msgr2=0x7f480c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480bfff700 1 --2- 172.21.15.119:0/3648990363 >> v2:172.21.15.19:3300/0 conn(0x7f480c067970 0x7f480c15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480bfff700 1 -- 172.21.15.119:0/3648990363 >> v1:172.21.15.19:6789/0 conn(0x7f480c142870 legacy=0x7f480c0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480bfff700 1 -- 172.21.15.119:0/3648990363 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c15d310 con 0x7f480c142c40 2024-08-17T02:26:06.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480bfff700 1 --2- 172.21.15.119:0/3648990363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 0x7f480c067430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f480c159800 tx=0x7f47f4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24962f656dab4cab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480b7fe700 1 -- 172.21.15.119:0/3648990363 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400b820 con 0x7f480c142c40 2024-08-17T02:26:06.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480b7fe700 1 -- 172.21.15.119:0/3648990363 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f400b980 con 0x7f480c142c40 2024-08-17T02:26:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.274+0000 7f480b7fe700 1 -- 172.21.15.119:0/3648990363 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400bd20 con 0x7f480c142c40 2024-08-17T02:26:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 -- 172.21.15.119:0/3648990363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 msgr2=0x7f480c067430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 --2- 172.21.15.119:0/3648990363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 0x7f480c067430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f480c159800 tx=0x7f47f4009250 comp rx=0 tx=0).stop 2024-08-17T02:26:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 -- 172.21.15.119:0/3648990363 shutdown_connections 2024-08-17T02:26:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 --2- 172.21.15.119:0/3648990363 >> v2:172.21.15.19:3300/0 conn(0x7f480c067970 0x7f480c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 --2- 172.21.15.119:0/3648990363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 0x7f480c067430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 -- 172.21.15.119:0/3648990363 >> 172.21.15.119:0/3648990363 conn(0x7f480c0687a0 msgr2=0x7f480c06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 -- 172.21.15.119:0/3648990363 shutdown_connections 2024-08-17T02:26:06.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 -- 172.21.15.119:0/3648990363 wait complete. 2024-08-17T02:26:06.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 Processor -- start 2024-08-17T02:26:06.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 -- start start 2024-08-17T02:26:06.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f480c067970 0x7f480c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f480c142870 0x7f480c0ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 0x7f480c13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0aeae0 con 0x7f480c067970 2024-08-17T02:26:06.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c13ef80 con 0x7f480c142c40 2024-08-17T02:26:06.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.278+0000 7f4812ede700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0aed10 con 0x7f480c142870 2024-08-17T02:26:06.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f481147b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 0x7f480c13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f480bfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f480c142870 0x7f480c0ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f481147b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 0x7f480c13ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45574/0 (socket says 172.21.15.119:45574) 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f481147b700 1 -- 172.21.15.119:0/3981268018 learned_addr learned my addr 172.21.15.119:0/3981268018 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f4810c7a700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f480c067970 0x7f480c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f480bfff700 1 -- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f480c142870 msgr2=0x7f480c0ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f480bfff700 1 -- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f480c142870 msgr2=0x7f480c0ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f480bfff700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f480c142870 0x7f480c0ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f480bfff700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f480c142870 0x7f480c0ae5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f481147b700 1 -- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f480c142870 msgr2=0x7f480c0ae5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f481147b700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f480c142870 0x7f480c0ae5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f481147b700 1 -- 172.21.15.119:0/3981268018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f480c067970 msgr2=0x7f480c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f481147b700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f480c067970 0x7f480c0aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f481147b700 1 -- 172.21.15.119:0/3981268018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40094f0 con 0x7f480c142c40 2024-08-17T02:26:06.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f481147b700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 0x7f480c13ea40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4804009fa0 tx=0x7f4804009900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f4808ff9700 1 -- 172.21.15.119:0/3981268018 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400ec70 con 0x7f480c142c40 2024-08-17T02:26:06.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f4808ff9700 1 -- 172.21.15.119:0/3981268018 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480400edd0 con 0x7f480c142c40 2024-08-17T02:26:06.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f4812ede700 1 -- 172.21.15.119:0/3981268018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c0aeff0 con 0x7f480c142c40 2024-08-17T02:26:06.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f4808ff9700 1 -- 172.21.15.119:0/3981268018 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804014670 con 0x7f480c142c40 2024-08-17T02:26:06.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f4812ede700 1 -- 172.21.15.119:0/3981268018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c0af5b0 con 0x7f480c142c40 2024-08-17T02:26:06.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f4808ff9700 1 -- 172.21.15.119:0/3981268018 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f48040149e0 con 0x7f480c142c40 2024-08-17T02:26:06.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f4808ff9700 1 -- 172.21.15.119:0/3981268018 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f4804014c90 con 0x7f480c142c40 2024-08-17T02:26:06.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.282+0000 7f4812ede700 1 -- 172.21.15.119:0/3981268018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c0645c0 con 0x7f480c142c40 2024-08-17T02:26:06.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.286+0000 7f4808ff9700 1 -- 172.21.15.119:0/3981268018 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f48040273e0 con 0x7f480c142c40 2024-08-17T02:26:06.332 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:06.327+0000 7f77a51f3000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.382+0000 7f4812ede700 1 -- 172.21.15.119:0/3981268018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3baa2f45-afde-49eb-9956-3cb368a42cf6", "id": 2} v 0) v1 -- 0x7f480c0681b0 con 0x7f480c142c40 2024-08-17T02:26:06.391 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:06.383+0000 7f77a51f3000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:26:06.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4808ff9700 1 -- 172.21.15.119:0/3981268018 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3baa2f45-afde-49eb-9956-3cb368a42cf6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f480401e730 con 0x7f480c142c40 2024-08-17T02:26:06.394 INFO:teuthology.orchestra.run.smithi119.stdout:2 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4812ede700 1 -- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 msgr2=0x7f480c13ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4812ede700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 0x7f480c13ea40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4804009fa0 tx=0x7f4804009900 comp rx=0 tx=0).stop 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4812ede700 1 -- 172.21.15.119:0/3981268018 shutdown_connections 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4812ede700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f480c142c40 0x7f480c13ea40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4812ede700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f480c142870 0x7f480c0ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4812ede700 1 --2- 172.21.15.119:0/3981268018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f480c067970 0x7f480c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4812ede700 1 -- 172.21.15.119:0/3981268018 >> 172.21.15.119:0/3981268018 conn(0x7f480c0687a0 msgr2=0x7f480c13f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4812ede700 1 -- 172.21.15.119:0/3981268018 shutdown_connections 2024-08-17T02:26:06.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.390+0000 7f4812ede700 1 -- 172.21.15.119:0/3981268018 wait complete. 2024-08-17T02:26:06.407 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 6a303011-b8e6-49e8-abdc-db3500d77e7c 3 2024-08-17T02:26:06.509 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:06.503+0000 7f77a51f3000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:26:06.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.510+0000 7fa78d238700 1 Processor -- start 2024-08-17T02:26:06.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.510+0000 7fa78d238700 1 -- start start 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa788155c30 0x7fa788069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa788156000 0x7fa788069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78813aff0 con 0x7fa78813a4c0 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78813be40 con 0x7fa788156000 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78813d930 con 0x7fa788155c30 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa787fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa788155c30 0x7fa788069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa787fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa788155c30 0x7fa788069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45588/0 (socket says 172.21.15.119:45588) 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa787fff700 1 -- 172.21.15.119:0/4151187681 learned_addr learned my addr 172.21.15.119:0/4151187681 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa77ffff700 1 --2- 172.21.15.119:0/4151187681 >> v2:172.21.15.19:3300/0 conn(0x7fa788156000 0x7fa788069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa787fff700 1 -- 172.21.15.119:0/4151187681 >> v2:172.21.15.19:3300/0 conn(0x7fa788156000 msgr2=0x7fa788069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa787fff700 1 --2- 172.21.15.119:0/4151187681 >> v2:172.21.15.19:3300/0 conn(0x7fa788156000 0x7fa788069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa787fff700 1 -- 172.21.15.119:0/4151187681 >> v1:172.21.15.19:6789/0 conn(0x7fa78813a4c0 legacy=0x7fa78813a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa787fff700 1 -- 172.21.15.119:0/4151187681 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78813b230 con 0x7fa788155c30 2024-08-17T02:26:06.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa787fff700 1 --2- 172.21.15.119:0/4151187681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788155c30 0x7fa788069930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa78806df70 tx=0x7fa778009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c9a73c6ede4fd93 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa7877fe700 1 -- 172.21.15.119:0/4151187681 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77800b860 con 0x7fa788155c30 2024-08-17T02:26:06.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa7877fe700 1 -- 172.21.15.119:0/4151187681 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77800b9c0 con 0x7fa788155c30 2024-08-17T02:26:06.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa7877fe700 1 -- 172.21.15.119:0/4151187681 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77800bd60 con 0x7fa788155c30 2024-08-17T02:26:06.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 -- 172.21.15.119:0/4151187681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788155c30 msgr2=0x7fa788069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 --2- 172.21.15.119:0/4151187681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788155c30 0x7fa788069930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa78806df70 tx=0x7fa778009250 comp rx=0 tx=0).stop 2024-08-17T02:26:06.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 -- 172.21.15.119:0/4151187681 shutdown_connections 2024-08-17T02:26:06.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 --2- 172.21.15.119:0/4151187681 >> v2:172.21.15.19:3300/0 conn(0x7fa788156000 0x7fa788069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 --2- 172.21.15.119:0/4151187681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788155c30 0x7fa788069930 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 -- 172.21.15.119:0/4151187681 >> 172.21.15.119:0/4151187681 conn(0x7fa78806e170 msgr2=0x7fa78806e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 -- 172.21.15.119:0/4151187681 shutdown_connections 2024-08-17T02:26:06.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 -- 172.21.15.119:0/4151187681 wait complete. 2024-08-17T02:26:06.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 Processor -- start 2024-08-17T02:26:06.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.514+0000 7fa78d238700 1 -- start start 2024-08-17T02:26:06.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78d238700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 0x7fa788139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78d238700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa788155c30 0x7fa788154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78d238700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788156000 0x7fa788067710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78d238700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa788155460 con 0x7fa788155c30 2024-08-17T02:26:06.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78d238700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa788167190 con 0x7fa788156000 2024-08-17T02:26:06.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78d238700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7881679e0 con 0x7fa78813a4c0 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa787fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 0x7fa788139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78ca37700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788156000 0x7fa788067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa787fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 0x7fa788139640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:50778/0 (socket says 172.21.15.119:50778) 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78ca37700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788156000 0x7fa788067710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45596/0 (socket says 172.21.15.119:45596) 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa787fff700 1 -- 172.21.15.119:0/272287926 learned_addr learned my addr 172.21.15.119:0/272287926 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa787fff700 1 -- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 msgr2=0x7fa788139640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa787fff700 1 -- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 msgr2=0x7fa788139640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa787fff700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 0x7fa788139640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa77ffff700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa788155c30 0x7fa788154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa787fff700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 0x7fa788139640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78ca37700 1 -- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 msgr2=0x7fa788139640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78ca37700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 0x7fa788139640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78ca37700 1 -- 172.21.15.119:0/272287926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa788155c30 msgr2=0x7fa788154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78ca37700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa788155c30 0x7fa788154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78ca37700 1 -- 172.21.15.119:0/272287926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780094f0 con 0x7fa788156000 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa77ffff700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa788155c30 0x7fa788154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78ca37700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788156000 0x7fa788067710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa78000c830 tx=0x7fa780001690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa784ff9700 1 -- 172.21.15.119:0/272287926 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780012630 con 0x7fa788156000 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa784ff9700 1 -- 172.21.15.119:0/272287926 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780012790 con 0x7fa788156000 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78d238700 1 -- 172.21.15.119:0/272287926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa788155180 con 0x7fa788156000 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa784ff9700 1 -- 172.21.15.119:0/272287926 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780012b50 con 0x7fa788156000 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78d238700 1 -- 172.21.15.119:0/272287926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7881676f0 con 0x7fa788156000 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa784ff9700 1 -- 172.21.15.119:0/272287926 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa78001b400 con 0x7fa788156000 2024-08-17T02:26:06.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa784ff9700 1 -- 172.21.15.119:0/272287926 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fa78000a850 con 0x7fa788156000 2024-08-17T02:26:06.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.518+0000 7fa78d238700 1 -- 172.21.15.119:0/272287926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7880cc490 con 0x7fa788156000 2024-08-17T02:26:06.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.522+0000 7fa784ff9700 1 -- 172.21.15.119:0/272287926 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa78813aff0 con 0x7fa788156000 2024-08-17T02:26:06.527 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:06.522+0000 7f6698647000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:26:06.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.598+0000 7fa78d238700 1 -- 172.21.15.119:0/272287926 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6a303011-b8e6-49e8-abdc-db3500d77e7c", "id": 3} v 0) v1 -- 0x7fa7880638f0 con 0x7fa788156000 2024-08-17T02:26:06.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.606+0000 7fa784ff9700 1 -- 172.21.15.119:0/272287926 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a303011-b8e6-49e8-abdc-db3500d77e7c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa78001b840 con 0x7fa788156000 2024-08-17T02:26:06.612 INFO:teuthology.orchestra.run.smithi119.stdout:3 2024-08-17T02:26:06.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.610+0000 7fa78d238700 1 -- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788156000 msgr2=0x7fa788067710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.610+0000 7fa78d238700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788156000 0x7fa788067710 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa78000c830 tx=0x7fa780001690 comp rx=0 tx=0).stop 2024-08-17T02:26:06.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.610+0000 7fa78d238700 1 -- 172.21.15.119:0/272287926 shutdown_connections 2024-08-17T02:26:06.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.610+0000 7fa78d238700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa788156000 0x7fa788067710 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.610+0000 7fa78d238700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa788155c30 0x7fa788154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.610+0000 7fa78d238700 1 --2- 172.21.15.119:0/272287926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa78813a4c0 0x7fa788139640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.610+0000 7fa78d238700 1 -- 172.21.15.119:0/272287926 >> 172.21.15.119:0/272287926 conn(0x7fa78806e170 msgr2=0x7fa788159820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.610+0000 7fa78d238700 1 -- 172.21.15.119:0/272287926 shutdown_connections 2024-08-17T02:26:06.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.610+0000 7fa78d238700 1 -- 172.21.15.119:0/272287926 wait complete. 2024-08-17T02:26:06.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new d1b54d11-84a8-44e6-9c75-bcfa4d4820e2 4 2024-08-17T02:26:06.650 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:06.646+0000 7f6698647000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:26:06.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f932d5df700 1 Processor -- start 2024-08-17T02:26:06.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f932d5df700 1 -- start start 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f932d5df700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 0x7f93280b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f932d5df700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f932806bac0 0x7f93280686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f932d5df700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93280adb00 con 0x7f9328159400 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f932d5df700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932806bf40 con 0x7f932806bac0 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f932d5df700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280ac630 con 0x7f93281597d0 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93267fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 0x7f93280b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93277fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f932806bac0 0x7f93280686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93277fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f932806bac0 0x7f93280686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45610/0 (socket says 172.21.15.119:45610) 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93267fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 0x7f93280b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:50780/0 (socket says 172.21.15.119:50780) 2024-08-17T02:26:06.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93277fe700 1 -- 172.21.15.119:0/1934965427 learned_addr learned my addr 172.21.15.119:0/1934965427 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:06.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93267fc700 1 -- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 msgr2=0x7f93280b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:26:06.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93267fc700 1 -- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 msgr2=0x7f93280b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:06.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93267fc700 1 --2- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 0x7f93280b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:06.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93267fc700 1 --2- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 0x7f93280b1c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:06.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93277fe700 1 -- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 msgr2=0x7f93280b1c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:06.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93277fe700 1 --2- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 0x7f93280b1c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93277fe700 1 -- 172.21.15.119:0/1934965427 >> v1:172.21.15.19:6789/0 conn(0x7f9328159400 legacy=0x7f93280ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93277fe700 1 -- 172.21.15.119:0/1934965427 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280ac910 con 0x7f932806bac0 2024-08-17T02:26:06.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f93277fe700 1 --2- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 0x7f93280686a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f93180099b0 tx=0x7f9318009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d884509a4ba2df7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f9325ffb700 1 -- 172.21.15.119:0/1934965427 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800b860 con 0x7f932806bac0 2024-08-17T02:26:06.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f9325ffb700 1 -- 172.21.15.119:0/1934965427 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931800b9c0 con 0x7f932806bac0 2024-08-17T02:26:06.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.722+0000 7f9325ffb700 1 -- 172.21.15.119:0/1934965427 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800bd60 con 0x7f932806bac0 2024-08-17T02:26:06.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 msgr2=0x7f93280686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 --2- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 0x7f93280686a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f93180099b0 tx=0x7f9318009250 comp rx=0 tx=0).stop 2024-08-17T02:26:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- 172.21.15.119:0/1934965427 shutdown_connections 2024-08-17T02:26:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 --2- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 0x7f93280686a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 --2- 172.21.15.119:0/1934965427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93281597d0 0x7f93280b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- 172.21.15.119:0/1934965427 >> 172.21.15.119:0/1934965427 conn(0x7f93280c9bf0 msgr2=0x7f932806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- 172.21.15.119:0/1934965427 shutdown_connections 2024-08-17T02:26:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- 172.21.15.119:0/1934965427 wait complete. 2024-08-17T02:26:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 Processor -- start 2024-08-17T02:26:06.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- start start 2024-08-17T02:26:06.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 0x7f932814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 0x7f93280699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93281597d0 0x7f9328069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280c69e0 con 0x7f93281597d0 2024-08-17T02:26:06.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280a5f20 con 0x7f932806bac0 2024-08-17T02:26:06.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280a55f0 con 0x7f9328159400 2024-08-17T02:26:06.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f93267fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 0x7f93280699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f9326ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 0x7f932814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f93267fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 0x7f93280699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:50786/0 (socket says 172.21.15.119:50786) 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f93267fc700 1 -- 172.21.15.119:0/647418507 learned_addr learned my addr 172.21.15.119:0/647418507 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f93267fc700 1 -- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 msgr2=0x7f93280699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f93267fc700 1 -- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 msgr2=0x7f93280699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f93267fc700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 0x7f93280699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f93267fc700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 0x7f93280699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f93277fe700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93281597d0 0x7f9328069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f9326ffd700 1 -- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 msgr2=0x7f93280699a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f9326ffd700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 0x7f93280699a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f9326ffd700 1 -- 172.21.15.119:0/647418507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93281597d0 msgr2=0x7f9328069ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f9326ffd700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93281597d0 0x7f9328069ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f9326ffd700 1 -- 172.21.15.119:0/647418507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93180094f0 con 0x7f932806bac0 2024-08-17T02:26:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f9326ffd700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 0x7f932814e220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f932000c910 tx=0x7f93200016f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f931effd700 1 -- 172.21.15.119:0/647418507 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320012630 con 0x7f932806bac0 2024-08-17T02:26:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f931effd700 1 -- 172.21.15.119:0/647418507 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9320012790 con 0x7f932806bac0 2024-08-17T02:26:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- 172.21.15.119:0/647418507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93280a58d0 con 0x7f932806bac0 2024-08-17T02:26:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f931effd700 1 -- 172.21.15.119:0/647418507 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320012b50 con 0x7f932806bac0 2024-08-17T02:26:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f932d5df700 1 -- 172.21.15.119:0/647418507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932814e760 con 0x7f932806bac0 2024-08-17T02:26:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f931effd700 1 -- 172.21.15.119:0/647418507 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9320003030 con 0x7f932806bac0 2024-08-17T02:26:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.726+0000 7f931effd700 1 -- 172.21.15.119:0/647418507 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f932000a3b0 con 0x7f932806bac0 2024-08-17T02:26:06.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.730+0000 7f932d5df700 1 -- 172.21.15.119:0/647418507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93280645c0 con 0x7f932806bac0 2024-08-17T02:26:06.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.734+0000 7f931effd700 1 -- 172.21.15.119:0/647418507 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f932001b450 con 0x7f932806bac0 2024-08-17T02:26:06.753 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:06.747+0000 7f77a51f3000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:26:06.807 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:06.799+0000 7f77a51f3000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:26:06.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.810+0000 7f932d5df700 1 -- 172.21.15.119:0/647418507 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d1b54d11-84a8-44e6-9c75-bcfa4d4820e2", "id": 4} v 0) v1 -- 0x7f93280ae8e0 con 0x7f932806bac0 2024-08-17T02:26:06.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.818+0000 7f931effd700 1 -- 172.21.15.119:0/647418507 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1b54d11-84a8-44e6-9c75-bcfa4d4820e2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f932001b9f0 con 0x7f932806bac0 2024-08-17T02:26:06.823 INFO:teuthology.orchestra.run.smithi119.stdout:4 2024-08-17T02:26:06.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.818+0000 7f932d5df700 1 -- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 msgr2=0x7f932814e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.818+0000 7f932d5df700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 0x7f932814e220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f932000c910 tx=0x7f93200016f0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.818+0000 7f932d5df700 1 -- 172.21.15.119:0/647418507 shutdown_connections 2024-08-17T02:26:06.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.818+0000 7f932d5df700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93281597d0 0x7f9328069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.818+0000 7f932d5df700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9328159400 0x7f93280699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.818+0000 7f932d5df700 1 --2- 172.21.15.119:0/647418507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f932806bac0 0x7f932814e220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.818+0000 7f932d5df700 1 -- 172.21.15.119:0/647418507 >> 172.21.15.119:0/647418507 conn(0x7f93280c9bf0 msgr2=0x7f9328156370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.822+0000 7f932d5df700 1 -- 172.21.15.119:0/647418507 shutdown_connections 2024-08-17T02:26:06.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.822+0000 7f932d5df700 1 -- 172.21.15.119:0/647418507 wait complete. 2024-08-17T02:26:06.836 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new fb65c9d4-fe1a-4691-9e07-c04f8b44b769 5 2024-08-17T02:26:06.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 Processor -- start 2024-08-17T02:26:06.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 -- start start 2024-08-17T02:26:06.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff550155c30 0x7ff550069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff550156000 0x7ff550069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 0x7ff55013a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55013be40 con 0x7ff550156000 2024-08-17T02:26:06.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55013b230 con 0x7ff550155c30 2024-08-17T02:26:06.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55013b510 con 0x7ff55013a4c0 2024-08-17T02:26:06.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55601f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff550155c30 0x7ff550069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff556820700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 0x7ff55013a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff556820700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 0x7ff55013a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:50788/0 (socket says 172.21.15.119:50788) 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff556820700 1 -- 172.21.15.119:0/1262298728 learned_addr learned my addr 172.21.15.119:0/1262298728 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55601f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff550155c30 0x7ff550069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45630/0 (socket says 172.21.15.119:45630) 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff556820700 1 -- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 msgr2=0x7ff55013a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff556820700 1 -- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 msgr2=0x7ff55013a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff556820700 1 --2- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 0x7ff55013a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff556820700 1 --2- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 0x7ff55013a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55581e700 1 --2- 172.21.15.119:0/1262298728 >> v2:172.21.15.19:3300/0 conn(0x7ff550156000 0x7ff550069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55601f700 1 -- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 msgr2=0x7ff55013a920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55601f700 1 --2- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 0x7ff55013a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55601f700 1 -- 172.21.15.119:0/1262298728 >> v2:172.21.15.19:3300/0 conn(0x7ff550156000 msgr2=0x7ff550069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55601f700 1 --2- 172.21.15.119:0/1262298728 >> v2:172.21.15.19:3300/0 conn(0x7ff550156000 0x7ff550069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55601f700 1 -- 172.21.15.119:0/1262298728 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55013b7f0 con 0x7ff550155c30 2024-08-17T02:26:06.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55601f700 1 --2- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 0x7ff550069930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff55006df70 tx=0x7ff54c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afb102b1dd8e9edc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55501d700 1 -- 172.21.15.119:0/1262298728 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c00b6b0 con 0x7ff550155c30 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55501d700 1 -- 172.21.15.119:0/1262298728 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c00b810 con 0x7ff550155c30 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff55501d700 1 -- 172.21.15.119:0/1262298728 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c00bbb0 con 0x7ff550155c30 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 -- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 msgr2=0x7ff550069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.942+0000 7ff557021700 1 --2- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 0x7ff550069930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff55006df70 tx=0x7ff54c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- 172.21.15.119:0/1262298728 shutdown_connections 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 --2- 172.21.15.119:0/1262298728 >> v2:172.21.15.19:3300/0 conn(0x7ff550156000 0x7ff550069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 --2- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff55013a4c0 0x7ff55013a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 --2- 172.21.15.119:0/1262298728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 0x7ff550069930 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- 172.21.15.119:0/1262298728 >> 172.21.15.119:0/1262298728 conn(0x7ff55006e170 msgr2=0x7ff55006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- 172.21.15.119:0/1262298728 shutdown_connections 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- 172.21.15.119:0/1262298728 wait complete. 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 Processor -- start 2024-08-17T02:26:06.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- start start 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff55013a4c0 0x7ff550152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 0x7ff550152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 0x7ff5500676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501551c0 con 0x7ff55013a4c0 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500ac090 con 0x7ff550155c30 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff550154310 con 0x7ff550156000 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55581e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 0x7ff550152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff556820700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 0x7ff5500676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff556820700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 0x7ff5500676c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:50802/0 (socket says 172.21.15.119:50802) 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff556820700 1 -- 172.21.15.119:0/1118339461 learned_addr learned my addr 172.21.15.119:0/1118339461 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55581e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 0x7ff550152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45638/0 (socket says 172.21.15.119:45638) 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff556820700 1 -- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 msgr2=0x7ff5500676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff556820700 1 -- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 msgr2=0x7ff5500676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff556820700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 0x7ff5500676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:06.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff556820700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 0x7ff5500676c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55601f700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff55013a4c0 0x7ff550152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55581e700 1 -- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 msgr2=0x7ff5500676c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55581e700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 0x7ff5500676c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55581e700 1 -- 172.21.15.119:0/1118339461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff55013a4c0 msgr2=0x7ff550152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55581e700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff55013a4c0 0x7ff550152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55581e700 1 -- 172.21.15.119:0/1118339461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c009420 con 0x7ff550155c30 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55601f700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff55013a4c0 0x7ff550152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff55581e700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 0x7ff550152b50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff54000d860 tx=0x7ff540008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff5467fc700 1 -- 172.21.15.119:0/1118339461 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540014620 con 0x7ff550155c30 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff5467fc700 1 -- 172.21.15.119:0/1118339461 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540014780 con 0x7ff550155c30 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- 172.21.15.119:0/1118339461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5501545b0 con 0x7ff550155c30 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff5467fc700 1 -- 172.21.15.119:0/1118339461 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540014b20 con 0x7ff550155c30 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.946+0000 7ff557021700 1 -- 172.21.15.119:0/1118339461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff550154b70 con 0x7ff550155c30 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.950+0000 7ff5467fc700 1 -- 172.21.15.119:0/1118339461 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ff54001d400 con 0x7ff550155c30 2024-08-17T02:26:06.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.950+0000 7ff5467fc700 1 -- 172.21.15.119:0/1118339461 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7ff540012960 con 0x7ff550155c30 2024-08-17T02:26:06.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.950+0000 7ff557021700 1 -- 172.21.15.119:0/1118339461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff550155330 con 0x7ff550155c30 2024-08-17T02:26:06.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:06.954+0000 7ff5467fc700 1 -- 172.21.15.119:0/1118339461 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ff54003c7a0 con 0x7ff550155c30 2024-08-17T02:26:06.976 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:06.974+0000 7f6698647000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:26:06.994 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:06.987+0000 7f77a51f3000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:26:07.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.030+0000 7ff557021700 1 -- 172.21.15.119:0/1118339461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb65c9d4-fe1a-4691-9e07-c04f8b44b769", "id": 5} v 0) v1 -- 0x7ff5500638f0 con 0x7ff550155c30 2024-08-17T02:26:07.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff5467fc700 1 -- 172.21.15.119:0/1118339461 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb65c9d4-fe1a-4691-9e07-c04f8b44b769", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff54002b070 con 0x7ff550155c30 2024-08-17T02:26:07.041 INFO:teuthology.orchestra.run.smithi119.stdout:5 2024-08-17T02:26:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff557021700 1 -- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 msgr2=0x7ff550152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff557021700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 0x7ff550152b50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff54000d860 tx=0x7ff540008040 comp rx=0 tx=0).stop 2024-08-17T02:26:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff557021700 1 -- 172.21.15.119:0/1118339461 shutdown_connections 2024-08-17T02:26:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff557021700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff550156000 0x7ff5500676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff557021700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff550155c30 0x7ff550152b50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff557021700 1 --2- 172.21.15.119:0/1118339461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff55013a4c0 0x7ff550152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff557021700 1 -- 172.21.15.119:0/1118339461 >> 172.21.15.119:0/1118339461 conn(0x7ff55006e170 msgr2=0x7ff5500cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff557021700 1 -- 172.21.15.119:0/1118339461 shutdown_connections 2024-08-17T02:26:07.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.038+0000 7ff557021700 1 -- 172.21.15.119:0/1118339461 wait complete. 2024-08-17T02:26:07.055 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 5abac1db-7197-4124-a005-d24e2f630501 6 2024-08-17T02:26:07.059 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:07.055+0000 7f77a51f3000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:26:07.127 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:07.119+0000 7f77a51f3000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:26:07.145 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:07.142+0000 7f6698647000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:26:07.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d6cf8700 1 Processor -- start 2024-08-17T02:26:07.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d6cf8700 1 -- start start 2024-08-17T02:26:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d6cf8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa1d0156d70 0x7fa1d00678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d6cf8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 0x7fa1d00b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d6cf8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d00cba90 con 0x7fa1d0067e00 2024-08-17T02:26:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d6cf8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d00cae80 con 0x7fa1d0156d70 2024-08-17T02:26:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d6cf8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00cb160 con 0x7fa1d0157140 2024-08-17T02:26:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d54f5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 0x7fa1d00b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d54f5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 0x7fa1d00b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:50806/0 (socket says 172.21.15.119:50806) 2024-08-17T02:26:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d54f5700 1 -- 172.21.15.119:0/1738017738 learned_addr learned my addr 172.21.15.119:0/1738017738 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d54f5700 1 -- 172.21.15.119:0/1738017738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 msgr2=0x7fa1d00b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:26:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d54f5700 1 -- 172.21.15.119:0/1738017738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 msgr2=0x7fa1d00b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d54f5700 1 --2- 172.21.15.119:0/1738017738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 0x7fa1d00b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d5cf6700 1 --2- 172.21.15.119:0/1738017738 >> v2:172.21.15.19:3300/0 conn(0x7fa1d0156d70 0x7fa1d00678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d54f5700 1 --2- 172.21.15.119:0/1738017738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 0x7fa1d00b2060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:07.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d5cf6700 1 -- 172.21.15.119:0/1738017738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 msgr2=0x7fa1d00b2060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d5cf6700 1 --2- 172.21.15.119:0/1738017738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 0x7fa1d00b2060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d5cf6700 1 -- 172.21.15.119:0/1738017738 >> v1:172.21.15.19:6789/0 conn(0x7fa1d0067e00 legacy=0x7fa1d00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d4cf4700 1 -- 172.21.15.119:0/1738017738 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562798424 0 0) 0x7fa1d00cba90 con 0x7fa1d0067e00 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d5cf6700 1 -- 172.21.15.119:0/1738017738 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d00cb440 con 0x7fa1d0156d70 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d5cf6700 1 --2- 172.21.15.119:0/1738017738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d0156d70 0x7fa1d00678c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e60 tx=0x7fa1c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92d289da2d962cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d4cf4700 1 -- 172.21.15.119:0/1738017738 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800e070 con 0x7fa1d0156d70 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d4cf4700 1 -- 172.21.15.119:0/1738017738 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c800bc30 con 0x7fa1d0156d70 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d4cf4700 1 -- 172.21.15.119:0/1738017738 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8012430 con 0x7fa1d0156d70 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1738017738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d0156d70 msgr2=0x7fa1d00678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.150+0000 7fa1d6cf8700 1 --2- 172.21.15.119:0/1738017738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d0156d70 0x7fa1d00678c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e60 tx=0x7fa1c8009780 comp rx=0 tx=0).stop 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1738017738 shutdown_connections 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 --2- 172.21.15.119:0/1738017738 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0157140 0x7fa1d00b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 --2- 172.21.15.119:0/1738017738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d0156d70 0x7fa1d00678c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1738017738 >> 172.21.15.119:0/1738017738 conn(0x7fa1d006e170 msgr2=0x7fa1d006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1738017738 shutdown_connections 2024-08-17T02:26:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1738017738 wait complete. 2024-08-17T02:26:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 Processor -- start 2024-08-17T02:26:07.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 -- start start 2024-08-17T02:26:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 0x7fa1d015a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d0156d70 0x7fa1d014eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0157140 0x7fa1d014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d015c210 con 0x7fa1d0156d70 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d015bd80 con 0x7fa1d0157140 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d6cf8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d015b170 con 0x7fa1d0067e00 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d5cf6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 0x7fa1d015a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d5cf6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 0x7fa1d015a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:50816/0 (socket says 172.21.15.119:50816) 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d64f7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0157140 0x7fa1d014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d5cf6700 1 -- 172.21.15.119:0/1219970461 learned_addr learned my addr 172.21.15.119:0/1219970461 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d5cf6700 1 -- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 msgr2=0x7fa1d015a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d5cf6700 1 -- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 msgr2=0x7fa1d015a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d54f5700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d0156d70 0x7fa1d014eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d5cf6700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 0x7fa1d015a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d5cf6700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 0x7fa1d015a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d64f7700 1 -- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 msgr2=0x7fa1d015a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d64f7700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 0x7fa1d015a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d64f7700 1 -- 172.21.15.119:0/1219970461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d0156d70 msgr2=0x7fa1d014eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d64f7700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d0156d70 0x7fa1d014eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d64f7700 1 -- 172.21.15.119:0/1219970461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c8009a20 con 0x7fa1d0157140 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.154+0000 7fa1d64f7700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0157140 0x7fa1d014f2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c490 tx=0x7fa1cc007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.158+0000 7fa1c5ffb700 1 -- 172.21.15.119:0/1219970461 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc011590 con 0x7fa1d0157140 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.158+0000 7fa1c5ffb700 1 -- 172.21.15.119:0/1219970461 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0116f0 con 0x7fa1d0157140 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.158+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1219970461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d015b450 con 0x7fa1d0157140 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.158+0000 7fa1c5ffb700 1 -- 172.21.15.119:0/1219970461 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc011ab0 con 0x7fa1d0157140 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.158+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1219970461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d015ba10 con 0x7fa1d0157140 2024-08-17T02:26:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.158+0000 7fa1c5ffb700 1 -- 172.21.15.119:0/1219970461 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa1cc01c440 con 0x7fa1d0157140 2024-08-17T02:26:07.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.158+0000 7fa1c5ffb700 1 -- 172.21.15.119:0/1219970461 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fa1cc000fe0 con 0x7fa1d0157140 2024-08-17T02:26:07.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.158+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1219970461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d00638f0 con 0x7fa1d0157140 2024-08-17T02:26:07.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.162+0000 7fa1c5ffb700 1 -- 172.21.15.119:0/1219970461 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa1cc017070 con 0x7fa1d0157140 2024-08-17T02:26:07.209 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:07.206+0000 7f6698647000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:26:07.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.238+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1219970461 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5abac1db-7197-4124-a005-d24e2f630501", "id": 6} v 0) v1 -- 0x7fa1d006f1a0 con 0x7fa1d0157140 2024-08-17T02:26:07.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1c5ffb700 1 -- 172.21.15.119:0/1219970461 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5abac1db-7197-4124-a005-d24e2f630501", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa1cc011e60 con 0x7fa1d0157140 2024-08-17T02:26:07.249 INFO:teuthology.orchestra.run.smithi119.stdout:6 2024-08-17T02:26:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0157140 msgr2=0x7fa1d014f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1d6cf8700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0157140 0x7fa1d014f2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c490 tx=0x7fa1cc007ea0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1219970461 shutdown_connections 2024-08-17T02:26:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1d6cf8700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0157140 0x7fa1d014f2e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1d6cf8700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1d0156d70 0x7fa1d014eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1d6cf8700 1 --2- 172.21.15.119:0/1219970461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1d0067e00 0x7fa1d015a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1219970461 >> 172.21.15.119:0/1219970461 conn(0x7fa1d006e170 msgr2=0x7fa1d0157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1219970461 shutdown_connections 2024-08-17T02:26:07.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.246+0000 7fa1d6cf8700 1 -- 172.21.15.119:0/1219970461 wait complete. 2024-08-17T02:26:07.261 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new c227f270-7015-4604-8bcd-7ea1152aa67f 7 2024-08-17T02:26:07.266 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:07.262+0000 7f6698647000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:26:07.325 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:07.322+0000 7f6698647000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:26:07.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.354+0000 7f1d2bb47700 1 Processor -- start 2024-08-17T02:26:07.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.354+0000 7f1d2bb47700 1 -- start start 2024-08-17T02:26:07.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d24159400 0x7f1d240b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d240adb00 con 0x7f1d2406bac0 2024-08-17T02:26:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2406bf60 con 0x7f1d241597d0 2024-08-17T02:26:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d240ac630 con 0x7f1d24159400 2024-08-17T02:26:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d298e3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d24159400 0x7f1d240b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d290e2700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1d241597d0 0x7f1d240ad3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33320/0 (socket says 172.21.15.119:33320) 2024-08-17T02:26:07.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d290e2700 1 -- 172.21.15.119:0/381744502 learned_addr learned my addr 172.21.15.119:0/381744502 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-08-17T02:26:07.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d288e1700 1 -- 172.21.15.119:0/381744502 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130612109 0 0) 0x7f1d2406bf60 con 0x7f1d241597d0 2024-08-17T02:26:07.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d288e1700 1 -- 172.21.15.119:0/381744502 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d10003570 con 0x7f1d241597d0 2024-08-17T02:26:07.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d298e3700 1 -- 172.21.15.119:0/381744502 >> v1:172.21.15.119:6789/0 conn(0x7f1d241597d0 legacy=0x7f1d240ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d298e3700 1 -- 172.21.15.119:0/381744502 >> v1:172.21.15.19:6789/0 conn(0x7f1d2406bac0 legacy=0x7f1d240686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d298e3700 1 -- 172.21.15.119:0/381744502 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d240ac910 con 0x7f1d24159400 2024-08-17T02:26:07.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d298e3700 1 --2- 172.21.15.119:0/381744502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d24159400 0x7f1d240b1c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1d200098e0 tx=0x7f1d200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=503e1e6bfb876820 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d288e1700 1 -- 172.21.15.119:0/381744502 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000b640 con 0x7f1d24159400 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d288e1700 1 -- 172.21.15.119:0/381744502 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2000b7a0 con 0x7f1d24159400 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d288e1700 1 -- 172.21.15.119:0/381744502 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000bb40 con 0x7f1d24159400 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 -- 172.21.15.119:0/381744502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d24159400 msgr2=0x7f1d240b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 --2- 172.21.15.119:0/381744502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d24159400 0x7f1d240b1c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1d200098e0 tx=0x7f1d200091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 -- 172.21.15.119:0/381744502 shutdown_connections 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 --2- 172.21.15.119:0/381744502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d24159400 0x7f1d240b1c00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 -- 172.21.15.119:0/381744502 >> 172.21.15.119:0/381744502 conn(0x7f1d240c9bf0 msgr2=0x7f1d2406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 -- 172.21.15.119:0/381744502 shutdown_connections 2024-08-17T02:26:07.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.358+0000 7f1d2bb47700 1 -- 172.21.15.119:0/381744502 wait complete. 2024-08-17T02:26:07.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 Processor -- start 2024-08-17T02:26:07.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 -- start start 2024-08-17T02:26:07.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d2406bac0 0x7f1d2414cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d241597d0 0x7f1d2414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d2414e7c0 0x7f1d240cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d241672c0 con 0x7f1d2406bac0 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2414ecd0 con 0x7f1d241597d0 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d24166500 con 0x7f1d2414e7c0 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d290e2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d241597d0 0x7f1d2414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2a0e4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d2414e7c0 0x7f1d240cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d290e2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d241597d0 0x7f1d2414e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:45680/0 (socket says 172.21.15.119:45680) 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d290e2700 1 -- 172.21.15.119:0/1351722006 learned_addr learned my addr 172.21.15.119:0/1351722006 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d298e3700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d2406bac0 0x7f1d2414cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2a0e4700 1 -- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d2414e7c0 msgr2=0x7f1d240cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2a0e4700 1 -- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d2414e7c0 msgr2=0x7f1d240cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2a0e4700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d2414e7c0 0x7f1d240cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2a0e4700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d2414e7c0 0x7f1d240cad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d290e2700 1 -- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d2414e7c0 msgr2=0x7f1d240cad40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d290e2700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d2414e7c0 0x7f1d240cad40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d290e2700 1 -- 172.21.15.119:0/1351722006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d2406bac0 msgr2=0x7f1d2414cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d290e2700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d2406bac0 0x7f1d2414cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d290e2700 1 -- 172.21.15.119:0/1351722006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20009420 con 0x7f1d241597d0 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d290e2700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d241597d0 0x7f1d2414e280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400c590 tx=0x7f1d14007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d19ffb700 1 -- 172.21.15.119:0/1351722006 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14005cd0 con 0x7f1d241597d0 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d19ffb700 1 -- 172.21.15.119:0/1351722006 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d14005e50 con 0x7f1d241597d0 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 -- 172.21.15.119:0/1351722006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d241667e0 con 0x7f1d241597d0 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d19ffb700 1 -- 172.21.15.119:0/1351722006 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14007320 con 0x7f1d241597d0 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.362+0000 7f1d2bb47700 1 -- 172.21.15.119:0/1351722006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d24166da0 con 0x7f1d241597d0 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.366+0000 7f1d19ffb700 1 -- 172.21.15.119:0/1351722006 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1d1401c440 con 0x7f1d241597d0 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.366+0000 7f1d19ffb700 1 -- 172.21.15.119:0/1351722006 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f1d140076d0 con 0x7f1d241597d0 2024-08-17T02:26:07.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.366+0000 7f1d2bb47700 1 -- 172.21.15.119:0/1351722006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d24166fc0 con 0x7f1d241597d0 2024-08-17T02:26:07.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.366+0000 7f1d19ffb700 1 -- 172.21.15.119:0/1351722006 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1d14017070 con 0x7f1d241597d0 2024-08-17T02:26:07.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.442+0000 7f1d2bb47700 1 -- 172.21.15.119:0/1351722006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c227f270-7015-4604-8bcd-7ea1152aa67f", "id": 7} v 0) v1 -- 0x7f1d240645c0 con 0x7f1d241597d0 2024-08-17T02:26:07.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.450+0000 7f1d19ffb700 1 -- 172.21.15.119:0/1351722006 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c227f270-7015-4604-8bcd-7ea1152aa67f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1d1401c6f0 con 0x7f1d241597d0 2024-08-17T02:26:07.455 INFO:teuthology.orchestra.run.smithi119.stdout:7 2024-08-17T02:26:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.454+0000 7f1d2bb47700 1 -- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d241597d0 msgr2=0x7f1d2414e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.454+0000 7f1d2bb47700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d241597d0 0x7f1d2414e280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400c590 tx=0x7f1d14007e00 comp rx=0 tx=0).stop 2024-08-17T02:26:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.454+0000 7f1d2bb47700 1 -- 172.21.15.119:0/1351722006 shutdown_connections 2024-08-17T02:26:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.454+0000 7f1d2bb47700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d2414e7c0 0x7f1d240cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.454+0000 7f1d2bb47700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d241597d0 0x7f1d2414e280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.454+0000 7f1d2bb47700 1 --2- 172.21.15.119:0/1351722006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d2406bac0 0x7f1d2414cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.454+0000 7f1d2bb47700 1 -- 172.21.15.119:0/1351722006 >> 172.21.15.119:0/1351722006 conn(0x7f1d240c9bf0 msgr2=0x7f1d240ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.454+0000 7f1d2bb47700 1 -- 172.21.15.119:0/1351722006 shutdown_connections 2024-08-17T02:26:07.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-08-17T02:26:07.454+0000 7f1d2bb47700 1 -- 172.21.15.119:0/1351722006 wait complete. 2024-08-17T02:26:07.470 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:26:07.470 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:26:07.473 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:26:07.473 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:26:07.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:26:07.475 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:26:07.475 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:26:07.476 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:26:07.478 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:26:07.478 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:26:07.478 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:26:07.480 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:26:07.481 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:26:07.481 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:26:07.482 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:26:07.483 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:26:07.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:26:07.486 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:26:07.486 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:26:07.486 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:26:07.488 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:26:07.488 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:26:07.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:26:07.489 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:07.486+0000 7f6698647000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:26:07.490 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:26:07.491 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:07.592 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:07.587+0000 7f77a51f3000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:26:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.595+0000 7f364d02e700 1 Processor -- start 2024-08-17T02:26:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.595+0000 7f364d02e700 1 -- start start 2024-08-17T02:26:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.595+0000 7f364d02e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 0x7f364815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.595+0000 7f364d02e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480ad6e0 con 0x7f364815aed0 2024-08-17T02:26:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.595+0000 7f364d02e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480c86a0 con 0x7f3648140db0 2024-08-17T02:26:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.595+0000 7f364d02e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36480ca6e0 con 0x7f36480ca200 2024-08-17T02:26:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3646d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f364815aed0 0x7f36481406a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48966/0 (socket says 172.21.15.19:48966) 2024-08-17T02:26:07.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3646d9d700 1 -- 172.21.15.19:0/2279840436 learned_addr learned my addr 172.21.15.19:0/2279840436 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:07.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 0x7f364815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 -- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 msgr2=0x7f364815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:26:07.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 -- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 msgr2=0x7f364815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:07.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 0x7f364815b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 0x7f364815b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348835501 0 0) 0x7f36480ad6e0 con 0x7f364815aed0 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3630003570 con 0x7f364815aed0 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11968465 0 0) 0x7f36480c86a0 con 0x7f3648140db0 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36480ad6e0 con 0x7f3648140db0 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976701548 0 0) 0x7f3630003570 con 0x7f364815aed0 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 msgr2=0x7f364815b2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 0x7f364815b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 >> v1:172.21.15.119:6789/0 conn(0x7f3648140db0 legacy=0x7f36480c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480c88f0 con 0x7f364815aed0 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f3638001470 con 0x7f364815aed0 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 >> v1:172.21.15.19:6789/0 conn(0x7f364815aed0 legacy=0x7f36481406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3630003c20 0x7f3630004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 0x7f3630004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3630004da0 0x7f3630005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36480ca6e0 con 0x7f3630004da0 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363000bbf0 con 0x7f3630003c20 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363000bdb0 con 0x7f36480ca200 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3630004da0 0x7f3630005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3646d9d700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3630003c20 0x7f3630004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364659c700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 0x7f3630004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 -- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 msgr2=0x7f3630004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36480ca200 0x7f3630004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 -- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3630003c20 msgr2=0x7f3630004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3630003c20 0x7f3630004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 -- 172.21.15.19:0/2279840436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630003570 con 0x7f3630004da0 2024-08-17T02:26:07.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3630004da0 0x7f3630005210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3640007440 tx=0x7f3640009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c272a1d6de10c9f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640009a30 con 0x7f3630004da0 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640007cf0 con 0x7f3630004da0 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f3645d9b700 1 -- 172.21.15.19:0/2279840436 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640014630 con 0x7f3630004da0 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364d02e700 1 -- 172.21.15.19:0/2279840436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3630004da0 msgr2=0x7f3630005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364d02e700 1 --2- 172.21.15.19:0/2279840436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3630004da0 0x7f3630005210 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3640007440 tx=0x7f3640009720 comp rx=0 tx=0).stop 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364759e700 1 -- 172.21.15.19:0/2279840436 reap_dead start 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364d02e700 1 -- 172.21.15.19:0/2279840436 shutdown_connections 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364d02e700 1 -- 172.21.15.19:0/2279840436 >> 172.21.15.19:0/2279840436 conn(0x7f36480caad0 msgr2=0x7f36480caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364d02e700 1 -- 172.21.15.19:0/2279840436 shutdown_connections 2024-08-17T02:26:07.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.599+0000 7f364d02e700 1 -- 172.21.15.19:0/2279840436 wait complete. 2024-08-17T02:26:07.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 Processor -- start 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 -- start start 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3648156ad0 0x7f364815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3648156ea0 0x7f364815d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36480cbc10 0x7f36480cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364813aff0 con 0x7f3648156ea0 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36480cc940 con 0x7f36480cbc10 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36480ccc20 con 0x7f3648156ad0 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3648156ea0 0x7f364815d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3648156ea0 0x7f364815d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46444/0 (socket says 172.21.15.19:46444) 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364659c700 1 -- 172.21.15.19:0/1949502365 learned_addr learned my addr 172.21.15.19:0/1949502365 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364759e700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36480cbc10 0x7f36480cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f3646d9d700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3648156ad0 0x7f364815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364659c700 1 -- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3648156ad0 msgr2=0x7f364815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f3646d9d700 1 -- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3648156ad0 msgr2=0x7f364815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f3646d9d700 1 -- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3648156ad0 msgr2=0x7f364815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f3646d9d700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3648156ad0 0x7f364815cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f3646d9d700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3648156ad0 0x7f364815cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364659c700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3648156ad0 0x7f364815cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364659c700 1 -- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36480cbc10 msgr2=0x7f36480cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364659c700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36480cbc10 0x7f36480cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364659c700 1 -- 172.21.15.19:0/1949502365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364813a9a0 con 0x7f3648156ea0 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364659c700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3648156ea0 0x7f364815d470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f363c002bd0 tx=0x7f363c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f362effd700 1 -- 172.21.15.19:0/1949502365 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00f9a0 con 0x7f3648156ea0 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f362effd700 1 -- 172.21.15.19:0/1949502365 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00fb20 con 0x7f3648156ea0 2024-08-17T02:26:07.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 -- 172.21.15.19:0/1949502365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364813ac80 con 0x7f3648156ea0 2024-08-17T02:26:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f362effd700 1 -- 172.21.15.19:0/1949502365 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00fee0 con 0x7f3648156ea0 2024-08-17T02:26:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.603+0000 7f364d02e700 1 -- 172.21.15.19:0/1949502365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3648159560 con 0x7f3648156ea0 2024-08-17T02:26:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.607+0000 7f362effd700 1 -- 172.21.15.19:0/1949502365 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f363c013600 con 0x7f3648156ea0 2024-08-17T02:26:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.607+0000 7f364d02e700 1 -- 172.21.15.19:0/1949502365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36480645c0 con 0x7f3648156ea0 2024-08-17T02:26:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.607+0000 7f362effd700 1 -- 172.21.15.19:0/1949502365 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f363c01cae0 con 0x7f3648156ea0 2024-08-17T02:26:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.607+0000 7f362effd700 1 -- 172.21.15.19:0/1949502365 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f363c03b7a0 con 0x7f3648156ea0 2024-08-17T02:26:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.671+0000 7f364d02e700 1 -- 172.21.15.19:0/1949502365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f364813fc60 con 0x7f3648156ea0 2024-08-17T02:26:07.678 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:07.674+0000 7f6698647000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:26:07.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.671+0000 7f362effd700 1 -- 172.21.15.19:0/1949502365 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f363c02a070 con 0x7f3648156ea0 2024-08-17T02:26:07.679 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:07.679 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:07.445054+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:07.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.675+0000 7f364d02e700 1 -- 172.21.15.19:0/1949502365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3648156ea0 msgr2=0x7f364815d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.675+0000 7f364d02e700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3648156ea0 0x7f364815d470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f363c002bd0 tx=0x7f363c007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.675+0000 7f364d02e700 1 -- 172.21.15.19:0/1949502365 shutdown_connections 2024-08-17T02:26:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.675+0000 7f364d02e700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36480cbc10 0x7f36480cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.675+0000 7f364d02e700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3648156ea0 0x7f364815d470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.675+0000 7f364d02e700 1 --2- 172.21.15.19:0/1949502365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3648156ad0 0x7f364815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.675+0000 7f364d02e700 1 -- 172.21.15.19:0/1949502365 >> 172.21.15.19:0/1949502365 conn(0x7f36480caad0 msgr2=0x7f364813e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.675+0000 7f364d02e700 1 -- 172.21.15.19:0/1949502365 shutdown_connections 2024-08-17T02:26:07.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:07.675+0000 7f364d02e700 1 -- 172.21.15.19:0/1949502365 wait complete. 2024-08-17T02:26:07.696 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:26:07.696 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:26:07.718 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:07.711+0000 7f77a51f3000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:26:07.748 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:07.746+0000 7f6698647000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:26:07.841 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-08-17T02:26:07.835+0000 7f146732f3c0 -1 Falling back to public interface 2024-08-17T02:26:07.841 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-08-17T02:26:07.835+0000 7f9d202bb3c0 -1 Falling back to public interface 2024-08-17T02:26:07.858 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-08-17T02:26:07.854+0000 7f71342e53c0 -1 Falling back to public interface 2024-08-17T02:26:07.881 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-08-17T02:26:07.878+0000 7f477601f3c0 -1 Falling back to public interface 2024-08-17T02:26:07.893 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-08-17T02:26:07.890+0000 7f852a6e33c0 -1 Falling back to public interface 2024-08-17T02:26:07.924 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:07.918+0000 7f6698647000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:26:07.996 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:07.990+0000 7f6698647000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:26:08.049 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:08.043+0000 7f77a51f3000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:26:08.090 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-08-17T02:26:08.083+0000 7f1ee05013c0 -1 Falling back to public interface 2024-08-17T02:26:08.094 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-08-17T02:26:08.090+0000 7f4afb1343c0 -1 Falling back to public interface 2024-08-17T02:26:08.109 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-08-17T02:26:08.103+0000 7f8959e4a3c0 -1 Falling back to public interface 2024-08-17T02:26:08.220 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:08.215+0000 7f77a51f3000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:26:08.289 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:08.283+0000 7f77a51f3000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:26:08.344 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:08.339+0000 7f77a51f3000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:26:08.402 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:08.395+0000 7f77a51f3000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:26:08.502 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:08.586 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:08.579+0000 7f77a51f3000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:26:08.609 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f864b4700 1 Processor -- start 2024-08-17T02:26:08.609 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f864b4700 1 -- start start 2024-08-17T02:26:08.610 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f864b4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f800ad3d0 0x7f4f80151950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.610 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f864b4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f800ab790 con 0x7f4f80151580 2024-08-17T02:26:08.610 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f864b4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f800aba70 con 0x7f4f800ae960 2024-08-17T02:26:08.610 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f864b4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f800abd50 con 0x7f4f800ad3d0 2024-08-17T02:26:08.610 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f84a51700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f800ad3d0 0x7f4f80151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.610 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f7ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4f80151580 0x7f4f800aad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56872/0 (socket says 172.21.15.19:56872) 2024-08-17T02:26:08.610 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f84a51700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f800ad3d0 0x7f4f80151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35810/0 (socket says 172.21.15.19:35810) 2024-08-17T02:26:08.610 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f7ffff700 1 -- 172.21.15.19:0/3154467145 learned_addr learned my addr 172.21.15.19:0/3154467145 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:08.611 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f84a51700 1 -- 172.21.15.19:0/3154467145 >> v1:172.21.15.119:6789/0 conn(0x7f4f800ae960 legacy=0x7f4f800accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.611 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f84a51700 1 -- 172.21.15.19:0/3154467145 >> v1:172.21.15.19:6789/0 conn(0x7f4f80151580 legacy=0x7f4f800aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.611 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f7f7fe700 1 -- 172.21.15.19:0/3154467145 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225964358 0 0) 0x7f4f800ab790 con 0x7f4f80151580 2024-08-17T02:26:08.611 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f84a51700 1 -- 172.21.15.19:0/3154467145 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800ac030 con 0x7f4f800ad3d0 2024-08-17T02:26:08.611 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f84a51700 1 --2- 172.21.15.19:0/3154467145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f800ad3d0 0x7f4f80151950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009e60 tx=0x7f4f78009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366643eb0e519e07 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.612 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f7f7fe700 1 -- 172.21.15.19:0/3154467145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800e070 con 0x7f4f800ad3d0 2024-08-17T02:26:08.612 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f7f7fe700 1 -- 172.21.15.19:0/3154467145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7800bc30 con 0x7f4f800ad3d0 2024-08-17T02:26:08.612 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.603+0000 7f4f7f7fe700 1 -- 172.21.15.19:0/3154467145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78012430 con 0x7f4f800ad3d0 2024-08-17T02:26:08.612 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- 172.21.15.19:0/3154467145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f800ad3d0 msgr2=0x7f4f80151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.612 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 --2- 172.21.15.19:0/3154467145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f800ad3d0 0x7f4f80151950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009e60 tx=0x7f4f78009780 comp rx=0 tx=0).stop 2024-08-17T02:26:08.612 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- 172.21.15.19:0/3154467145 shutdown_connections 2024-08-17T02:26:08.613 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 --2- 172.21.15.19:0/3154467145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f800ad3d0 0x7f4f80151950 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.613 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- 172.21.15.19:0/3154467145 >> 172.21.15.19:0/3154467145 conn(0x7f4f800ce0e0 msgr2=0x7f4f800ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.613 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- 172.21.15.19:0/3154467145 shutdown_connections 2024-08-17T02:26:08.613 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- 172.21.15.19:0/3154467145 wait complete. 2024-08-17T02:26:08.613 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 Processor -- start 2024-08-17T02:26:08.613 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- start start 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f800ad3d0 0x7f4f80140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f800ae960 0x7f4f8006e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f80151580 0x7f4f8006e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8014f2a0 con 0x7f4f80151580 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f801410b0 con 0x7f4f800ae960 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f801573c0 con 0x7f4f800ad3d0 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f84a51700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f80151580 0x7f4f8006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f84a51700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f80151580 0x7f4f8006e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35814/0 (socket says 172.21.15.19:35814) 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f84a51700 1 -- 172.21.15.19:0/2924199369 learned_addr learned my addr 172.21.15.19:0/2924199369 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f77fff700 1 --2- 172.21.15.19:0/2924199369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f800ae960 0x7f4f8006e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f7ffff700 1 --2- 172.21.15.19:0/2924199369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f800ad3d0 0x7f4f80140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f84a51700 1 -- 172.21.15.19:0/2924199369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f800ad3d0 msgr2=0x7f4f80140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f84a51700 1 --2- 172.21.15.19:0/2924199369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f800ad3d0 0x7f4f80140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f84a51700 1 -- 172.21.15.19:0/2924199369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f800ae960 msgr2=0x7f4f8006e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f84a51700 1 --2- 172.21.15.19:0/2924199369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f800ae960 0x7f4f8006e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f84a51700 1 -- 172.21.15.19:0/2924199369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78009a20 con 0x7f4f80151580 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f84a51700 1 --2- 172.21.15.19:0/2924199369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f80151580 0x7f4f8006e680 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4f78013000 tx=0x7f4f78019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f7cff9700 1 -- 172.21.15.19:0/2924199369 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7801b630 con 0x7f4f80151580 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f7cff9700 1 -- 172.21.15.19:0/2924199369 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7801b790 con 0x7f4f80151580 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- 172.21.15.19:0/2924199369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f801576a0 con 0x7f4f80151580 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f7cff9700 1 -- 172.21.15.19:0/2924199369 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7801bb30 con 0x7f4f80151580 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f864b4700 1 -- 172.21.15.19:0/2924199369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f80157c60 con 0x7f4f80151580 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f7cff9700 1 -- 172.21.15.19:0/2924199369 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4f7802f440 con 0x7f4f80151580 2024-08-17T02:26:08.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.607+0000 7f4f7cff9700 1 -- 172.21.15.19:0/2924199369 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f4f7801cae0 con 0x7f4f80151580 2024-08-17T02:26:08.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.611+0000 7f4f864b4700 1 -- 172.21.15.19:0/2924199369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f80064c10 con 0x7f4f80151580 2024-08-17T02:26:08.620 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.615+0000 7f4f7cff9700 1 -- 172.21.15.19:0/2924199369 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f4f7802a070 con 0x7f4f80151580 2024-08-17T02:26:08.687 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.679+0000 7f4f864b4700 1 -- 172.21.15.19:0/2924199369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f80141350 con 0x7f4f80151580 2024-08-17T02:26:08.688 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f7cff9700 1 -- 172.21.15.19:0/2924199369 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f4f7801ccf0 con 0x7f4f80151580 2024-08-17T02:26:08.688 INFO:teuthology.misc.health.smithi019.stdout: 2024-08-17T02:26:08.688 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:07.445054+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:08.690 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f864b4700 1 -- 172.21.15.19:0/2924199369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f80151580 msgr2=0x7f4f8006e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.690 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f864b4700 1 --2- 172.21.15.19:0/2924199369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f80151580 0x7f4f8006e680 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4f78013000 tx=0x7f4f78019000 comp rx=0 tx=0).stop 2024-08-17T02:26:08.690 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f864b4700 1 -- 172.21.15.19:0/2924199369 shutdown_connections 2024-08-17T02:26:08.690 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f864b4700 1 --2- 172.21.15.19:0/2924199369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f80151580 0x7f4f8006e680 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.690 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f864b4700 1 --2- 172.21.15.19:0/2924199369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f800ae960 0x7f4f8006e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.690 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f864b4700 1 --2- 172.21.15.19:0/2924199369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f800ad3d0 0x7f4f80140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.690 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f864b4700 1 -- 172.21.15.19:0/2924199369 >> 172.21.15.19:0/2924199369 conn(0x7f4f800ce0e0 msgr2=0x7f4f80067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.690 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f864b4700 1 -- 172.21.15.19:0/2924199369 shutdown_connections 2024-08-17T02:26:08.690 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:08.683+0000 7f4f864b4700 1 -- 172.21.15.19:0/2924199369 wait complete. 2024-08-17T02:26:08.704 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:26:08.720 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:08.714+0000 7f6698647000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:26:08.772 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:08.767+0000 7f77a51f3000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:26:08.843 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:08.835+0000 7f77a51f3000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:26:09.021 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:09.015+0000 7f77a51f3000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:26:09.091 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:09.083+0000 7f77a51f3000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:26:09.763 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:09.758+0000 7f66816bf700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:26:09.763 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-08-17T02:26:09.758+0000 7f66816bf700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:26:09.842 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-08-17T02:26:09.835+0000 7f77a51f3000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:26:11.392 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-08-17T02:26:11.387+0000 7f146732f3c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:26:11.455 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-08-17T02:26:11.450+0000 7f477601f3c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:26:11.559 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-08-17T02:26:11.554+0000 7f4afb1343c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:26:11.646 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-08-17T02:26:11.642+0000 7f71342e53c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:26:11.751 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-08-17T02:26:11.746+0000 7f852a6e33c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:26:11.767 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-08-17T02:26:11.759+0000 7f9d202bb3c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:26:11.891 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-08-17T02:26:11.883+0000 7f1ee05013c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:26:12.011 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-08-17T02:26:12.007+0000 7f8959e4a3c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:26:14.490 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-08-17T02:26:14.483+0000 7f1462acf700 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:26:14.535 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-08-17T02:26:14.527+0000 7f145b872700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:14.966 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-08-17T02:26:14.962+0000 7f47717bf700 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:26:14.971 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-08-17T02:26:14.966+0000 7f476a562700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:15.070 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-08-17T02:26:15.066+0000 7f712fa85700 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:26:15.076 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-08-17T02:26:15.074+0000 7f7128828700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:15.081 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-08-17T02:26:15.078+0000 7f8525e83700 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:26:15.089 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-08-17T02:26:15.086+0000 7f851ec26700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:15.090 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-08-17T02:26:15.086+0000 7f4af68d4700 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:26:15.096 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-08-17T02:26:15.090+0000 7f4aef677700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:15.510 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:15.612 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f1235c8d700 1 Processor -- start 2024-08-17T02:26:15.612 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f1235c8d700 1 -- start start 2024-08-17T02:26:15.613 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f1235c8d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12300cc730 0x7f12300ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.614 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f1235c8d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12301616a0 con 0x7f1230161b30 2024-08-17T02:26:15.614 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f1235c8d700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123015e6f0 con 0x7f1230161f00 2024-08-17T02:26:15.614 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f1235c8d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123015e990 con 0x7f12300cc730 2024-08-17T02:26:15.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1230161b30 0x7f123015dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56876/0 (socket says 172.21.15.19:56876) 2024-08-17T02:26:15.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122ffff700 1 -- 172.21.15.19:0/1986853728 learned_addr learned my addr 172.21.15.19:0/1986853728 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:15.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f1234c8b700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12300cc730 0x7f12300ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.616 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454973383 0 0) 0x7f12301616a0 con 0x7f1230161b30 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f121c003570 con 0x7f1230161b30 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510840464 0 0) 0x7f123015e6f0 con 0x7f1230161f00 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12301616a0 con 0x7f1230161f00 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2783025691 0 0) 0x7f121c003570 con 0x7f1230161b30 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12300cc730 msgr2=0x7f12300ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12300cc730 0x7f12300ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 >> v1:172.21.15.119:6789/0 conn(0x7f1230161f00 legacy=0x7f1230146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1230161330 con 0x7f1230161b30 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f1218001470 con 0x7f1230161b30 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 >> v1:172.21.15.19:6789/0 conn(0x7f1230161b30 legacy=0x7f123015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12300cc730 0x7f121c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.617 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.607+0000 7f122f7fe700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f121c0041d0 0x7f121c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f122f7fe700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f121c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123015e990 con 0x7f121c004dc0 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c00bcc0 con 0x7f121c0041d0 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c00be80 con 0x7f12300cc730 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f123548c700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f121c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f122ffff700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f121c0041d0 0x7f121c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f1234c8b700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12300cc730 0x7f121c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f123548c700 1 -- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12300cc730 msgr2=0x7f121c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f123548c700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12300cc730 0x7f121c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f123548c700 1 -- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f121c0041d0 msgr2=0x7f121c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.618 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f123548c700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f121c0041d0 0x7f121c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.619 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f123548c700 1 -- 172.21.15.19:0/1986853728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c003570 con 0x7f121c004dc0 2024-08-17T02:26:15.619 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f123548c700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f121c005230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1220009ec0 tx=0x7f1220009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970cbcc92e4c153b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.619 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000b8f0 con 0x7f121c004dc0 2024-08-17T02:26:15.619 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122000ba50 con 0x7f121c004dc0 2024-08-17T02:26:15.619 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f122f7fe700 1 -- 172.21.15.19:0/1986853728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000b8f0 con 0x7f121c004dc0 2024-08-17T02:26:15.620 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f1235c8d700 1 -- 172.21.15.19:0/1986853728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 msgr2=0x7f121c005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.620 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f1235c8d700 1 --2- 172.21.15.19:0/1986853728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f121c005230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1220009ec0 tx=0x7f1220009560 comp rx=0 tx=0).stop 2024-08-17T02:26:15.620 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f123548c700 1 -- 172.21.15.19:0/1986853728 reap_dead start 2024-08-17T02:26:15.620 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f1235c8d700 1 -- 172.21.15.19:0/1986853728 shutdown_connections 2024-08-17T02:26:15.620 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.611+0000 7f1235c8d700 1 -- 172.21.15.19:0/1986853728 >> 172.21.15.19:0/1986853728 conn(0x7f12300672b0 msgr2=0x7f1230067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.620 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 -- 172.21.15.19:0/1986853728 shutdown_connections 2024-08-17T02:26:15.620 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 -- 172.21.15.19:0/1986853728 wait complete. 2024-08-17T02:26:15.621 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 Processor -- start 2024-08-17T02:26:15.621 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 -- start start 2024-08-17T02:26:15.622 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f123013bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.622 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123013c290 0x7f123016dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.622 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123016e180 0x7f123016e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.622 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123013cdb0 con 0x7f121c004dc0 2024-08-17T02:26:15.622 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123016f660 con 0x7f123013c290 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1235c8d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123016eb30 con 0x7f123016e180 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1234c8b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f123013bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1234c8b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f123013bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35862/0 (socket says 172.21.15.19:35862) 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1234c8b700 1 -- 172.21.15.19:0/2073960422 learned_addr learned my addr 172.21.15.19:0/2073960422 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f122ffff700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123013c290 0x7f123016dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f123548c700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123016e180 0x7f123016e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1234c8b700 1 -- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123016e180 msgr2=0x7f123016e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1234c8b700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123016e180 0x7f123016e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1234c8b700 1 -- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123013c290 msgr2=0x7f123016dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1234c8b700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123013c290 0x7f123016dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.623 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1234c8b700 1 -- 172.21.15.19:0/2073960422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123013cad0 con 0x7f121c004dc0 2024-08-17T02:26:15.624 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.615+0000 7f1234c8b700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f123013bd50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f12280070b0 tx=0x7f1228009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.624 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.619+0000 7f122cff9700 1 -- 172.21.15.19:0/2073960422 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228015420 con 0x7f121c004dc0 2024-08-17T02:26:15.624 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.619+0000 7f122cff9700 1 -- 172.21.15.19:0/2073960422 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1228015580 con 0x7f121c004dc0 2024-08-17T02:26:15.624 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.619+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123016f010 con 0x7f121c004dc0 2024-08-17T02:26:15.624 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.619+0000 7f122cff9700 1 -- 172.21.15.19:0/2073960422 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228015940 con 0x7f121c004dc0 2024-08-17T02:26:15.624 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.619+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123013c700 con 0x7f121c004dc0 2024-08-17T02:26:15.625 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.619+0000 7f122cff9700 1 -- 172.21.15.19:0/2073960422 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f1228003040 con 0x7f121c004dc0 2024-08-17T02:26:15.626 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.619+0000 7f122cff9700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f121c061ff0 0x7f121c0644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.626 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.619+0000 7f122cff9700 1 -- 172.21.15.19:0/2073960422 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3627+0+0 (secure 0 0 0) 0x7f122807cd30 con 0x7f121c004dc0 2024-08-17T02:26:15.626 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.619+0000 7f122ffff700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f121c061ff0 0x7f121c0644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.627 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.623+0000 7f122ffff700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f121c061ff0 0x7f121c0644a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1218001200 tx=0x7f1218009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.627 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.623+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12100052b0 con 0x7f121c004dc0 2024-08-17T02:26:15.636 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.631+0000 7f122cff9700 1 -- 172.21.15.19:0/2073960422 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f122804da80 con 0x7f121c004dc0 2024-08-17T02:26:15.687 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-08-17T02:26:15.679+0000 7f8956e0f700 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:26:15.694 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-08-17T02:26:15.687+0000 7f894e38d700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:15.732 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-08-17T02:26:15.727+0000 7f1edd4c6700 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:26:15.741 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-08-17T02:26:15.735+0000 7f1ed4a44700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:15.745 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-08-17T02:26:15.739+0000 7f9d1d280700 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:26:15.750 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-08-17T02:26:15.743+0000 7f9d147fe700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:26:15.846 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.839+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1210005560 con 0x7f121c004dc0 2024-08-17T02:26:15.847 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f122cff9700 1 -- 172.21.15.19:0/2073960422 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9154 (secure 0 0 0) 0x7f1228015cb0 con 0x7f121c004dc0 2024-08-17T02:26:15.848 INFO:teuthology.misc.health.smithi019.stdout: 2024-08-17T02:26:15.848 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":14,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:15.523568+0000","last_up_change":"2024-08-17T02:26:15.523568+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:15.850 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f121c061ff0 msgr2=0x7f121c0644a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.850 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f121c061ff0 0x7f121c0644a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1218001200 tx=0x7f1218009040 comp rx=0 tx=0).stop 2024-08-17T02:26:15.850 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 msgr2=0x7f123013bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.851 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f123013bd50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f12280070b0 tx=0x7f1228009710 comp rx=0 tx=0).stop 2024-08-17T02:26:15.851 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 shutdown_connections 2024-08-17T02:26:15.851 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f121c061ff0 0x7f121c0644a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.851 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123016e180 0x7f123016e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.851 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123013c290 0x7f123016dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.851 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 --2- 172.21.15.19:0/2073960422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f121c004dc0 0x7f123013bd50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.851 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 >> 172.21.15.19:0/2073960422 conn(0x7f12300672b0 msgr2=0x7f123013a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.851 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 shutdown_connections 2024-08-17T02:26:15.851 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:15.843+0000 7f1235c8d700 1 -- 172.21.15.19:0/2073960422 wait complete. 2024-08-17T02:26:15.861 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-08-17T02:26:22.668 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:22.773 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f102d761700 1 Processor -- start 2024-08-17T02:26:22.773 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f102d761700 1 -- start start 2024-08-17T02:26:22.774 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f102d761700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f10280ce4e0 0x7f10280ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.774 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f102d761700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 0x7f102815b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.774 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f102d761700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10280c62d0 con 0x7f1028159150 2024-08-17T02:26:22.774 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f102d761700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10280c6570 con 0x7f10280ce4e0 2024-08-17T02:26:22.774 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f102d761700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10280c6010 con 0x7f102815ad70 2024-08-17T02:26:22.774 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f10277fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f10280ce4e0 0x7f10280ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.775 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f10277fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f10280ce4e0 0x7f10280ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43116/0 (socket says 172.21.15.19:43116) 2024-08-17T02:26:22.775 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f10277fe700 1 -- 172.21.15.19:0/1546195060 learned_addr learned my addr 172.21.15.19:0/1546195060 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:22.775 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f102cf60700 1 --2- 172.21.15.19:0/1546195060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 0x7f102815b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.776 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f10277fe700 1 -- 172.21.15.19:0/1546195060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 msgr2=0x7f102815b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.776 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f10277fe700 1 --2- 172.21.15.19:0/1546195060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 0x7f102815b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.776 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f10277fe700 1 -- 172.21.15.19:0/1546195060 >> v1:172.21.15.119:6789/0 conn(0x7f1028159150 legacy=0x7f10280c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.776 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.767+0000 7f10277fe700 1 -- 172.21.15.19:0/1546195060 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280cedf0 con 0x7f10280ce4e0 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f10277fe700 1 --2- 172.21.15.19:0/1546195060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10280ce4e0 0x7f10280ce8b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10100099b0 tx=0x7f1010009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc329de0cd7580d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f1026ffd700 1 -- 172.21.15.19:0/1546195060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010009ea0 con 0x7f10280ce4e0 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f1026ffd700 1 -- 172.21.15.19:0/1546195060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101000b860 con 0x7f10280ce4e0 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f1026ffd700 1 -- 172.21.15.19:0/1546195060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101000bc00 con 0x7f10280ce4e0 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 -- 172.21.15.19:0/1546195060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10280ce4e0 msgr2=0x7f10280ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 --2- 172.21.15.19:0/1546195060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10280ce4e0 0x7f10280ce8b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10100099b0 tx=0x7f1010009250 comp rx=0 tx=0).stop 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 -- 172.21.15.19:0/1546195060 shutdown_connections 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 --2- 172.21.15.19:0/1546195060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 0x7f102815b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 --2- 172.21.15.19:0/1546195060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10280ce4e0 0x7f10280ce8b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 -- 172.21.15.19:0/1546195060 >> 172.21.15.19:0/1546195060 conn(0x7f1028089bd0 msgr2=0x7f10280994f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 -- 172.21.15.19:0/1546195060 shutdown_connections 2024-08-17T02:26:22.777 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 -- 172.21.15.19:0/1546195060 wait complete. 2024-08-17T02:26:22.778 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 Processor -- start 2024-08-17T02:26:22.778 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.771+0000 7f102d761700 1 -- start start 2024-08-17T02:26:22.780 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f102d761700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280ce4e0 0x7f1028158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.780 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f102d761700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1028159150 0x7f10280c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.780 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f102d761700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 0x7f102814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.780 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f102d761700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1028158940 con 0x7f1028159150 2024-08-17T02:26:22.780 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f102d761700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280c9b40 con 0x7f10280ce4e0 2024-08-17T02:26:22.780 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f102d761700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10280cb500 con 0x7f102815ad70 2024-08-17T02:26:22.780 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f10277fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1028159150 0x7f10280c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.780 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f1027fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280ce4e0 0x7f1028158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.781 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f102cf60700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 0x7f102814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.781 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f1027fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280ce4e0 0x7f1028158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:33244/0 (socket says 172.21.15.19:33244) 2024-08-17T02:26:22.781 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f10277fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1028159150 0x7f10280c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43118/0 (socket says 172.21.15.19:43118) 2024-08-17T02:26:22.781 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f1027fff700 1 -- 172.21.15.19:0/2573612001 learned_addr learned my addr 172.21.15.19:0/2573612001 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:22.782 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f10277fe700 1 -- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 msgr2=0x7f102814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.782 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f10277fe700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 0x7f102814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.782 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f10277fe700 1 -- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280ce4e0 msgr2=0x7f1028158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.782 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f10277fe700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280ce4e0 0x7f1028158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.782 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f10277fe700 1 -- 172.21.15.19:0/2573612001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100094f0 con 0x7f1028159150 2024-08-17T02:26:22.782 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f10277fe700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1028159150 0x7f10280c9600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f102806f5f0 tx=0x7f1010017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.782 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f101ffff700 1 -- 172.21.15.19:0/2573612001 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010000d10 con 0x7f1028159150 2024-08-17T02:26:22.782 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f101ffff700 1 -- 172.21.15.19:0/2573612001 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101000bbe0 con 0x7f1028159150 2024-08-17T02:26:22.783 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f101ffff700 1 -- 172.21.15.19:0/2573612001 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010011650 con 0x7f1028159150 2024-08-17T02:26:22.783 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10280ca030 con 0x7f1028159150 2024-08-17T02:26:22.783 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.775+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10280caeb0 con 0x7f1028159150 2024-08-17T02:26:22.783 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.779+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1028064ba0 con 0x7f1028159150 2024-08-17T02:26:22.784 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.779+0000 7f101ffff700 1 -- 172.21.15.19:0/2573612001 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1010011a80 con 0x7f1028159150 2024-08-17T02:26:22.784 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.779+0000 7f101ffff700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1008060860 0x7f1008062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.784 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.779+0000 7f101ffff700 1 -- 172.21.15.19:0/2573612001 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f101007dc40 con 0x7f1028159150 2024-08-17T02:26:22.785 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.779+0000 7f1027fff700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1008060860 0x7f1008062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.785 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.779+0000 7f1027fff700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1008060860 0x7f1008062d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f102816c650 tx=0x7f1018009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.790 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.783+0000 7f101ffff700 1 -- 172.21.15.19:0/2573612001 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f101004e540 con 0x7f1028159150 2024-08-17T02:26:22.955 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.947+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10280d10a0 con 0x7f1028159150 2024-08-17T02:26:22.956 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f101ffff700 1 -- 172.21.15.19:0/2573612001 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f1010028090 con 0x7f1028159150 2024-08-17T02:26:22.956 INFO:teuthology.misc.health.smithi019.stdout: 2024-08-17T02:26:22.957 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":18,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:19.542123+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:22.959 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1008060860 msgr2=0x7f1008062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.959 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1008060860 0x7f1008062d10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f102816c650 tx=0x7f1018009040 comp rx=0 tx=0).stop 2024-08-17T02:26:22.959 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1028159150 msgr2=0x7f10280c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.959 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1028159150 0x7f10280c9600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f102806f5f0 tx=0x7f1010017000 comp rx=0 tx=0).stop 2024-08-17T02:26:22.959 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 shutdown_connections 2024-08-17T02:26:22.959 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1008060860 0x7f1008062d10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.959 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815ad70 0x7f102814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.959 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1028159150 0x7f10280c9600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.959 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 --2- 172.21.15.19:0/2573612001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280ce4e0 0x7f1028158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.960 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.951+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 >> 172.21.15.19:0/2573612001 conn(0x7f1028089bd0 msgr2=0x7f102806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.960 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.955+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 shutdown_connections 2024-08-17T02:26:22.960 INFO:teuthology.misc.health.smithi019.stderr:2024-08-17T02:26:22.955+0000 7f102d761700 1 -- 172.21.15.19:0/2573612001 wait complete. 2024-08-17T02:26:22.969 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:26:22.970 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:26:22.970 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:26:22.970 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:26:22.972 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:26:22.972 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:26:22.973 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:26:22.975 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:26:22.975 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:26:22.975 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:26:22.977 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:26:22.977 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:26:22.977 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:26:22.979 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:26:22.980 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:26:22.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:23.045 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-08-17T02:26:23.061 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2024-08-17T02:26:23.064 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-08-17T02:26:23.070 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2024-08-17T02:26:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 Processor -- start 2024-08-17T02:26:23.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 -- start start 2024-08-17T02:26:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc788068840 0x7fc7880af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc788068c10 0x7fc7880ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7880b05e0 con 0x7fc7880b0a70 2024-08-17T02:26:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc788069060 con 0x7fc788068c10 2024-08-17T02:26:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880af9d0 con 0x7fc788068840 2024-08-17T02:26:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78deb9700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc7880b0a70 0x7fc7881599f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56662/0 (socket says 172.21.15.19:56662) 2024-08-17T02:26:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78ceb7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc788068c10 0x7fc7880ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78deb9700 1 -- 172.21.15.19:0/4227215479 learned_addr learned my addr 172.21.15.19:0/4227215479 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78d6b8700 1 --2- 172.21.15.19:0/4227215479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc788068840 0x7fc7880af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc77ffff700 1 -- 172.21.15.19:0/4227215479 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861855325 0 0) 0x7fc7880b05e0 con 0x7fc7880b0a70 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc77ffff700 1 -- 172.21.15.19:0/4227215479 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc774003570 con 0x7fc7880b0a70 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78ceb7700 1 -- 172.21.15.19:0/4227215479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc788068840 msgr2=0x7fc7880af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78ceb7700 1 --2- 172.21.15.19:0/4227215479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc788068840 0x7fc7880af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78ceb7700 1 -- 172.21.15.19:0/4227215479 >> v1:172.21.15.19:6789/0 conn(0x7fc7880b0a70 legacy=0x7fc7881599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78ceb7700 1 -- 172.21.15.19:0/4227215479 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880afcb0 con 0x7fc788068c10 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78d6b8700 1 --2- 172.21.15.19:0/4227215479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc788068840 0x7fc7880af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78ceb7700 1 --2- 172.21.15.19:0/4227215479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068c10 0x7fc7880ae2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc7840098e0 tx=0x7fc7840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4191f93526b9722d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc77ffff700 1 -- 172.21.15.19:0/4227215479 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784011630 con 0x7fc788068c10 2024-08-17T02:26:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc77ffff700 1 -- 172.21.15.19:0/4227215479 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc784011790 con 0x7fc788068c10 2024-08-17T02:26:23.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc77ffff700 1 -- 172.21.15.19:0/4227215479 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784011b30 con 0x7fc788068c10 2024-08-17T02:26:23.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 -- 172.21.15.19:0/4227215479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068c10 msgr2=0x7fc7880ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 --2- 172.21.15.19:0/4227215479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068c10 0x7fc7880ae2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc7840098e0 tx=0x7fc7840091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 -- 172.21.15.19:0/4227215479 shutdown_connections 2024-08-17T02:26:23.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 --2- 172.21.15.19:0/4227215479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068c10 0x7fc7880ae2b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 --2- 172.21.15.19:0/4227215479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc788068840 0x7fc7880af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 -- 172.21.15.19:0/4227215479 >> 172.21.15.19:0/4227215479 conn(0x7fc78806d800 msgr2=0x7fc78806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 -- 172.21.15.19:0/4227215479 shutdown_connections 2024-08-17T02:26:23.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.091+0000 7fc78e6ba700 1 -- 172.21.15.19:0/4227215479 wait complete. 2024-08-17T02:26:23.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78e6ba700 1 Processor -- start 2024-08-17T02:26:23.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78e6ba700 1 -- start start 2024-08-17T02:26:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78e6ba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068840 0x7fc7881460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78e6ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc788068c10 0x7fc7880c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78e6ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880b0a70 0x7fc788166080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78e6ba700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7881502e0 con 0x7fc788068840 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78e6ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc788166c60 con 0x7fc788068c10 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78e6ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc788166f40 con 0x7fc7880b0a70 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78d6b8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068840 0x7fc7881460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78d6b8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068840 0x7fc7881460c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43190/0 (socket says 172.21.15.19:43190) 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78d6b8700 1 -- 172.21.15.19:0/1569404144 learned_addr learned my addr 172.21.15.19:0/1569404144 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78deb9700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880b0a70 0x7fc788166080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78ceb7700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc788068c10 0x7fc7880c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78d6b8700 1 -- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880b0a70 msgr2=0x7fc788166080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78d6b8700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880b0a70 0x7fc788166080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78d6b8700 1 -- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc788068c10 msgr2=0x7fc7880c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78d6b8700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc788068c10 0x7fc7880c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78d6b8700 1 -- 172.21.15.19:0/1569404144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009420 con 0x7fc788068840 2024-08-17T02:26:23.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78deb9700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880b0a70 0x7fc788166080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:23.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.095+0000 7fc78ceb7700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc788068c10 0x7fc7880c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:23.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc78d6b8700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068840 0x7fc7881460c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc77800ec80 tx=0x7fc7780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc77d7fa700 1 -- 172.21.15.19:0/1569404144 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77800c9d0 con 0x7fc788068840 2024-08-17T02:26:23.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc77d7fa700 1 -- 172.21.15.19:0/1569404144 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77800cb30 con 0x7fc788068840 2024-08-17T02:26:23.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc784009420 con 0x7fc788068840 2024-08-17T02:26:23.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc77d7fa700 1 -- 172.21.15.19:0/1569404144 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77800ceb0 con 0x7fc788068840 2024-08-17T02:26:23.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7880c87d0 con 0x7fc788068840 2024-08-17T02:26:23.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7880638f0 con 0x7fc788068840 2024-08-17T02:26:23.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc77d7fa700 1 -- 172.21.15.19:0/1569404144 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc778013680 con 0x7fc788068840 2024-08-17T02:26:23.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc77d7fa700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc76c060860 0x7fc76c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.099+0000 7fc77d7fa700 1 -- 172.21.15.19:0/1569404144 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc77807cbe0 con 0x7fc788068840 2024-08-17T02:26:23.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.103+0000 7fc78ceb7700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc76c060860 0x7fc76c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.103+0000 7fc78ceb7700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc76c060860 0x7fc76c062d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc788152ab0 tx=0x7fc784017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.107+0000 7fc77d7fa700 1 -- 172.21.15.19:0/1569404144 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc77804d380 con 0x7fc788068840 2024-08-17T02:26:23.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.271+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc788150850 con 0x7fc788068840 2024-08-17T02:26:23.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.271+0000 7fc77d7fa700 1 -- 172.21.15.19:0/1569404144 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12127 (secure 0 0 0) 0x7fc778021090 con 0x7fc788068840 2024-08-17T02:26:23.278 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:23.278 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:19.542123+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:23.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc76c060860 msgr2=0x7fc76c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc76c060860 0x7fc76c062d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc788152ab0 tx=0x7fc784017000 comp rx=0 tx=0).stop 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068840 msgr2=0x7fc7881460c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068840 0x7fc7881460c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc77800ec80 tx=0x7fc7780091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 shutdown_connections 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc76c060860 0x7fc76c062d10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880b0a70 0x7fc788166080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc788068c10 0x7fc7880c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 --2- 172.21.15.19:0/1569404144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc788068840 0x7fc7881460c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 >> 172.21.15.19:0/1569404144 conn(0x7fc78806d800 msgr2=0x7fc788153240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 shutdown_connections 2024-08-17T02:26:23.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.275+0000 7fc78e6ba700 1 -- 172.21.15.19:0/1569404144 wait complete. 2024-08-17T02:26:23.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:23.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:23.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.399+0000 7f1679e17700 1 Processor -- start 2024-08-17T02:26:23.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.399+0000 7f1679e17700 1 -- start start 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16740cc840 0x7f16740ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16740b2210 0x7f16740b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 0x7f16740b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16740af570 con 0x7f16740b2210 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16740b5a00 con 0x7f16740cc840 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16740cd150 con 0x7f16740b5040 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1672ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16740b2210 0x7f16740b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1672ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16740b2210 0x7f16740b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43196/0 (socket says 172.21.15.19:43196) 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1672ffd700 1 -- 172.21.15.19:0/1284836880 learned_addr learned my addr 172.21.15.19:0/1284836880 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1673fff700 1 --2- 172.21.15.19:0/1284836880 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 0x7f16740b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f16737fe700 1 --2- 172.21.15.19:0/1284836880 >> v2:172.21.15.119:3300/0 conn(0x7f16740cc840 0x7f16740ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1672ffd700 1 -- 172.21.15.19:0/1284836880 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 msgr2=0x7f16740b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1672ffd700 1 --2- 172.21.15.19:0/1284836880 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 0x7f16740b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1672ffd700 1 -- 172.21.15.19:0/1284836880 >> v2:172.21.15.119:3300/0 conn(0x7f16740cc840 msgr2=0x7f16740ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1672ffd700 1 --2- 172.21.15.19:0/1284836880 >> v2:172.21.15.119:3300/0 conn(0x7f16740cc840 0x7f16740ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1672ffd700 1 -- 172.21.15.19:0/1284836880 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1674159ce0 con 0x7f16740b2210 2024-08-17T02:26:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1672ffd700 1 --2- 172.21.15.19:0/1284836880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 0x7f16740b2670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16740cdcc0 tx=0x7f1664009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557d4d6354d3a78d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f16727fc700 1 -- 172.21.15.19:0/1284836880 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166400b640 con 0x7f16740b2210 2024-08-17T02:26:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f16727fc700 1 -- 172.21.15.19:0/1284836880 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166400b7a0 con 0x7f16740b2210 2024-08-17T02:26:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f16727fc700 1 -- 172.21.15.19:0/1284836880 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166400bb60 con 0x7f16740b2210 2024-08-17T02:26:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 -- 172.21.15.19:0/1284836880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 msgr2=0x7f16740b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 --2- 172.21.15.19:0/1284836880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 0x7f16740b2670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16740cdcc0 tx=0x7f1664009250 comp rx=0 tx=0).stop 2024-08-17T02:26:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 -- 172.21.15.19:0/1284836880 shutdown_connections 2024-08-17T02:26:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 --2- 172.21.15.19:0/1284836880 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 0x7f16740b2670 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 --2- 172.21.15.19:0/1284836880 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 0x7f16740b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 --2- 172.21.15.19:0/1284836880 >> v2:172.21.15.119:3300/0 conn(0x7f16740cc840 0x7f16740ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 -- 172.21.15.19:0/1284836880 >> 172.21.15.19:0/1284836880 conn(0x7f16740682c0 msgr2=0x7f16740686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 -- 172.21.15.19:0/1284836880 shutdown_connections 2024-08-17T02:26:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.403+0000 7f1679e17700 1 -- 172.21.15.19:0/1284836880 wait complete. 2024-08-17T02:26:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 Processor -- start 2024-08-17T02:26:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 -- start start 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 0x7f16740ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 0x7f167414b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16740cc840 0x7f167414aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16740cf3f0 con 0x7f16740b2210 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167414baa0 con 0x7f16740cc840 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167414aff0 con 0x7f16740b5040 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f16737fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 0x7f16740ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1672ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 0x7f167414b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1673fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16740cc840 0x7f167414aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f16737fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 0x7f16740ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43208/0 (socket says 172.21.15.19:43208) 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1672ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 0x7f167414b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:59500/0 (socket says 172.21.15.19:59500) 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1673fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16740cc840 0x7f167414aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:33316/0 (socket says 172.21.15.19:33316) 2024-08-17T02:26:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f16737fe700 1 -- 172.21.15.19:0/791997770 learned_addr learned my addr 172.21.15.19:0/791997770 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f16737fe700 1 -- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 msgr2=0x7f167414b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f16737fe700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 0x7f167414b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f16737fe700 1 -- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16740cc840 msgr2=0x7f167414aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f16737fe700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16740cc840 0x7f167414aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f16737fe700 1 -- 172.21.15.19:0/791997770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16640094f0 con 0x7f16740b2210 2024-08-17T02:26:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1673fff700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16740cc840 0x7f167414aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f16737fe700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 0x7f16740ce150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f166800e960 tx=0x7f16680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f165b7fe700 1 -- 172.21.15.19:0/791997770 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668013680 con 0x7f16740b2210 2024-08-17T02:26:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f165b7fe700 1 -- 172.21.15.19:0/791997770 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668013800 con 0x7f16740b2210 2024-08-17T02:26:23.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16740ce7e0 con 0x7f16740b2210 2024-08-17T02:26:23.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f165b7fe700 1 -- 172.21.15.19:0/791997770 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668013bc0 con 0x7f16740b2210 2024-08-17T02:26:23.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.407+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16740ceda0 con 0x7f16740b2210 2024-08-17T02:26:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.411+0000 7f165b7fe700 1 -- 172.21.15.19:0/791997770 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f16680123d0 con 0x7f16740b2210 2024-08-17T02:26:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.411+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16740645c0 con 0x7f16740b2210 2024-08-17T02:26:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.411+0000 7f165b7fe700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1660060890 0x7f1660062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.411+0000 7f165b7fe700 1 -- 172.21.15.19:0/791997770 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f166807c980 con 0x7f16740b2210 2024-08-17T02:26:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.411+0000 7f1672ffd700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1660060890 0x7f1660062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.415+0000 7f1672ffd700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1660060890 0x7f1660062d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16740cdcc0 tx=0x7f1664017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.419+0000 7f165b7fe700 1 -- 172.21.15.19:0/791997770 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f166804d120 con 0x7f16740b2210 2024-08-17T02:26:23.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.583+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f167415a570 con 0x7f16740b2210 2024-08-17T02:26:23.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.587+0000 7f165b7fe700 1 -- 172.21.15.19:0/791997770 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1668050740 con 0x7f16740b2210 2024-08-17T02:26:23.592 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1660060890 msgr2=0x7f1660062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1660060890 0x7f1660062d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f16740cdcc0 tx=0x7f1664017000 comp rx=0 tx=0).stop 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 msgr2=0x7f16740ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 0x7f16740ce150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f166800e960 tx=0x7f16680091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 shutdown_connections 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1660060890 0x7f1660062d40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16740cc840 0x7f167414aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16740b5040 0x7f167414b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 --2- 172.21.15.19:0/791997770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16740b2210 0x7f16740ce150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 >> 172.21.15.19:0/791997770 conn(0x7f16740682c0 msgr2=0x7f16740cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 shutdown_connections 2024-08-17T02:26:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.591+0000 7f1679e17700 1 -- 172.21.15.19:0/791997770 wait complete. 2024-08-17T02:26:23.610 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0574e70700 1 Processor -- start 2024-08-17T02:26:23.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0574e70700 1 -- start start 2024-08-17T02:26:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0574e70700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0570159040 0x7f05700cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0574e70700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05700d0010 0x7f05700d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0574e70700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700cf190 con 0x7f057015cea0 2024-08-17T02:26:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0574e70700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057015d9f0 con 0x7f05700d0010 2024-08-17T02:26:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0574e70700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700d09a0 con 0x7f0570159040 2024-08-17T02:26:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0567fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05700d0010 0x7f05700d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0567fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05700d0010 0x7f05700d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43220/0 (socket says 172.21.15.19:43220) 2024-08-17T02:26:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0567fff700 1 -- 172.21.15.19:0/601558387 learned_addr learned my addr 172.21.15.19:0/601558387 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f056f7fe700 1 --2- 172.21.15.19:0/601558387 >> v2:172.21.15.119:3300/0 conn(0x7f0570159040 0x7f05700cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0567fff700 1 -- 172.21.15.19:0/601558387 >> v2:172.21.15.119:3300/0 conn(0x7f0570159040 msgr2=0x7f05700cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0567fff700 1 --2- 172.21.15.19:0/601558387 >> v2:172.21.15.119:3300/0 conn(0x7f0570159040 0x7f05700cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0567fff700 1 -- 172.21.15.19:0/601558387 >> v1:172.21.15.119:6789/0 conn(0x7f057015cea0 legacy=0x7f057015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f056effd700 1 -- 172.21.15.19:0/601558387 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573589559 0 0) 0x7f05700cf190 con 0x7f057015cea0 2024-08-17T02:26:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0567fff700 1 -- 172.21.15.19:0/601558387 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700ce5e0 con 0x7f05700d0010 2024-08-17T02:26:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f0567fff700 1 --2- 172.21.15.19:0/601558387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05700d0010 0x7f05700d0460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0570070d70 tx=0x7f0558009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dcbdaa92e06c2e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f056effd700 1 -- 172.21.15.19:0/601558387 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558009e70 con 0x7f05700d0010 2024-08-17T02:26:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f056effd700 1 -- 172.21.15.19:0/601558387 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055800b860 con 0x7f05700d0010 2024-08-17T02:26:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.703+0000 7f056effd700 1 -- 172.21.15.19:0/601558387 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800bc00 con 0x7f05700d0010 2024-08-17T02:26:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.707+0000 7f0574e70700 1 -- 172.21.15.19:0/601558387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05700d0010 msgr2=0x7f05700d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.707+0000 7f0574e70700 1 --2- 172.21.15.19:0/601558387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05700d0010 0x7f05700d0460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0570070d70 tx=0x7f0558009250 comp rx=0 tx=0).stop 2024-08-17T02:26:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.707+0000 7f0574e70700 1 -- 172.21.15.19:0/601558387 shutdown_connections 2024-08-17T02:26:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.707+0000 7f0574e70700 1 --2- 172.21.15.19:0/601558387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05700d0010 0x7f05700d0460 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.707+0000 7f0574e70700 1 --2- 172.21.15.19:0/601558387 >> v2:172.21.15.119:3300/0 conn(0x7f0570159040 0x7f05700cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.707+0000 7f0574e70700 1 -- 172.21.15.19:0/601558387 >> 172.21.15.19:0/601558387 conn(0x7f0570068250 msgr2=0x7f0570068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.707+0000 7f0574e70700 1 -- 172.21.15.19:0/601558387 shutdown_connections 2024-08-17T02:26:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.707+0000 7f0574e70700 1 -- 172.21.15.19:0/601558387 wait complete. 2024-08-17T02:26:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0574e70700 1 Processor -- start 2024-08-17T02:26:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0574e70700 1 -- start start 2024-08-17T02:26:23.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0574e70700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05700d0010 0x7f0570151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0574e70700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0570159040 0x7f05700a7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0574e70700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057015cea0 0x7f0570063060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0574e70700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700a8100 con 0x7f0570159040 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0574e70700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701697b0 con 0x7f057015cea0 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0574e70700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0570169a90 con 0x7f05700d0010 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0567fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0570159040 0x7f05700a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0567fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0570159040 0x7f05700a7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43224/0 (socket says 172.21.15.19:43224) 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0567fff700 1 -- 172.21.15.19:0/2207208588 learned_addr learned my addr 172.21.15.19:0/2207208588 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f056f7fe700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05700d0010 0x7f0570151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f056ffff700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057015cea0 0x7f0570063060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0567fff700 1 -- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05700d0010 msgr2=0x7f0570151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0567fff700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05700d0010 0x7f0570151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0567fff700 1 -- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057015cea0 msgr2=0x7f0570063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0567fff700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057015cea0 0x7f0570063060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0567fff700 1 -- 172.21.15.19:0/2207208588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05580094f0 con 0x7f0570159040 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f056ffff700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057015cea0 0x7f0570063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f0567fff700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0570159040 0x7f05700a7640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05580094c0 tx=0x7f0558017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f05677fe700 1 -- 172.21.15.19:0/2207208588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800bbe0 con 0x7f0570159040 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.711+0000 7f05677fe700 1 -- 172.21.15.19:0/2207208588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0558011420 con 0x7f0570159040 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.715+0000 7f05677fe700 1 -- 172.21.15.19:0/2207208588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05580117e0 con 0x7f0570159040 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.715+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0570169d70 con 0x7f0570159040 2024-08-17T02:26:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.715+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057016a570 con 0x7f0570159040 2024-08-17T02:26:23.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.715+0000 7f05677fe700 1 -- 172.21.15.19:0/2207208588 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0558011b90 con 0x7f0570159040 2024-08-17T02:26:23.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.715+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05700643a0 con 0x7f0570159040 2024-08-17T02:26:23.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.715+0000 7f05677fe700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0550060860 0x7f0550062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.715+0000 7f05677fe700 1 -- 172.21.15.19:0/2207208588 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f055807dfe0 con 0x7f0570159040 2024-08-17T02:26:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.715+0000 7f056f7fe700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0550060860 0x7f0550062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.715+0000 7f056f7fe700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0550060860 0x7f0550062d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0560009d10 tx=0x7f05600091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.723+0000 7f05677fe700 1 -- 172.21.15.19:0/2207208588 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f055804e780 con 0x7f0570159040 2024-08-17T02:26:23.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.927+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05700cd320 con 0x7f0570159040 2024-08-17T02:26:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.927+0000 7f05677fe700 1 -- 172.21.15.19:0/2207208588 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1257 (secure 0 0 0) 0x7f0558015500 con 0x7f0570159040 2024-08-17T02:26:23.935 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:23.935 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34157,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:26:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0550060860 msgr2=0x7f0550062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0550060860 0x7f0550062d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0560009d10 tx=0x7f05600091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0570159040 msgr2=0x7f05700a7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0570159040 0x7f05700a7640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05580094c0 tx=0x7f0558017000 comp rx=0 tx=0).stop 2024-08-17T02:26:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 shutdown_connections 2024-08-17T02:26:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0550060860 0x7f0550062d10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f057015cea0 0x7f0570063060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0570159040 0x7f05700a7640 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 --2- 172.21.15.19:0/2207208588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05700d0010 0x7f0570151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 >> 172.21.15.19:0/2207208588 conn(0x7f0570068250 msgr2=0x7f0570152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 shutdown_connections 2024-08-17T02:26:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:23.931+0000 7f0574e70700 1 -- 172.21.15.19:0/2207208588 wait complete. 2024-08-17T02:26:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2024-08-17T02:26:25.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:26.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bdf21700 1 Processor -- start 2024-08-17T02:26:26.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bdf21700 1 -- start start 2024-08-17T02:26:26.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bdf21700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 0x7f90b80b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bdf21700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90b80ad1b0 0x7f90b80c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bdf21700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b80c86e0 con 0x7f90b815cd90 2024-08-17T02:26:26.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bdf21700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b80cb850 con 0x7f90b80ad1b0 2024-08-17T02:26:26.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bdf21700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b815d1e0 con 0x7f90b815c620 2024-08-17T02:26:26.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bd720700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90b80ad1b0 0x7f90b80c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bd720700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90b80ad1b0 0x7f90b80c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43226/0 (socket says 172.21.15.19:43226) 2024-08-17T02:26:26.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bd720700 1 -- 172.21.15.19:0/24542642 learned_addr learned my addr 172.21.15.19:0/24542642 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:26.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.059+0000 7f90bcf1f700 1 --2- 172.21.15.19:0/24542642 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 0x7f90b80b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bd720700 1 -- 172.21.15.19:0/24542642 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 msgr2=0x7f90b80b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bd720700 1 --2- 172.21.15.19:0/24542642 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 0x7f90b80b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bd720700 1 -- 172.21.15.19:0/24542642 >> v1:172.21.15.119:6789/0 conn(0x7f90b815cd90 legacy=0x7f90b80acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bd720700 1 -- 172.21.15.19:0/24542642 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b815d490 con 0x7f90b80ad1b0 2024-08-17T02:26:26.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90b77fe700 1 -- 172.21.15.19:0/24542642 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974202568 0 0) 0x7f90b80c86e0 con 0x7f90b815cd90 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bd720700 1 --2- 172.21.15.19:0/24542642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b80ad1b0 0x7f90b80c8b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009f20 tx=0x7f90b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96153e414101e8ed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90b77fe700 1 -- 172.21.15.19:0/24542642 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b000e070 con 0x7f90b80ad1b0 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90b77fe700 1 -- 172.21.15.19:0/24542642 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b000b9d0 con 0x7f90b80ad1b0 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90b77fe700 1 -- 172.21.15.19:0/24542642 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00092e0 con 0x7f90b80ad1b0 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 -- 172.21.15.19:0/24542642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b80ad1b0 msgr2=0x7f90b80c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 --2- 172.21.15.19:0/24542642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b80ad1b0 0x7f90b80c8b70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009f20 tx=0x7f90b0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 -- 172.21.15.19:0/24542642 shutdown_connections 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 --2- 172.21.15.19:0/24542642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b80ad1b0 0x7f90b80c8b70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 --2- 172.21.15.19:0/24542642 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 0x7f90b80b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 -- 172.21.15.19:0/24542642 >> 172.21.15.19:0/24542642 conn(0x7f90b80ca900 msgr2=0x7f90b80cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 -- 172.21.15.19:0/24542642 shutdown_connections 2024-08-17T02:26:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 -- 172.21.15.19:0/24542642 wait complete. 2024-08-17T02:26:26.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 Processor -- start 2024-08-17T02:26:26.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.063+0000 7f90bdf21700 1 -- start start 2024-08-17T02:26:26.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bdf21700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ad1b0 0x7f90b814a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bdf21700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 0x7f90b806d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bdf21700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b815cd90 0x7f90b80c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bdf21700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80ac680 con 0x7f90b815cd90 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bdf21700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80aa5a0 con 0x7f90b80ad1b0 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bdf21700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b814a9b0 con 0x7f90b815c620 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bd720700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b815cd90 0x7f90b80c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bd720700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b815cd90 0x7f90b80c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43240/0 (socket says 172.21.15.19:43240) 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bd720700 1 -- 172.21.15.19:0/2920307465 learned_addr learned my addr 172.21.15.19:0/2920307465 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90b7fff700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 0x7f90b806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bcf1f700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ad1b0 0x7f90b814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bd720700 1 -- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 msgr2=0x7f90b806d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bd720700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 0x7f90b806d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bd720700 1 -- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ad1b0 msgr2=0x7f90b814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bd720700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ad1b0 0x7f90b814a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bd720700 1 -- 172.21.15.19:0/2920307465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0009ae0 con 0x7f90b815cd90 2024-08-17T02:26:26.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bd720700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b815cd90 0x7f90b80c77a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90b000b610 tx=0x7f90b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90b4ff9700 1 -- 172.21.15.19:0/2920307465 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0008ad0 con 0x7f90b815cd90 2024-08-17T02:26:26.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90b4ff9700 1 -- 172.21.15.19:0/2920307465 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b0008c50 con 0x7f90b815cd90 2024-08-17T02:26:26.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b806d550 con 0x7f90b815cd90 2024-08-17T02:26:26.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90b4ff9700 1 -- 172.21.15.19:0/2920307465 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0026460 con 0x7f90b815cd90 2024-08-17T02:26:26.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.067+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b80a9990 con 0x7f90b815cd90 2024-08-17T02:26:26.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.071+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b80643a0 con 0x7f90b815cd90 2024-08-17T02:26:26.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.071+0000 7f90b4ff9700 1 -- 172.21.15.19:0/2920307465 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f90b0003040 con 0x7f90b815cd90 2024-08-17T02:26:26.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.071+0000 7f90b4ff9700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f909c060930 0x7f909c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.071+0000 7f90b4ff9700 1 -- 172.21.15.19:0/2920307465 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f90b007e520 con 0x7f90b815cd90 2024-08-17T02:26:26.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.071+0000 7f90bcf1f700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f909c060930 0x7f909c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.075+0000 7f90bcf1f700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f909c060930 0x7f909c062de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009db0 tx=0x7f90a80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.075+0000 7f90b4ff9700 1 -- 172.21.15.19:0/2920307465 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f90b004edf0 con 0x7f90b815cd90 2024-08-17T02:26:26.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.275+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90b80aa6e0 con 0x7f90b815cd90 2024-08-17T02:26:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90b4ff9700 1 -- 172.21.15.19:0/2920307465 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3522 (secure 0 0 0) 0x7f90b0021de0 con 0x7f90b815cd90 2024-08-17T02:26:26.283 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:26.283 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/903872793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":903872793},{"type":"v1","addr":"172.21.15.19:6833","nonce":903872793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3217936958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3217936958},{"type":"v1","addr":"172.21.15.19:6835","nonce":3217936958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/183789327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":183789327},{"type":"v1","addr":"172.21.15.119:6837","nonce":183789327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":34157,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:26:26.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f909c060930 msgr2=0x7f909c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f909c060930 0x7f909c062de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009db0 tx=0x7f90a80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b815cd90 msgr2=0x7f90b80c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b815cd90 0x7f90b80c77a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90b000b610 tx=0x7f90b0018000 comp rx=0 tx=0).stop 2024-08-17T02:26:26.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 shutdown_connections 2024-08-17T02:26:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f909c060930 0x7f909c062de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b815cd90 0x7f90b80c77a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90b815c620 0x7f90b806d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 --2- 172.21.15.19:0/2920307465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90b80ad1b0 0x7f90b814a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 >> 172.21.15.19:0/2920307465 conn(0x7f90b80ca900 msgr2=0x7f90b80c2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 shutdown_connections 2024-08-17T02:26:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.279+0000 7f90bdf21700 1 -- 172.21.15.19:0/2920307465 wait complete. 2024-08-17T02:26:26.286 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 3 2024-08-17T02:26:26.297 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:26.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:26.405 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:26.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.399+0000 7ff9b7fff700 1 Processor -- start 2024-08-17T02:26:26.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.399+0000 7ff9b7fff700 1 -- start start 2024-08-17T02:26:26.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.399+0000 7ff9b7fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9b806e620 0x7ff9b80b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.399+0000 7ff9b7fff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b8141a00 con 0x7ff9b80b1630 2024-08-17T02:26:26.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.399+0000 7ff9b7fff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b8140b10 con 0x7ff9b80b0d20 2024-08-17T02:26:26.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.399+0000 7ff9b7fff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b8140df0 con 0x7ff9b806e620 2024-08-17T02:26:26.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.399+0000 7ff9b77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff9b80b1630 0x7ff9b8141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56678/0 (socket says 172.21.15.19:56678) 2024-08-17T02:26:26.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.399+0000 7ff9b77fe700 1 -- 172.21.15.19:0/4019048906 learned_addr learned my addr 172.21.15.19:0/4019048906 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:26.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.399+0000 7ff9affff700 1 --2- 172.21.15.19:0/4019048906 >> v2:172.21.15.119:3300/0 conn(0x7ff9b806e620 0x7ff9b80b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80086083 0 0) 0x7ff9b8141a00 con 0x7ff9b80b1630 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a4003570 con 0x7ff9b80b1630 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332631440 0 0) 0x7ff9b8140b10 con 0x7ff9b80b0d20 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b8141a00 con 0x7ff9b80b0d20 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 185869943 0 0) 0x7ff9a4003570 con 0x7ff9b80b1630 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 >> v2:172.21.15.119:3300/0 conn(0x7ff9b806e620 msgr2=0x7ff9b80b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 --2- 172.21.15.19:0/4019048906 >> v2:172.21.15.119:3300/0 conn(0x7ff9b806e620 0x7ff9b80b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 >> v1:172.21.15.119:6789/0 conn(0x7ff9b80b0d20 legacy=0x7ff9b806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b81410d0 con 0x7ff9b80b1630 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7ff9b00017f0 con 0x7ff9b80b1630 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 >> v1:172.21.15.19:6789/0 conn(0x7ff9b80b1630 legacy=0x7ff9b8141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9a4004c50 0x7ff9a4005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9a4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9a4004160 0x7ff9a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b8140df0 con 0x7ff9a40037b0 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400c050 con 0x7ff9a4004c50 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a400c210 con 0x7ff9a4004160 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9affff700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9a4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b6ffd700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9a4004c50 0x7ff9a4005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b77fe700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9a4004160 0x7ff9a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9affff700 1 -- 172.21.15.19:0/4019048906 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9a4004160 msgr2=0x7ff9a400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9affff700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9a4004160 0x7ff9a400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9affff700 1 -- 172.21.15.19:0/4019048906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9a4004c50 msgr2=0x7ff9a4005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9affff700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9a4004c50 0x7ff9a4005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b77fe700 1 -- 172.21.15.19:0/4019048906 reap_dead start 2024-08-17T02:26:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9affff700 1 -- 172.21.15.19:0/4019048906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4003570 con 0x7ff9a40037b0 2024-08-17T02:26:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9affff700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9a4003c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009c00 tx=0x7ff9a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdb5d902e4c16a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000e710 con 0x7ff9a40037b0 2024-08-17T02:26:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a000e870 con 0x7ff9a40037b0 2024-08-17T02:26:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b67fc700 1 -- 172.21.15.19:0/4019048906 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000ec30 con 0x7ff9a40037b0 2024-08-17T02:26:26.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b7fff700 1 -- 172.21.15.19:0/4019048906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 msgr2=0x7ff9a4003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b7fff700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9a4003c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009c00 tx=0x7ff9a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b7fff700 1 -- 172.21.15.19:0/4019048906 shutdown_connections 2024-08-17T02:26:26.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b7fff700 1 --2- 172.21.15.19:0/4019048906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9a4003c20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b7fff700 1 -- 172.21.15.19:0/4019048906 >> 172.21.15.19:0/4019048906 conn(0x7ff9b80678d0 msgr2=0x7ff9b8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b7fff700 1 -- 172.21.15.19:0/4019048906 shutdown_connections 2024-08-17T02:26:26.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.403+0000 7ff9b7fff700 1 -- 172.21.15.19:0/4019048906 wait complete. 2024-08-17T02:26:26.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.407+0000 7ff9b7fff700 1 Processor -- start 2024-08-17T02:26:26.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.407+0000 7ff9b7fff700 1 -- start start 2024-08-17T02:26:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.407+0000 7ff9b7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9b81405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.407+0000 7ff9b7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80acad0 0x7ff9b80acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.407+0000 7ff9b7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b80a9f70 0x7ff9b80aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.407+0000 7ff9b7fff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80ad480 con 0x7ff9a40037b0 2024-08-17T02:26:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.407+0000 7ff9b7fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80ae280 con 0x7ff9b80acad0 2024-08-17T02:26:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.407+0000 7ff9b7fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b8140ae0 con 0x7ff9b80a9f70 2024-08-17T02:26:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9b81405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9b81405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43258/0 (socket says 172.21.15.19:43258) 2024-08-17T02:26:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b6ffd700 1 -- 172.21.15.19:0/2580515097 learned_addr learned my addr 172.21.15.19:0/2580515097 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b77fe700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b80a9f70 0x7ff9b80aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9affff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80acad0 0x7ff9b80acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b6ffd700 1 -- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b80a9f70 msgr2=0x7ff9b80aa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b6ffd700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b80a9f70 0x7ff9b80aa3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b6ffd700 1 -- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80acad0 msgr2=0x7ff9b80acf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b6ffd700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80acad0 0x7ff9b80acf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b6ffd700 1 -- 172.21.15.19:0/2580515097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b80a6720 con 0x7ff9a40037b0 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9affff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80acad0 0x7ff9b80acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b77fe700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b80a9f70 0x7ff9b80aa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b6ffd700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9b81405a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8002be0 tx=0x7ff9a8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9aeffd700 1 -- 172.21.15.19:0/2580515097 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800fa50 con 0x7ff9a40037b0 2024-08-17T02:26:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9aeffd700 1 -- 172.21.15.19:0/2580515097 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a800fbd0 con 0x7ff9a40037b0 2024-08-17T02:26:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b80aa920 con 0x7ff9a40037b0 2024-08-17T02:26:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9aeffd700 1 -- 172.21.15.19:0/2580515097 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80133f0 con 0x7ff9a40037b0 2024-08-17T02:26:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b80ad950 con 0x7ff9a40037b0 2024-08-17T02:26:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b80643a0 con 0x7ff9a40037b0 2024-08-17T02:26:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9aeffd700 1 -- 172.21.15.19:0/2580515097 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff9a80137e0 con 0x7ff9a40037b0 2024-08-17T02:26:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9aeffd700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff998060860 0x7ff998062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9aeffd700 1 -- 172.21.15.19:0/2580515097 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff9a807d0c0 con 0x7ff9a40037b0 2024-08-17T02:26:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.411+0000 7ff9affff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff998060860 0x7ff998062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.415+0000 7ff9affff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff998060860 0x7ff998062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00091e0 tx=0x7ff9a001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.419+0000 7ff9aeffd700 1 -- 172.21.15.19:0/2580515097 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff9a804d860 con 0x7ff9a40037b0 2024-08-17T02:26:26.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.583+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b806f5f0 con 0x7ff9a40037b0 2024-08-17T02:26:26.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.587+0000 7ff9aeffd700 1 -- 172.21.15.19:0/2580515097 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12127 (secure 0 0 0) 0x7ff9a8050e80 con 0x7ff9a40037b0 2024-08-17T02:26:26.592 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:26.592 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:19.542123+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:26.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.587+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff998060860 msgr2=0x7ff998062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.587+0000 7ff9b7fff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff998060860 0x7ff998062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00091e0 tx=0x7ff9a001a000 comp rx=0 tx=0).stop 2024-08-17T02:26:26.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.587+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 msgr2=0x7ff9b81405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.587+0000 7ff9b7fff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9b81405a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8002be0 tx=0x7ff9a8007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:26.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.587+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 shutdown_connections 2024-08-17T02:26:26.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.591+0000 7ff9b7fff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff998060860 0x7ff998062d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.591+0000 7ff9b7fff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b80a9f70 0x7ff9b80aa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.591+0000 7ff9b7fff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80acad0 0x7ff9b80acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.591+0000 7ff9b7fff700 1 --2- 172.21.15.19:0/2580515097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a40037b0 0x7ff9b81405a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.591+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 >> 172.21.15.19:0/2580515097 conn(0x7ff9b80678d0 msgr2=0x7ff9b815cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.591+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 shutdown_connections 2024-08-17T02:26:26.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.591+0000 7ff9b7fff700 1 -- 172.21.15.19:0/2580515097 wait complete. 2024-08-17T02:26:26.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:26.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.711+0000 7f8f04c18700 1 Processor -- start 2024-08-17T02:26:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.711+0000 7f8f04c18700 1 -- start start 2024-08-17T02:26:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.711+0000 7f8f04c18700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00155c30 0x7f8f00069930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.711+0000 7f8f04c18700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8f00156000 0x7f8f00069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.711+0000 7f8f04c18700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f0013a4c0 0x7f8f0013a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0013be40 con 0x7f8f0013a4c0 2024-08-17T02:26:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0013b230 con 0x7f8f00156000 2024-08-17T02:26:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0013b510 con 0x7f8f00155c30 2024-08-17T02:26:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f0013a4c0 0x7f8f0013a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f0013a4c0 0x7f8f0013a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43264/0 (socket says 172.21.15.19:43264) 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efffff700 1 -- 172.21.15.19:0/1545111373 learned_addr learned my addr 172.21.15.19:0/1545111373 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efeffd700 1 --2- 172.21.15.19:0/1545111373 >> v2:172.21.15.119:3300/0 conn(0x7f8f00156000 0x7f8f00069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8eff7fe700 1 --2- 172.21.15.19:0/1545111373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00155c30 0x7f8f00069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efffff700 1 -- 172.21.15.19:0/1545111373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00155c30 msgr2=0x7f8f00069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efffff700 1 --2- 172.21.15.19:0/1545111373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00155c30 0x7f8f00069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efffff700 1 -- 172.21.15.19:0/1545111373 >> v2:172.21.15.119:3300/0 conn(0x7f8f00156000 msgr2=0x7f8f00069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efffff700 1 --2- 172.21.15.19:0/1545111373 >> v2:172.21.15.119:3300/0 conn(0x7f8f00156000 0x7f8f00069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efffff700 1 -- 172.21.15.19:0/1545111373 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0013b7f0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efeffd700 1 --2- 172.21.15.19:0/1545111373 >> v2:172.21.15.119:3300/0 conn(0x7f8f00156000 0x7f8f00069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efffff700 1 --2- 172.21.15.19:0/1545111373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 0x7f8f0013a900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8f0006db80 tx=0x7f8ef8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0210f84d4824d4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efe7fc700 1 -- 172.21.15.19:0/1545111373 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800e070 con 0x7f8f0013a4c0 2024-08-17T02:26:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efe7fc700 1 -- 172.21.15.19:0/1545111373 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef800ba50 con 0x7f8f0013a4c0 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8efe7fc700 1 -- 172.21.15.19:0/1545111373 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80092e0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 -- 172.21.15.19:0/1545111373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 msgr2=0x7f8f0013a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1545111373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 0x7f8f0013a900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8f0006db80 tx=0x7f8ef8009840 comp rx=0 tx=0).stop 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 -- 172.21.15.19:0/1545111373 shutdown_connections 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1545111373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 0x7f8f0013a900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1545111373 >> v2:172.21.15.119:3300/0 conn(0x7f8f00156000 0x7f8f00069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1545111373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00155c30 0x7f8f00069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 -- 172.21.15.19:0/1545111373 >> 172.21.15.19:0/1545111373 conn(0x7f8f0006e170 msgr2=0x7f8f0006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 -- 172.21.15.19:0/1545111373 shutdown_connections 2024-08-17T02:26:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 -- 172.21.15.19:0/1545111373 wait complete. 2024-08-17T02:26:26.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 Processor -- start 2024-08-17T02:26:26.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.715+0000 7f8f04c18700 1 -- start start 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8f04c18700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 0x7f8f00132800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8f04c18700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f00155c30 0x7f8f000c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8f04c18700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00156000 0x7f8f000ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8f04c18700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000caee0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8f04c18700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000c9e40 con 0x7f8f00155c30 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8f04c18700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f000ca120 con 0x7f8f00156000 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8eff7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 0x7f8f00132800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8eff7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 0x7f8f00132800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43274/0 (socket says 172.21.15.19:43274) 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8eff7fe700 1 -- 172.21.15.19:0/1049679981 learned_addr learned my addr 172.21.15.19:0/1049679981 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8efffff700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00156000 0x7f8f000ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8efeffd700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f00155c30 0x7f8f000c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8eff7fe700 1 -- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00156000 msgr2=0x7f8f000ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8eff7fe700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00156000 0x7f8f000ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8eff7fe700 1 -- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f00155c30 msgr2=0x7f8f000c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8eff7fe700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f00155c30 0x7f8f000c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8eff7fe700 1 -- 172.21.15.19:0/1049679981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef8009ae0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8efeffd700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f00155c30 0x7f8f000c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8eff7fe700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 0x7f8f00132800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800d890 tx=0x7f8ee8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8ef77fe700 1 -- 172.21.15.19:0/1049679981 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80125f0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8ef77fe700 1 -- 172.21.15.19:0/1049679981 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee8012750 con 0x7f8f0013a4c0 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f000ca400 con 0x7f8f0013a4c0 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8ef77fe700 1 -- 172.21.15.19:0/1049679981 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8012ad0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.719+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f000ca9c0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.723+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f00069460 con 0x7f8f0013a4c0 2024-08-17T02:26:26.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.723+0000 7f8ef77fe700 1 -- 172.21.15.19:0/1049679981 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8ee801e460 con 0x7f8f0013a4c0 2024-08-17T02:26:26.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.723+0000 7f8ef77fe700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ee0060860 0x7f8ee0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.723+0000 7f8ef77fe700 1 -- 172.21.15.19:0/1049679981 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8ee807cea0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.723+0000 7f8efeffd700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ee0060860 0x7f8ee0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.723+0000 7f8efeffd700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ee0060860 0x7f8ee0062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0006f00 tx=0x7f8ef0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.731+0000 7f8ef77fe700 1 -- 172.21.15.19:0/1049679981 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8ee80510d0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.887+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f000638a0 con 0x7f8f0013a4c0 2024-08-17T02:26:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8ef77fe700 1 -- 172.21.15.19:0/1049679981 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ee8050c60 con 0x7f8f0013a4c0 2024-08-17T02:26:26.895 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:26:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ee0060860 msgr2=0x7f8ee0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ee0060860 0x7f8ee0062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0006f00 tx=0x7f8ef0008040 comp rx=0 tx=0).stop 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 msgr2=0x7f8f00132800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 0x7f8f00132800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800d890 tx=0x7f8ee8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 shutdown_connections 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ee0060860 0x7f8ee0062d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f00156000 0x7f8f000ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f00155c30 0x7f8f000c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 --2- 172.21.15.19:0/1049679981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f0013a4c0 0x7f8f00132800 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 >> 172.21.15.19:0/1049679981 conn(0x7f8f0006e170 msgr2=0x7f8f00068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 shutdown_connections 2024-08-17T02:26:26.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:26.891+0000 7f8f04c18700 1 -- 172.21.15.19:0/1049679981 wait complete. 2024-08-17T02:26:26.909 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:26:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.011+0000 7f929f830700 1 Processor -- start 2024-08-17T02:26:27.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.011+0000 7f929f830700 1 -- start start 2024-08-17T02:26:27.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929f830700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f929815c5a0 0x7f92980caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929f830700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980c77c0 con 0x7f92980cb000 2024-08-17T02:26:27.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929f830700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980c6e90 con 0x7f9298068db0 2024-08-17T02:26:27.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929f830700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980cb510 con 0x7f929815c5a0 2024-08-17T02:26:27.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929d5cc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f929815c5a0 0x7f92980caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929cdcb700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f92980cb000 0x7f92980686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56682/0 (socket says 172.21.15.19:56682) 2024-08-17T02:26:27.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929cdcb700 1 -- 172.21.15.19:0/3092510199 learned_addr learned my addr 172.21.15.19:0/3092510199 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:27.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f928ffff700 1 -- 172.21.15.19:0/3092510199 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325790290 0 0) 0x7f92980c77c0 con 0x7f92980cb000 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f928ffff700 1 -- 172.21.15.19:0/3092510199 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9284003570 con 0x7f92980cb000 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929d5cc700 1 -- 172.21.15.19:0/3092510199 >> v1:172.21.15.119:6789/0 conn(0x7f9298068db0 legacy=0x7f92980c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929d5cc700 1 -- 172.21.15.19:0/3092510199 >> v1:172.21.15.19:6789/0 conn(0x7f92980cb000 legacy=0x7f92980686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929d5cc700 1 -- 172.21.15.19:0/3092510199 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980c7170 con 0x7f929815c5a0 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f929d5cc700 1 --2- 172.21.15.19:0/3092510199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929815c5a0 0x7f92980caac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92940098e0 tx=0x7f92940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2834f35937d58f44 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f928ffff700 1 -- 172.21.15.19:0/3092510199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929400b640 con 0x7f929815c5a0 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f928ffff700 1 -- 172.21.15.19:0/3092510199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929400b7a0 con 0x7f929815c5a0 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.015+0000 7f928ffff700 1 -- 172.21.15.19:0/3092510199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929400bb40 con 0x7f929815c5a0 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 -- 172.21.15.19:0/3092510199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929815c5a0 msgr2=0x7f92980caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 --2- 172.21.15.19:0/3092510199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929815c5a0 0x7f92980caac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f92940098e0 tx=0x7f92940091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 -- 172.21.15.19:0/3092510199 shutdown_connections 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 --2- 172.21.15.19:0/3092510199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929815c5a0 0x7f92980caac0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 -- 172.21.15.19:0/3092510199 >> 172.21.15.19:0/3092510199 conn(0x7f92980c9c20 msgr2=0x7f929806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 -- 172.21.15.19:0/3092510199 shutdown_connections 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 -- 172.21.15.19:0/3092510199 wait complete. 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 Processor -- start 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 -- start start 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9298068db0 0x7f92980ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92980cb000 0x7f929816a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f929815c5a0 0x7f9298158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929816a650 con 0x7f9298068db0 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980aeb10 con 0x7f92980cb000 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.019+0000 7f929f830700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929816a370 con 0x7f929815c5a0 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929d5cc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9298068db0 0x7f92980ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929d5cc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9298068db0 0x7f92980ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43290/0 (socket says 172.21.15.19:43290) 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929d5cc700 1 -- 172.21.15.19:0/2185245158 learned_addr learned my addr 172.21.15.19:0/2185245158 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:27.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929cdcb700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92980cb000 0x7f929816a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929ddcd700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f929815c5a0 0x7f9298158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929d5cc700 1 -- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f929815c5a0 msgr2=0x7f9298158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929d5cc700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f929815c5a0 0x7f9298158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929d5cc700 1 -- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92980cb000 msgr2=0x7f929816a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929d5cc700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92980cb000 0x7f929816a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929d5cc700 1 -- 172.21.15.19:0/2185245158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294009420 con 0x7f9298068db0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929d5cc700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9298068db0 0x7f92980ae5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9294009f80 tx=0x7f9294017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f928d7fa700 1 -- 172.21.15.19:0/2185245158 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294000d10 con 0x7f9298068db0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f928d7fa700 1 -- 172.21.15.19:0/2185245158 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929400bb20 con 0x7f9298068db0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f928d7fa700 1 -- 172.21.15.19:0/2185245158 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294011670 con 0x7f9298068db0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980c3820 con 0x7f9298068db0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980c3de0 con 0x7f9298068db0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.023+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92980c3fd0 con 0x7f9298068db0 2024-08-17T02:26:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.027+0000 7f928d7fa700 1 -- 172.21.15.19:0/2185245158 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9294011a20 con 0x7f9298068db0 2024-08-17T02:26:27.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.027+0000 7f928d7fa700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f927c060860 0x7f927c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.027+0000 7f928d7fa700 1 -- 172.21.15.19:0/2185245158 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f929407dda0 con 0x7f9298068db0 2024-08-17T02:26:27.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.027+0000 7f929cdcb700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f927c060860 0x7f927c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.027+0000 7f929cdcb700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f927c060860 0x7f927c062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9298157460 tx=0x7f9288009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.035+0000 7f928d7fa700 1 -- 172.21.15.19:0/2185245158 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f929404e540 con 0x7f9298068db0 2024-08-17T02:26:27.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9298156da0 con 0x7f9298068db0 2024-08-17T02:26:27.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f928d7fa700 1 -- 172.21.15.19:0/2185245158 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9294051b60 con 0x7f9298068db0 2024-08-17T02:26:27.204 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:27.204 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-08-17T02:26:27.204 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:26:27.204 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-08-17T02:26:27.204 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-08-17T02:26:27.204 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:26:27.204 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-08-17T02:26:27.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f927c060860 msgr2=0x7f927c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f927c060860 0x7f927c062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9298157460 tx=0x7f9288009040 comp rx=0 tx=0).stop 2024-08-17T02:26:27.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9298068db0 msgr2=0x7f92980ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9298068db0 0x7f92980ae5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9294009f80 tx=0x7f9294017000 comp rx=0 tx=0).stop 2024-08-17T02:26:27.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 shutdown_connections 2024-08-17T02:26:27.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f927c060860 0x7f927c062d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f929815c5a0 0x7f9298158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92980cb000 0x7f929816a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 --2- 172.21.15.19:0/2185245158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9298068db0 0x7f92980ae5d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 >> 172.21.15.19:0/2185245158 conn(0x7f92980c9c20 msgr2=0x7f929815b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 shutdown_connections 2024-08-17T02:26:27.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.199+0000 7f929f830700 1 -- 172.21.15.19:0/2185245158 wait complete. 2024-08-17T02:26:27.217 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:26:27.218 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:26:27.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8edea7700 1 Processor -- start 2024-08-17T02:26:27.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8edea7700 1 -- start start 2024-08-17T02:26:27.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8edea7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8e8153030 0x7ff8e80acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8edea7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8068db0 0x7ff8e806be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8edea7700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e806c3d0 con 0x7ff8e8153400 2024-08-17T02:26:27.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8edea7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e8155c20 con 0x7ff8e8153030 2024-08-17T02:26:27.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8edea7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e8155e30 con 0x7ff8e8068db0 2024-08-17T02:26:27.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8ecea5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8e8153030 0x7ff8e80acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8ecea5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8e8153030 0x7ff8e80acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43294/0 (socket says 172.21.15.19:43294) 2024-08-17T02:26:27.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8ecea5700 1 -- 172.21.15.19:0/803766578 learned_addr learned my addr 172.21.15.19:0/803766578 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:27.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8ed6a6700 1 --2- 172.21.15.19:0/803766578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8068db0 0x7ff8e806be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8ecea5700 1 -- 172.21.15.19:0/803766578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8068db0 msgr2=0x7ff8e806be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:27.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8ecea5700 1 --2- 172.21.15.19:0/803766578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8068db0 0x7ff8e806be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8ecea5700 1 -- 172.21.15.19:0/803766578 >> v1:172.21.15.119:6789/0 conn(0x7ff8e8153400 legacy=0x7ff8e80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8ecea5700 1 -- 172.21.15.19:0/803766578 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e8156110 con 0x7ff8e8153030 2024-08-17T02:26:27.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8ecea5700 1 --2- 172.21.15.19:0/803766578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 0x7ff8e80acd40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0099b0 tx=0x7ff8dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653851d9142b63cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8e77fe700 1 -- 172.21.15.19:0/803766578 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc009ea0 con 0x7ff8e8153030 2024-08-17T02:26:27.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8e77fe700 1 -- 172.21.15.19:0/803766578 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc00b860 con 0x7ff8e8153030 2024-08-17T02:26:27.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.327+0000 7ff8e77fe700 1 -- 172.21.15.19:0/803766578 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc00bc00 con 0x7ff8e8153030 2024-08-17T02:26:27.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 -- 172.21.15.19:0/803766578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 msgr2=0x7ff8e80acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 --2- 172.21.15.19:0/803766578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 0x7ff8e80acd40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0099b0 tx=0x7ff8dc009250 comp rx=0 tx=0).stop 2024-08-17T02:26:27.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 -- 172.21.15.19:0/803766578 shutdown_connections 2024-08-17T02:26:27.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 --2- 172.21.15.19:0/803766578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8068db0 0x7ff8e806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 --2- 172.21.15.19:0/803766578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 0x7ff8e80acd40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 -- 172.21.15.19:0/803766578 >> 172.21.15.19:0/803766578 conn(0x7ff8e80ccfd0 msgr2=0x7ff8e806d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 -- 172.21.15.19:0/803766578 shutdown_connections 2024-08-17T02:26:27.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 -- 172.21.15.19:0/803766578 wait complete. 2024-08-17T02:26:27.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 Processor -- start 2024-08-17T02:26:27.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.331+0000 7ff8edea7700 1 -- start start 2024-08-17T02:26:27.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8edea7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e8068db0 0x7ff8e8148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8edea7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 0x7ff8e814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8edea7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8153400 0x7ff8e80b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8edea7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80af4d0 con 0x7ff8e8153030 2024-08-17T02:26:27.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8edea7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b0330 con 0x7ff8e8068db0 2024-08-17T02:26:27.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8edea7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e8149230 con 0x7ff8e8153400 2024-08-17T02:26:27.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 0x7ff8e814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8ecea5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e8068db0 0x7ff8e8148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 0x7ff8e814d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43310/0 (socket says 172.21.15.19:43310) 2024-08-17T02:26:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e7fff700 1 -- 172.21.15.19:0/1300639317 learned_addr learned my addr 172.21.15.19:0/1300639317 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8ed6a6700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8153400 0x7ff8e80b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e7fff700 1 -- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8153400 msgr2=0x7ff8e80b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8153400 0x7ff8e80b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e7fff700 1 -- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e8068db0 msgr2=0x7ff8e8148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e8068db0 0x7ff8e8148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e7fff700 1 -- 172.21.15.19:0/1300639317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0094f0 con 0x7ff8e8153030 2024-08-17T02:26:27.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 0x7ff8e814d380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c5c0 tx=0x7ff8d8007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/1300639317 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8011590 con 0x7ff8e8153030 2024-08-17T02:26:27.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/1300639317 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8011710 con 0x7ff8e8153030 2024-08-17T02:26:27.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e80af720 con 0x7ff8e8153030 2024-08-17T02:26:27.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/1300639317 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8011ad0 con 0x7ff8e8153030 2024-08-17T02:26:27.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.335+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e80afce0 con 0x7ff8e8153030 2024-08-17T02:26:27.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.339+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e80644b0 con 0x7ff8e8153030 2024-08-17T02:26:27.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.339+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/1300639317 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff8d801c460 con 0x7ff8e8153030 2024-08-17T02:26:27.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.339+0000 7ff8e4ff9700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.339+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/1300639317 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff8d807c380 con 0x7ff8e8153030 2024-08-17T02:26:27.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.339+0000 7ff8ecea5700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.339+0000 7ff8ecea5700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0099b0 tx=0x7ff8dc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.347+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/1300639317 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff8d804cb20 con 0x7ff8e8153030 2024-08-17T02:26:27.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.511+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff8e8152110 con 0x7ff8e8153030 2024-08-17T02:26:27.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.595+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/1300639317 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff8d8050140 con 0x7ff8e8153030 2024-08-17T02:26:27.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 msgr2=0x7ff8d4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0099b0 tx=0x7ff8dc017000 comp rx=0 tx=0).stop 2024-08-17T02:26:27.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 msgr2=0x7ff8e814d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 0x7ff8e814d380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800c5c0 tx=0x7ff8d8007ee0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 shutdown_connections 2024-08-17T02:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8153400 0x7ff8e80b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8e8153030 0x7ff8e814d380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 --2- 172.21.15.19:0/1300639317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e8068db0 0x7ff8e8148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 >> 172.21.15.19:0/1300639317 conn(0x7ff8e80ccfd0 msgr2=0x7ff8e8155070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 shutdown_connections 2024-08-17T02:26:27.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.599+0000 7ff8edea7700 1 -- 172.21.15.19:0/1300639317 wait complete. 2024-08-17T02:26:27.609 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-08-17T02:26:27.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:26:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382abaf700 1 Processor -- start 2024-08-17T02:26:27.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382abaf700 1 -- start start 2024-08-17T02:26:27.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382abaf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38240cef90 0x7f3824068a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382abaf700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3824158ca0 0x7f3824159100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382abaf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38240cfd00 con 0x7f3824068650 2024-08-17T02:26:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382abaf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38240cf460 con 0x7f38240cef90 2024-08-17T02:26:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382abaf700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38240cf740 con 0x7f3824158ca0 2024-08-17T02:26:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f3823fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38240cef90 0x7f3824068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382894b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3824068650 0x7f38240ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:56692/0 (socket says 172.21.15.19:56692) 2024-08-17T02:26:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f3823fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38240cef90 0x7f3824068a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43322/0 (socket says 172.21.15.19:43322) 2024-08-17T02:26:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382894b700 1 -- 172.21.15.19:0/410138135 learned_addr learned my addr 172.21.15.19:0/410138135 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:27.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.731+0000 7f382914c700 1 --2- 172.21.15.19:0/410138135 >> v2:172.21.15.119:3300/0 conn(0x7f3824158ca0 0x7f3824159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f3823fff700 1 -- 172.21.15.19:0/410138135 >> v2:172.21.15.119:3300/0 conn(0x7f3824158ca0 msgr2=0x7f3824159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f3823fff700 1 --2- 172.21.15.19:0/410138135 >> v2:172.21.15.119:3300/0 conn(0x7f3824158ca0 0x7f3824159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f3823fff700 1 -- 172.21.15.19:0/410138135 >> v1:172.21.15.19:6789/0 conn(0x7f3824068650 legacy=0x7f38240ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f3823fff700 1 -- 172.21.15.19:0/410138135 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38240cfa20 con 0x7f38240cef90 2024-08-17T02:26:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f3823fff700 1 --2- 172.21.15.19:0/410138135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 0x7f3824068a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38240ce3c0 tx=0x7f38140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ca40ec19b24ac0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f38237fe700 1 -- 172.21.15.19:0/410138135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381400b6b0 con 0x7f38240cef90 2024-08-17T02:26:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f38237fe700 1 -- 172.21.15.19:0/410138135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381400b810 con 0x7f38240cef90 2024-08-17T02:26:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f38237fe700 1 -- 172.21.15.19:0/410138135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381400bbb0 con 0x7f38240cef90 2024-08-17T02:26:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f382abaf700 1 -- 172.21.15.19:0/410138135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 msgr2=0x7f3824068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f382abaf700 1 --2- 172.21.15.19:0/410138135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 0x7f3824068a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38240ce3c0 tx=0x7f38140091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f382abaf700 1 -- 172.21.15.19:0/410138135 shutdown_connections 2024-08-17T02:26:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f382abaf700 1 --2- 172.21.15.19:0/410138135 >> v2:172.21.15.119:3300/0 conn(0x7f3824158ca0 0x7f3824159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f382abaf700 1 --2- 172.21.15.19:0/410138135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 0x7f3824068a20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f382abaf700 1 -- 172.21.15.19:0/410138135 >> 172.21.15.19:0/410138135 conn(0x7f3824066e00 msgr2=0x7f3824067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f382abaf700 1 -- 172.21.15.19:0/410138135 shutdown_connections 2024-08-17T02:26:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.735+0000 7f382abaf700 1 -- 172.21.15.19:0/410138135 wait complete. 2024-08-17T02:26:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 Processor -- start 2024-08-17T02:26:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 -- start start 2024-08-17T02:26:27.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3824068650 0x7f382415f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 0x7f38241524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3824158ca0 0x7f3824169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382415df10 con 0x7f38240cef90 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382416a530 con 0x7f3824158ca0 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382415cc30 con 0x7f3824068650 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3823fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 0x7f38241524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3823fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 0x7f38241524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43326/0 (socket says 172.21.15.19:43326) 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3823fff700 1 -- 172.21.15.19:0/1805383350 learned_addr learned my addr 172.21.15.19:0/1805383350 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382894b700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3824068650 0x7f382415f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382914c700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3824158ca0 0x7f3824169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3823fff700 1 -- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3824068650 msgr2=0x7f382415f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3823fff700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3824068650 0x7f382415f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3823fff700 1 -- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3824158ca0 msgr2=0x7f3824169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3823fff700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3824158ca0 0x7f3824169ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3823fff700 1 -- 172.21.15.19:0/1805383350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814009420 con 0x7f38240cef90 2024-08-17T02:26:27.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3823fff700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 0x7f38241524d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3814013000 tx=0x7f3814017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3820ff9700 1 -- 172.21.15.19:0/1805383350 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381400bb90 con 0x7f38240cef90 2024-08-17T02:26:27.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382415ecc0 con 0x7f38240cef90 2024-08-17T02:26:27.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3820ff9700 1 -- 172.21.15.19:0/1805383350 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814011420 con 0x7f38240cef90 2024-08-17T02:26:27.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f3820ff9700 1 -- 172.21.15.19:0/1805383350 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140117c0 con 0x7f38240cef90 2024-08-17T02:26:27.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.739+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382415f280 con 0x7f38240cef90 2024-08-17T02:26:27.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.743+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382415eb20 con 0x7f38240cef90 2024-08-17T02:26:27.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.743+0000 7f3820ff9700 1 -- 172.21.15.19:0/1805383350 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3814011bb0 con 0x7f38240cef90 2024-08-17T02:26:27.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.743+0000 7f3820ff9700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3804060860 0x7f3804062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:27.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.743+0000 7f3820ff9700 1 -- 172.21.15.19:0/1805383350 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f381407e3f0 con 0x7f38240cef90 2024-08-17T02:26:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.747+0000 7f382894b700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3804060860 0x7f3804062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.747+0000 7f382894b700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3804060860 0x7f3804062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3824160250 tx=0x7f380c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:27.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.751+0000 7f3820ff9700 1 -- 172.21.15.19:0/1805383350 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f381404eaa0 con 0x7f38240cef90 2024-08-17T02:26:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:27.915+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3824063c80 con 0x7f38240cef90 2024-08-17T02:26:28.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.607+0000 7f3820ff9700 1 -- 172.21.15.19:0/1805383350 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3824063c80 con 0x7f38240cef90 2024-08-17T02:26:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.611+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3804060860 msgr2=0x7f3804062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.611+0000 7f382abaf700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3804060860 0x7f3804062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3824160250 tx=0x7f380c007eb0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.611+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 msgr2=0x7f38241524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.611+0000 7f382abaf700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 0x7f38241524d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3814013000 tx=0x7f3814017000 comp rx=0 tx=0).stop 2024-08-17T02:26:28.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.623+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 shutdown_connections 2024-08-17T02:26:28.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.623+0000 7f382abaf700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3804060860 0x7f3804062d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.623+0000 7f382abaf700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3824158ca0 0x7f3824169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.623+0000 7f382abaf700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38240cef90 0x7f38241524d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.623+0000 7f382abaf700 1 --2- 172.21.15.19:0/1805383350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3824068650 0x7f382415f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.623+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 >> 172.21.15.19:0/1805383350 conn(0x7f3824066e00 msgr2=0x7f3824156890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.627+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 shutdown_connections 2024-08-17T02:26:28.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.627+0000 7f382abaf700 1 -- 172.21.15.19:0/1805383350 wait complete. 2024-08-17T02:26:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-08-17T02:26:28.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:26:28.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.755+0000 7fb2de0d3700 1 Processor -- start 2024-08-17T02:26:28.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.755+0000 7fb2de0d3700 1 -- start start 2024-08-17T02:26:28.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2d80cbcc0 0x7fb2d815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb2d815d9f0 0x7fb2d80c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80cc350 con 0x7fb2d80b0390 2024-08-17T02:26:28.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80ca760 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80cd3f0 con 0x7fb2d815d9f0 2024-08-17T02:26:28.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dc8d0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2d80cbcc0 0x7fb2d815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dd0d1700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb2d80b0390 0x7fb2d815cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33820/0 (socket says 172.21.15.19:33820) 2024-08-17T02:26:28.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dd0d1700 1 -- 172.21.15.19:0/500620387 learned_addr learned my addr 172.21.15.19:0/500620387 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:28.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dd8d2700 1 --2- 172.21.15.19:0/500620387 >> v2:172.21.15.119:3300/0 conn(0x7fb2d815d9f0 0x7fb2d80c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dc8d0700 1 -- 172.21.15.19:0/500620387 >> v2:172.21.15.119:3300/0 conn(0x7fb2d815d9f0 msgr2=0x7fb2d80c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:28.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dc8d0700 1 --2- 172.21.15.19:0/500620387 >> v2:172.21.15.119:3300/0 conn(0x7fb2d815d9f0 0x7fb2d80c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dc8d0700 1 -- 172.21.15.19:0/500620387 >> v1:172.21.15.19:6789/0 conn(0x7fb2d80b0390 legacy=0x7fb2d815cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dc8d0700 1 -- 172.21.15.19:0/500620387 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80cc630 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dd8d2700 1 --2- 172.21.15.19:0/500620387 >> v2:172.21.15.119:3300/0 conn(0x7fb2d815d9f0 0x7fb2d80c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2cffff700 1 -- 172.21.15.19:0/500620387 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627904300 0 0) 0x7fb2d80cc350 con 0x7fb2d80b0390 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2dc8d0700 1 --2- 172.21.15.19:0/500620387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 0x7fb2d815d4b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80ceff0 tx=0x7fb2d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d4ca9f5b3499f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2cffff700 1 -- 172.21.15.19:0/500620387 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400b6b0 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2cffff700 1 -- 172.21.15.19:0/500620387 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d400b810 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2cffff700 1 -- 172.21.15.19:0/500620387 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400bbb0 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 -- 172.21.15.19:0/500620387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 msgr2=0x7fb2d815d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 --2- 172.21.15.19:0/500620387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 0x7fb2d815d4b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80ceff0 tx=0x7fb2d40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 -- 172.21.15.19:0/500620387 shutdown_connections 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 --2- 172.21.15.19:0/500620387 >> v2:172.21.15.119:3300/0 conn(0x7fb2d815d9f0 0x7fb2d80c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 --2- 172.21.15.19:0/500620387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 0x7fb2d815d4b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 -- 172.21.15.19:0/500620387 >> 172.21.15.19:0/500620387 conn(0x7fb2d80cdee0 msgr2=0x7fb2d80ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 -- 172.21.15.19:0/500620387 shutdown_connections 2024-08-17T02:26:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.759+0000 7fb2de0d3700 1 -- 172.21.15.19:0/500620387 wait complete. 2024-08-17T02:26:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2de0d3700 1 Processor -- start 2024-08-17T02:26:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2de0d3700 1 -- start start 2024-08-17T02:26:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2de0d3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2d80b0390 0x7fb2d814ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2de0d3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 0x7fb2d81564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2de0d3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2d815d9f0 0x7fb2d8156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2de0d3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c7e80 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2de0d3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8153320 con 0x7fb2d80b0390 2024-08-17T02:26:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2de0d3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c7ba0 con 0x7fb2d815d9f0 2024-08-17T02:26:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dc8d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 0x7fb2d81564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dc8d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 0x7fb2d81564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58102/0 (socket says 172.21.15.19:58102) 2024-08-17T02:26:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dc8d0700 1 -- 172.21.15.19:0/34551561 learned_addr learned my addr 172.21.15.19:0/34551561 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dd0d1700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2d80b0390 0x7fb2d814ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dd8d2700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2d815d9f0 0x7fb2d8156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dc8d0700 1 -- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2d815d9f0 msgr2=0x7fb2d8156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dc8d0700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2d815d9f0 0x7fb2d8156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dc8d0700 1 -- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2d80b0390 msgr2=0x7fb2d814ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dc8d0700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2d80b0390 0x7fb2d814ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dc8d0700 1 -- 172.21.15.19:0/34551561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4009420 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dd8d2700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2d815d9f0 0x7fb2d8156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:28.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.763+0000 7fb2dc8d0700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 0x7fb2d81564e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80c4b50 tx=0x7fb2d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2cd7fa700 1 -- 172.21.15.19:0/34551561 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4000d10 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2cd7fa700 1 -- 172.21.15.19:0/34551561 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d400bb90 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d8152cd0 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2cd7fa700 1 -- 172.21.15.19:0/34551561 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011650 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d814f2d0 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d8152b30 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2cd7fa700 1 -- 172.21.15.19:0/34551561 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb2d4011a00 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2cd7fa700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb2bc060860 0x7fb2bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2cd7fa700 1 -- 172.21.15.19:0/34551561 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb2d407e3a0 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.767+0000 7fb2dd0d1700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb2bc060860 0x7fb2bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.771+0000 7fb2dd0d1700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb2bc060860 0x7fb2bc062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8007fd0 tx=0x7fb2c8007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.775+0000 7fb2cd7fa700 1 -- 172.21.15.19:0/34551561 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb2d8152b30 con 0x7fb2d80cbcc0 2024-08-17T02:26:28.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:28.983+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb2d8152b30 con 0x7fb2d80cbcc0 2024-08-17T02:26:29.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.631+0000 7fb2cd7fa700 1 -- 172.21.15.19:0/34551561 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb2d8152b30 con 0x7fb2d80cbcc0 2024-08-17T02:26:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb2bc060860 msgr2=0x7fb2bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb2bc060860 0x7fb2bc062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8007fd0 tx=0x7fb2c8007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 msgr2=0x7fb2d81564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 0x7fb2d81564e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80c4b50 tx=0x7fb2d4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 shutdown_connections 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb2bc060860 0x7fb2bc062d10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2d815d9f0 0x7fb2d8156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d80cbcc0 0x7fb2d81564e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 --2- 172.21.15.19:0/34551561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2d80b0390 0x7fb2d814ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 >> 172.21.15.19:0/34551561 conn(0x7fb2d80cdee0 msgr2=0x7fb2d815cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 shutdown_connections 2024-08-17T02:26:29.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.639+0000 7fb2de0d3700 1 -- 172.21.15.19:0/34551561 wait complete. 2024-08-17T02:26:29.648 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:26:29.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:29.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.755+0000 7f3b5efaa700 1 Processor -- start 2024-08-17T02:26:29.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.755+0000 7f3b5efaa700 1 -- start start 2024-08-17T02:26:29.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b580b0d20 0x7f3b5806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3b5806e450 0x7f3b580b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b580b1630 0x7f3b581610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b58141a00 con 0x7f3b580b0d20 2024-08-17T02:26:29.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5806e8a0 con 0x7f3b5806e450 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58140b10 con 0x7f3b580b1630 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5dfa8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b580b0d20 0x7f3b5806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5dfa8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b580b0d20 0x7f3b5806df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58108/0 (socket says 172.21.15.19:58108) 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5dfa8700 1 -- 172.21.15.19:0/3159454224 learned_addr learned my addr 172.21.15.19:0/3159454224 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5d7a7700 1 --2- 172.21.15.19:0/3159454224 >> v2:172.21.15.119:3300/0 conn(0x7f3b5806e450 0x7f3b580b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5e7a9700 1 --2- 172.21.15.19:0/3159454224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b580b1630 0x7f3b581610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5dfa8700 1 -- 172.21.15.19:0/3159454224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b580b1630 msgr2=0x7f3b581610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5dfa8700 1 --2- 172.21.15.19:0/3159454224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b580b1630 0x7f3b581610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5dfa8700 1 -- 172.21.15.19:0/3159454224 >> v2:172.21.15.119:3300/0 conn(0x7f3b5806e450 msgr2=0x7f3b580b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5dfa8700 1 --2- 172.21.15.19:0/3159454224 >> v2:172.21.15.119:3300/0 conn(0x7f3b5806e450 0x7f3b580b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5dfa8700 1 -- 172.21.15.19:0/3159454224 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58140df0 con 0x7f3b580b0d20 2024-08-17T02:26:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5dfa8700 1 --2- 172.21.15.19:0/3159454224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b0d20 0x7f3b5806df10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b5806c630 tx=0x7f3b50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb31cd0818536b2a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5cfa6700 1 -- 172.21.15.19:0/3159454224 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000e070 con 0x7f3b580b0d20 2024-08-17T02:26:29.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5cfa6700 1 -- 172.21.15.19:0/3159454224 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000b970 con 0x7f3b580b0d20 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5cfa6700 1 -- 172.21.15.19:0/3159454224 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b500092e0 con 0x7f3b580b0d20 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3159454224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b0d20 msgr2=0x7f3b5806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3159454224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b0d20 0x7f3b5806df10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b5806c630 tx=0x7f3b50009840 comp rx=0 tx=0).stop 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3159454224 shutdown_connections 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3159454224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b580b1630 0x7f3b581610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3159454224 >> v2:172.21.15.119:3300/0 conn(0x7f3b5806e450 0x7f3b580b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3159454224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b0d20 0x7f3b5806df10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3159454224 >> 172.21.15.19:0/3159454224 conn(0x7f3b580678d0 msgr2=0x7f3b58067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3159454224 shutdown_connections 2024-08-17T02:26:29.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.759+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3159454224 wait complete. 2024-08-17T02:26:29.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 Processor -- start 2024-08-17T02:26:29.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 -- start start 2024-08-17T02:26:29.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b5806e450 0x7f3b580a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b580b0d20 0x7f3b580abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b1630 0x7f3b5814c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580acf00 con 0x7f3b580b1630 2024-08-17T02:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580ac2f0 con 0x7f3b580b0d20 2024-08-17T02:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580ac5d0 con 0x7f3b5806e450 2024-08-17T02:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5e7a9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b1630 0x7f3b5814c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5e7a9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b1630 0x7f3b5814c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58124/0 (socket says 172.21.15.19:58124) 2024-08-17T02:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5e7a9700 1 -- 172.21.15.19:0/3380826762 learned_addr learned my addr 172.21.15.19:0/3380826762 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5d7a7700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b580b0d20 0x7f3b580abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5dfa8700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b5806e450 0x7f3b580a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5e7a9700 1 -- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b5806e450 msgr2=0x7f3b580a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5e7a9700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b5806e450 0x7f3b580a9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5e7a9700 1 -- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b580b0d20 msgr2=0x7f3b580abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5e7a9700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b580b0d20 0x7f3b580abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5e7a9700 1 -- 172.21.15.19:0/3380826762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009ae0 con 0x7f3b580b1630 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5e7a9700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b1630 0x7f3b5814c180 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400e8d0 tx=0x7f3b540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b4dffb700 1 -- 172.21.15.19:0/3380826762 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54013680 con 0x7f3b580b1630 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b4dffb700 1 -- 172.21.15.19:0/3380826762 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b540137e0 con 0x7f3b580b1630 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b580ac8b0 con 0x7f3b580b1630 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b4dffb700 1 -- 172.21.15.19:0/3380826762 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54013ba0 con 0x7f3b580b1630 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.763+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b580ac010 con 0x7f3b580b1630 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.767+0000 7f3b4dffb700 1 -- 172.21.15.19:0/3380826762 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3b540123d0 con 0x7f3b580b1630 2024-08-17T02:26:29.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.767+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b580ad0b0 con 0x7f3b580b1630 2024-08-17T02:26:29.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.767+0000 7f3b4dffb700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b3c060860 0x7f3b3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.767+0000 7f3b4dffb700 1 -- 172.21.15.19:0/3380826762 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b5407cc00 con 0x7f3b580b1630 2024-08-17T02:26:29.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.767+0000 7f3b5dfa8700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b3c060860 0x7f3b3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.767+0000 7f3b5dfa8700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b3c060860 0x7f3b3c062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009880 tx=0x7f3b50018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.775+0000 7f3b4dffb700 1 -- 172.21.15.19:0/3380826762 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3b580ad0b0 con 0x7f3b580b1630 2024-08-17T02:26:29.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.943+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b580ad040 con 0x7f3b580b1630 2024-08-17T02:26:29.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b4dffb700 1 -- 172.21.15.19:0/3380826762 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f3b54083080 con 0x7f3b580b1630 2024-08-17T02:26:29.951 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:29.951 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:28.986802+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:29.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b3c060860 msgr2=0x7f3b3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b3c060860 0x7f3b3c062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009880 tx=0x7f3b50018000 comp rx=0 tx=0).stop 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b1630 msgr2=0x7f3b5814c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b1630 0x7f3b5814c180 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400e8d0 tx=0x7f3b540091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 shutdown_connections 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b3c060860 0x7f3b3c062d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b580b1630 0x7f3b5814c180 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b580b0d20 0x7f3b580abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 --2- 172.21.15.19:0/3380826762 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b5806e450 0x7f3b580a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 >> 172.21.15.19:0/3380826762 conn(0x7f3b580678d0 msgr2=0x7f3b58063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 shutdown_connections 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:29.947+0000 7f3b5efaa700 1 -- 172.21.15.19:0/3380826762 wait complete. 2024-08-17T02:26:29.966 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:30.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.067+0000 7f258c182700 1 Processor -- start 2024-08-17T02:26:30.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.067+0000 7f258c182700 1 -- start start 2024-08-17T02:26:30.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2584068db0 0x7f2584164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840c77c0 con 0x7f258415c970 2024-08-17T02:26:30.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840c6e90 con 0x7f258415c5a0 2024-08-17T02:26:30.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25840cb510 con 0x7f2584068db0 2024-08-17T02:26:30.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258971d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f258415c970 0x7f25840686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33836/0 (socket says 172.21.15.19:33836) 2024-08-17T02:26:30.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258971d700 1 -- 172.21.15.19:0/481691439 learned_addr learned my addr 172.21.15.19:0/481691439 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:30.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258a71f700 1 --2- 172.21.15.19:0/481691439 >> v2:172.21.15.119:3300/0 conn(0x7f2584068db0 0x7f2584164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f2588f1c700 1 -- 172.21.15.19:0/481691439 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005928595 0 0) 0x7f25840c77c0 con 0x7f258415c970 2024-08-17T02:26:30.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f2588f1c700 1 -- 172.21.15.19:0/481691439 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2570003570 con 0x7f258415c970 2024-08-17T02:26:30.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258a71f700 1 -- 172.21.15.19:0/481691439 >> v1:172.21.15.119:6789/0 conn(0x7f258415c5a0 legacy=0x7f25840caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f2588f1c700 1 -- 172.21.15.19:0/481691439 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447656610 0 0) 0x7f25840c6e90 con 0x7f258415c5a0 2024-08-17T02:26:30.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258a71f700 1 -- 172.21.15.19:0/481691439 >> v1:172.21.15.19:6789/0 conn(0x7f258415c970 legacy=0x7f25840686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258a71f700 1 -- 172.21.15.19:0/481691439 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25840c7170 con 0x7f2584068db0 2024-08-17T02:26:30.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258a71f700 1 --2- 172.21.15.19:0/481691439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 0x7f2584164230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257c009e60 tx=0x7f257c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16bf0b84561e7ac9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f2588f1c700 1 -- 172.21.15.19:0/481691439 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00e070 con 0x7f2584068db0 2024-08-17T02:26:30.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f2588f1c700 1 -- 172.21.15.19:0/481691439 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c00bb60 con 0x7f2584068db0 2024-08-17T02:26:30.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f2588f1c700 1 -- 172.21.15.19:0/481691439 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c012430 con 0x7f2584068db0 2024-08-17T02:26:30.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 -- 172.21.15.19:0/481691439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 msgr2=0x7f2584164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 --2- 172.21.15.19:0/481691439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 0x7f2584164230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257c009e60 tx=0x7f257c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:30.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 -- 172.21.15.19:0/481691439 shutdown_connections 2024-08-17T02:26:30.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 --2- 172.21.15.19:0/481691439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 0x7f2584164230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 -- 172.21.15.19:0/481691439 >> 172.21.15.19:0/481691439 conn(0x7f25840c9c20 msgr2=0x7f258406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 -- 172.21.15.19:0/481691439 shutdown_connections 2024-08-17T02:26:30.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.071+0000 7f258c182700 1 -- 172.21.15.19:0/481691439 wait complete. 2024-08-17T02:26:30.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258c182700 1 Processor -- start 2024-08-17T02:26:30.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258c182700 1 -- start start 2024-08-17T02:26:30.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258c182700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 0x7f258416a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258c182700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f258415c5a0 0x7f2584155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258c182700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258415c970 0x7f258416a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258c182700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840b05c0 con 0x7f258415c970 2024-08-17T02:26:30.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258c182700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840c52d0 con 0x7f2584068db0 2024-08-17T02:26:30.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258c182700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258416a700 con 0x7f258415c5a0 2024-08-17T02:26:30.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258a71f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258415c970 0x7f258416a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258a71f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258415c970 0x7f258416a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58128/0 (socket says 172.21.15.19:58128) 2024-08-17T02:26:30.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f2589f1e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 0x7f258416a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258a71f700 1 -- 172.21.15.19:0/3120236940 learned_addr learned my addr 172.21.15.19:0/3120236940 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:30.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258971d700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f258415c5a0 0x7f2584155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f2589f1e700 1 -- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f258415c5a0 msgr2=0x7f2584155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f2589f1e700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f258415c5a0 0x7f2584155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f2589f1e700 1 -- 172.21.15.19:0/3120236940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258415c970 msgr2=0x7f258416a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f2589f1e700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258415c970 0x7f258416a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f2589f1e700 1 -- 172.21.15.19:0/3120236940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c009a20 con 0x7f2584068db0 2024-08-17T02:26:30.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f258a71f700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258415c970 0x7f258416a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:30.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.075+0000 7f2589f1e700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 0x7f258416a1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25740011e0 tx=0x7f2574007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f2579ffb700 1 -- 172.21.15.19:0/3120236940 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574011590 con 0x7f2584068db0 2024-08-17T02:26:30.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f2579ffb700 1 -- 172.21.15.19:0/3120236940 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574011710 con 0x7f2584068db0 2024-08-17T02:26:30.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f2579ffb700 1 -- 172.21.15.19:0/3120236940 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574011ad0 con 0x7f2584068db0 2024-08-17T02:26:30.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25840af9b0 con 0x7f2584068db0 2024-08-17T02:26:30.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25840aff70 con 0x7f2584068db0 2024-08-17T02:26:30.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25840645c0 con 0x7f2584068db0 2024-08-17T02:26:30.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f2579ffb700 1 -- 172.21.15.19:0/3120236940 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2574033ad0 con 0x7f2584068db0 2024-08-17T02:26:30.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f2579ffb700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2568060890 0x7f2568062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f2579ffb700 1 -- 172.21.15.19:0/3120236940 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f257407bf90 con 0x7f2584068db0 2024-08-17T02:26:30.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.079+0000 7f258971d700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2568060890 0x7f2568062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.083+0000 7f258971d700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2568060890 0x7f2568062d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f258415bde0 tx=0x7f2580009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.087+0000 7f2579ffb700 1 -- 172.21.15.19:0/3120236940 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f257404c460 con 0x7f2584068db0 2024-08-17T02:26:30.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.255+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25840c6720 con 0x7f2584068db0 2024-08-17T02:26:30.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.259+0000 7f2579ffb700 1 -- 172.21.15.19:0/3120236940 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f2574017020 con 0x7f2584068db0 2024-08-17T02:26:30.264 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:30.265 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:28.986802+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2568060890 msgr2=0x7f2568062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2568060890 0x7f2568062d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f258415bde0 tx=0x7f2580009040 comp rx=0 tx=0).stop 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 msgr2=0x7f258416a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 0x7f258416a1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25740011e0 tx=0x7f2574007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 shutdown_connections 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2568060890 0x7f2568062d40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258415c970 0x7f258416a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f258415c5a0 0x7f2584155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 --2- 172.21.15.19:0/3120236940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2584068db0 0x7f258416a1c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 >> 172.21.15.19:0/3120236940 conn(0x7f25840c9c20 msgr2=0x7f258415a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 shutdown_connections 2024-08-17T02:26:30.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.263+0000 7f258c182700 1 -- 172.21.15.19:0/3120236940 wait complete. 2024-08-17T02:26:30.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:26:30.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822e0a8700 1 Processor -- start 2024-08-17T02:26:30.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822e0a8700 1 -- start start 2024-08-17T02:26:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822e0a8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8228068db0 0x7f8228159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822e0a8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280aa900 con 0x7f82280a9860 2024-08-17T02:26:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822e0a8700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280af130 con 0x7f8228158ea0 2024-08-17T02:26:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822e0a8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8228067490 con 0x7f8228068db0 2024-08-17T02:26:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822d8a7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8228068db0 0x7f8228159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822c8a5700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f82280a9860 0x7f82280686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33844/0 (socket says 172.21.15.19:33844) 2024-08-17T02:26:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822c8a5700 1 -- 172.21.15.19:0/4110326464 learned_addr learned my addr 172.21.15.19:0/4110326464 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:30.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f821ffff700 1 -- 172.21.15.19:0/4110326464 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326665188 0 0) 0x7f82280aa900 con 0x7f82280a9860 2024-08-17T02:26:30.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f821ffff700 1 -- 172.21.15.19:0/4110326464 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8214003570 con 0x7f82280a9860 2024-08-17T02:26:30.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f821ffff700 1 -- 172.21.15.19:0/4110326464 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241015438 0 0) 0x7f82280af130 con 0x7f8228158ea0 2024-08-17T02:26:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f821ffff700 1 -- 172.21.15.19:0/4110326464 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82280aa900 con 0x7f8228158ea0 2024-08-17T02:26:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822d8a7700 1 -- 172.21.15.19:0/4110326464 >> v1:172.21.15.119:6789/0 conn(0x7f8228158ea0 legacy=0x7f82280aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.391+0000 7f822d8a7700 1 -- 172.21.15.19:0/4110326464 >> v1:172.21.15.19:6789/0 conn(0x7f82280a9860 legacy=0x7f82280686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822d8a7700 1 -- 172.21.15.19:0/4110326464 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280a9cf0 con 0x7f8228068db0 2024-08-17T02:26:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822d8a7700 1 --2- 172.21.15.19:0/4110326464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228068db0 0x7f8228159270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8220009e60 tx=0x7f8220009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6df3870f682321 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f821ffff700 1 -- 172.21.15.19:0/4110326464 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000e070 con 0x7f8228068db0 2024-08-17T02:26:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f821ffff700 1 -- 172.21.15.19:0/4110326464 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822000bab0 con 0x7f8228068db0 2024-08-17T02:26:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f821ffff700 1 -- 172.21.15.19:0/4110326464 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000be70 con 0x7f8228068db0 2024-08-17T02:26:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822e0a8700 1 -- 172.21.15.19:0/4110326464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228068db0 msgr2=0x7f8228159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822e0a8700 1 --2- 172.21.15.19:0/4110326464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228068db0 0x7f8228159270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8220009e60 tx=0x7f8220009780 comp rx=0 tx=0).stop 2024-08-17T02:26:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822e0a8700 1 -- 172.21.15.19:0/4110326464 shutdown_connections 2024-08-17T02:26:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822e0a8700 1 --2- 172.21.15.19:0/4110326464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228068db0 0x7f8228159270 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822e0a8700 1 -- 172.21.15.19:0/4110326464 >> 172.21.15.19:0/4110326464 conn(0x7f822806e350 msgr2=0x7f822806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822e0a8700 1 -- 172.21.15.19:0/4110326464 shutdown_connections 2024-08-17T02:26:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822e0a8700 1 -- 172.21.15.19:0/4110326464 wait complete. 2024-08-17T02:26:30.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822e0a8700 1 Processor -- start 2024-08-17T02:26:30.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.395+0000 7f822e0a8700 1 -- start start 2024-08-17T02:26:30.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822e0a8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8228068db0 0x7f8228157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822e0a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82280a9860 0x7f82280c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822e0a8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228158ea0 0x7f82280cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822e0a8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280c1f80 con 0x7f8228158ea0 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822e0a8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280c2260 con 0x7f8228068db0 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822e0a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82280c2540 con 0x7f82280a9860 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d8a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228158ea0 0x7f82280cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d8a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228158ea0 0x7f82280cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58136/0 (socket says 172.21.15.19:58136) 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d8a7700 1 -- 172.21.15.19:0/2341246334 learned_addr learned my addr 172.21.15.19:0/2341246334 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d0a6700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8228068db0 0x7f8228157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822c8a5700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82280a9860 0x7f82280c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d8a7700 1 -- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82280a9860 msgr2=0x7f82280c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d8a7700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82280a9860 0x7f82280c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d8a7700 1 -- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8228068db0 msgr2=0x7f8228157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d8a7700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8228068db0 0x7f8228157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d8a7700 1 -- 172.21.15.19:0/2341246334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8220009a20 con 0x7f8228158ea0 2024-08-17T02:26:30.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822d8a7700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228158ea0 0x7f82280cb750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8220013000 tx=0x7f8220019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f821d7fa700 1 -- 172.21.15.19:0/2341246334 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220012db0 con 0x7f8228158ea0 2024-08-17T02:26:30.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f821d7fa700 1 -- 172.21.15.19:0/2341246334 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8220026480 con 0x7f8228158ea0 2024-08-17T02:26:30.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f821d7fa700 1 -- 172.21.15.19:0/2341246334 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220026840 con 0x7f8228158ea0 2024-08-17T02:26:30.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82280c2820 con 0x7f8228158ea0 2024-08-17T02:26:30.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.399+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8228157a90 con 0x7f8228158ea0 2024-08-17T02:26:30.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.403+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82280c8a50 con 0x7f8228158ea0 2024-08-17T02:26:30.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.403+0000 7f821d7fa700 1 -- 172.21.15.19:0/2341246334 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f822001c400 con 0x7f8228158ea0 2024-08-17T02:26:30.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.403+0000 7f821d7fa700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f820c060890 0x7f820c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.403+0000 7f821d7fa700 1 -- 172.21.15.19:0/2341246334 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f822007e960 con 0x7f8228158ea0 2024-08-17T02:26:30.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.403+0000 7f822d0a6700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f820c060890 0x7f820c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.403+0000 7f822d0a6700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f820c060890 0x7f820c062d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8224007fd0 tx=0x7f8224007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.411+0000 7f821d7fa700 1 -- 172.21.15.19:0/2341246334 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f82280c8a50 con 0x7f8228158ea0 2024-08-17T02:26:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.611+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f82280c8a50 con 0x7f8228158ea0 2024-08-17T02:26:30.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f821d7fa700 1 -- 172.21.15.19:0/2341246334 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f82280c8a50 con 0x7f8228158ea0 2024-08-17T02:26:30.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f820c060890 msgr2=0x7f820c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f820c060890 0x7f820c062d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8224007fd0 tx=0x7f8224007d50 comp rx=0 tx=0).stop 2024-08-17T02:26:30.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228158ea0 msgr2=0x7f82280cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228158ea0 0x7f82280cb750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8220013000 tx=0x7f8220019000 comp rx=0 tx=0).stop 2024-08-17T02:26:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 shutdown_connections 2024-08-17T02:26:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f820c060890 0x7f820c062d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8228158ea0 0x7f82280cb750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f82280a9860 0x7f82280c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 --2- 172.21.15.19:0/2341246334 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8228068db0 0x7f8228157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 >> 172.21.15.19:0/2341246334 conn(0x7f822806e350 msgr2=0x7f8228157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 shutdown_connections 2024-08-17T02:26:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.639+0000 7f822e0a8700 1 -- 172.21.15.19:0/2341246334 wait complete. 2024-08-17T02:26:30.660 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:26:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.763+0000 7f22b0c59700 1 Processor -- start 2024-08-17T02:26:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22b0c59700 1 -- start start 2024-08-17T02:26:30.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22b0c59700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22ac140910 0x7f22ac0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22b0c59700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22ac0cbab0 0x7f22ac0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22b0c59700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac0cc450 con 0x7f22ac0c2c80 2024-08-17T02:26:30.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22b0c59700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0c3e30 con 0x7f22ac140910 2024-08-17T02:26:30.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22b0c59700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0c4110 con 0x7f22ac0cbab0 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22ab7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22ac140910 0x7f22ac0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22abfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22ac0c2c80 0x7f22ac0c30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33848/0 (socket says 172.21.15.19:33848) 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22abfff700 1 -- 172.21.15.19:0/2010930118 learned_addr learned my addr 172.21.15.19:0/2010930118 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22aaffd700 1 --2- 172.21.15.19:0/2010930118 >> v2:172.21.15.119:3300/0 conn(0x7f22ac0cbab0 0x7f22ac0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22aa7fc700 1 -- 172.21.15.19:0/2010930118 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975245976 0 0) 0x7f22a4001490 con 0x7f22ac0c2c80 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22aa7fc700 1 -- 172.21.15.19:0/2010930118 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2294003570 con 0x7f22ac0c2c80 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22ab7fe700 1 -- 172.21.15.19:0/2010930118 >> v2:172.21.15.119:3300/0 conn(0x7f22ac0cbab0 msgr2=0x7f22ac0cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22ab7fe700 1 --2- 172.21.15.19:0/2010930118 >> v2:172.21.15.119:3300/0 conn(0x7f22ac0cbab0 0x7f22ac0cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22ab7fe700 1 -- 172.21.15.19:0/2010930118 >> v1:172.21.15.19:6789/0 conn(0x7f22ac0c2c80 legacy=0x7f22ac0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22ab7fe700 1 -- 172.21.15.19:0/2010930118 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0c43f0 con 0x7f22ac140910 2024-08-17T02:26:30.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22ab7fe700 1 --2- 172.21.15.19:0/2010930118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac140910 0x7f22ac0c8520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06eb90 tx=0x7f229c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65eedf62b39698c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22aa7fc700 1 -- 172.21.15.19:0/2010930118 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c011630 con 0x7f22ac140910 2024-08-17T02:26:30.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22aa7fc700 1 -- 172.21.15.19:0/2010930118 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c011790 con 0x7f22ac140910 2024-08-17T02:26:30.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.767+0000 7f22aa7fc700 1 -- 172.21.15.19:0/2010930118 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c011b30 con 0x7f22ac140910 2024-08-17T02:26:30.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- 172.21.15.19:0/2010930118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac140910 msgr2=0x7f22ac0c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 --2- 172.21.15.19:0/2010930118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac140910 0x7f22ac0c8520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06eb90 tx=0x7f229c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- 172.21.15.19:0/2010930118 shutdown_connections 2024-08-17T02:26:30.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 --2- 172.21.15.19:0/2010930118 >> v2:172.21.15.119:3300/0 conn(0x7f22ac0cbab0 0x7f22ac0cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 --2- 172.21.15.19:0/2010930118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac140910 0x7f22ac0c8520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- 172.21.15.19:0/2010930118 >> 172.21.15.19:0/2010930118 conn(0x7f22ac0cdee0 msgr2=0x7f22ac0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- 172.21.15.19:0/2010930118 shutdown_connections 2024-08-17T02:26:30.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- 172.21.15.19:0/2010930118 wait complete. 2024-08-17T02:26:30.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 Processor -- start 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- start start 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22ac0c2c80 0x7f22ac069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac0cbab0 0x7f22ac159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac140910 0x7f22ac159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac12ea20 con 0x7f22ac0cbab0 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac069ae0 con 0x7f22ac140910 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac069dc0 con 0x7f22ac0c2c80 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22aaffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac0cbab0 0x7f22ac159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22aaffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac0cbab0 0x7f22ac159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58150/0 (socket says 172.21.15.19:58150) 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22aaffd700 1 -- 172.21.15.19:0/2458034858 learned_addr learned my addr 172.21.15.19:0/2458034858 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:30.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22abfff700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac140910 0x7f22ac159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22ab7fe700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22ac0c2c80 0x7f22ac069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22aaffd700 1 -- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22ac0c2c80 msgr2=0x7f22ac069160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22aaffd700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22ac0c2c80 0x7f22ac069160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22aaffd700 1 -- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac140910 msgr2=0x7f22ac159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22aaffd700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac140910 0x7f22ac159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22aaffd700 1 -- 172.21.15.19:0/2458034858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c009420 con 0x7f22ac0cbab0 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22aaffd700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac0cbab0 0x7f22ac159500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22a000ec80 tx=0x7f22a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22937fe700 1 -- 172.21.15.19:0/2458034858 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000c850 con 0x7f22ac0cbab0 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22937fe700 1 -- 172.21.15.19:0/2458034858 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000c9b0 con 0x7f22ac0cbab0 2024-08-17T02:26:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22937fe700 1 -- 172.21.15.19:0/2458034858 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000cd50 con 0x7f22ac0cbab0 2024-08-17T02:26:30.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.771+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac06a0a0 con 0x7f22ac0cbab0 2024-08-17T02:26:30.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.775+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac069720 con 0x7f22ac0cbab0 2024-08-17T02:26:30.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.775+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac12ebd0 con 0x7f22ac0cbab0 2024-08-17T02:26:30.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.775+0000 7f22937fe700 1 -- 172.21.15.19:0/2458034858 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f22a0013680 con 0x7f22ac0cbab0 2024-08-17T02:26:30.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.775+0000 7f22937fe700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2298060860 0x7f2298062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.775+0000 7f22937fe700 1 -- 172.21.15.19:0/2458034858 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22a007cec0 con 0x7f22ac0cbab0 2024-08-17T02:26:30.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.775+0000 7f22ab7fe700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2298060860 0x7f2298062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.779+0000 7f22ab7fe700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2298060860 0x7f2298062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06eb90 tx=0x7f229c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.783+0000 7f22937fe700 1 -- 172.21.15.19:0/2458034858 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f22ac12ebd0 con 0x7f22ac0cbab0 2024-08-17T02:26:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:30.983+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f22ac0638f0 con 0x7f22ac0cbab0 2024-08-17T02:26:31.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.643+0000 7f22937fe700 1 -- 172.21.15.19:0/2458034858 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f22a004d310 con 0x7f22ac0cbab0 2024-08-17T02:26:31.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2298060860 msgr2=0x7f2298062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2298060860 0x7f2298062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06eb90 tx=0x7f229c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:31.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac0cbab0 msgr2=0x7f22ac159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac0cbab0 0x7f22ac159500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22a000ec80 tx=0x7f22a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 shutdown_connections 2024-08-17T02:26:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2298060860 0x7f2298062d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22ac140910 0x7f22ac159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22ac0cbab0 0x7f22ac159500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 --2- 172.21.15.19:0/2458034858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22ac0c2c80 0x7f22ac069160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 >> 172.21.15.19:0/2458034858 conn(0x7f22ac0cdee0 msgr2=0x7f22ac0b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 shutdown_connections 2024-08-17T02:26:31.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.647+0000 7f22b0c59700 1 -- 172.21.15.19:0/2458034858 wait complete. 2024-08-17T02:26:31.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:31.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 Processor -- start 2024-08-17T02:26:31.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 -- start start 2024-08-17T02:26:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fad2415d540 0x7fad240af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fad2406e830 0x7fad240a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad240a9260 0x7fad240b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad240b0270 con 0x7fad2415d540 2024-08-17T02:26:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad240af660 con 0x7fad2406e830 2024-08-17T02:26:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad240af940 con 0x7fad240a9260 2024-08-17T02:26:31.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad28a38700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fad2415d540 0x7fad240af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad28a38700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fad2415d540 0x7fad240af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58166/0 (socket says 172.21.15.19:58166) 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad28a38700 1 -- 172.21.15.19:0/3197781015 learned_addr learned my addr 172.21.15.19:0/3197781015 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad23fff700 1 --2- 172.21.15.19:0/3197781015 >> v2:172.21.15.119:3300/0 conn(0x7fad2406e830 0x7fad240a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad29239700 1 --2- 172.21.15.19:0/3197781015 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad240a9260 0x7fad240b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad28a38700 1 -- 172.21.15.19:0/3197781015 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad240a9260 msgr2=0x7fad240b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad28a38700 1 --2- 172.21.15.19:0/3197781015 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad240a9260 0x7fad240b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad28a38700 1 -- 172.21.15.19:0/3197781015 >> v2:172.21.15.119:3300/0 conn(0x7fad2406e830 msgr2=0x7fad240a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad28a38700 1 --2- 172.21.15.19:0/3197781015 >> v2:172.21.15.119:3300/0 conn(0x7fad2406e830 0x7fad240a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad28a38700 1 -- 172.21.15.19:0/3197781015 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad240afc20 con 0x7fad2415d540 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad23fff700 1 --2- 172.21.15.19:0/3197781015 >> v2:172.21.15.119:3300/0 conn(0x7fad2406e830 0x7fad240a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:31.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad28a38700 1 --2- 172.21.15.19:0/3197781015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2415d540 0x7fad240af030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad2406c970 tx=0x7fad18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9123dd6a4eade0b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad237fe700 1 -- 172.21.15.19:0/3197781015 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800b860 con 0x7fad2415d540 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad237fe700 1 -- 172.21.15.19:0/3197781015 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1800b9c0 con 0x7fad2415d540 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad237fe700 1 -- 172.21.15.19:0/3197781015 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1800bd60 con 0x7fad2415d540 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3197781015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2415d540 msgr2=0x7fad240af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3197781015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2415d540 0x7fad240af030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fad2406c970 tx=0x7fad18009250 comp rx=0 tx=0).stop 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3197781015 shutdown_connections 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3197781015 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad240a9260 0x7fad240b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3197781015 >> v2:172.21.15.119:3300/0 conn(0x7fad2406e830 0x7fad240a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3197781015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2415d540 0x7fad240af030 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3197781015 >> 172.21.15.19:0/3197781015 conn(0x7fad24066e00 msgr2=0x7fad24067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3197781015 shutdown_connections 2024-08-17T02:26:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.775+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3197781015 wait complete. 2024-08-17T02:26:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad2ac9c700 1 Processor -- start 2024-08-17T02:26:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad2ac9c700 1 -- start start 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad2ac9c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad2406e830 0x7fad240ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad2ac9c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad240a9260 0x7fad240aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad2ac9c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2415d540 0x7fad241577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad2ac9c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad240abb60 con 0x7fad240a9260 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad2ac9c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad240c8350 con 0x7fad2415d540 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad2ac9c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad240ab5a0 con 0x7fad2406e830 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad23fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad240a9260 0x7fad240aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad23fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad240a9260 0x7fad240aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58168/0 (socket says 172.21.15.19:58168) 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.779+0000 7fad23fff700 1 -- 172.21.15.19:0/3467334513 learned_addr learned my addr 172.21.15.19:0/3467334513 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad29239700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2415d540 0x7fad241577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad28a38700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad2406e830 0x7fad240ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad23fff700 1 -- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad2406e830 msgr2=0x7fad240ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad23fff700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad2406e830 0x7fad240ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad23fff700 1 -- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2415d540 msgr2=0x7fad241577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad23fff700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2415d540 0x7fad241577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad23fff700 1 -- 172.21.15.19:0/3467334513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad180094f0 con 0x7fad240a9260 2024-08-17T02:26:31.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad23fff700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad240a9260 0x7fad240aab50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad1400d1d0 tx=0x7fad14009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad20ff9700 1 -- 172.21.15.19:0/3467334513 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1400dd10 con 0x7fad240a9260 2024-08-17T02:26:31.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad20ff9700 1 -- 172.21.15.19:0/3467334513 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400f040 con 0x7fad240a9260 2024-08-17T02:26:31.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad240ab880 con 0x7fad240a9260 2024-08-17T02:26:31.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad20ff9700 1 -- 172.21.15.19:0/3467334513 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14015670 con 0x7fad240a9260 2024-08-17T02:26:31.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad24097850 con 0x7fad240a9260 2024-08-17T02:26:31.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad240645c0 con 0x7fad240a9260 2024-08-17T02:26:31.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad20ff9700 1 -- 172.21.15.19:0/3467334513 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fad14015a60 con 0x7fad240a9260 2024-08-17T02:26:31.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.783+0000 7fad20ff9700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fad10060890 0x7fad10062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.787+0000 7fad20ff9700 1 -- 172.21.15.19:0/3467334513 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad1407cf20 con 0x7fad240a9260 2024-08-17T02:26:31.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.787+0000 7fad28a38700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fad10060890 0x7fad10062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.787+0000 7fad28a38700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fad10060890 0x7fad10062d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fad2406c970 tx=0x7fad18017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.791+0000 7fad20ff9700 1 -- 172.21.15.19:0/3467334513 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fad1404d420 con 0x7fad240a9260 2024-08-17T02:26:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.991+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad2406e610 con 0x7fad240a9260 2024-08-17T02:26:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.991+0000 7fad20ff9700 1 -- 172.21.15.19:0/3467334513 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fad14050a40 con 0x7fad240a9260 2024-08-17T02:26:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:31.996 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/903872793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":903872793},{"type":"v1","addr":"172.21.15.19:6833","nonce":903872793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3217936958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3217936958},{"type":"v1","addr":"172.21.15.19:6835","nonce":3217936958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/183789327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":183789327},{"type":"v1","addr":"172.21.15.119:6837","nonce":183789327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:28.987569+0000","modified":"2024-08-17T02:26:31.636583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.991+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fad10060890 msgr2=0x7fad10062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.991+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fad10060890 0x7fad10062d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fad2406c970 tx=0x7fad18017000 comp rx=0 tx=0).stop 2024-08-17T02:26:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.991+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad240a9260 msgr2=0x7fad240aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.991+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad240a9260 0x7fad240aab50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad1400d1d0 tx=0x7fad14009a90 comp rx=0 tx=0).stop 2024-08-17T02:26:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.995+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 shutdown_connections 2024-08-17T02:26:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.995+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fad10060890 0x7fad10062d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.995+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad2415d540 0x7fad241577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.995+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad240a9260 0x7fad240aab50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.995+0000 7fad2ac9c700 1 --2- 172.21.15.19:0/3467334513 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad2406e830 0x7fad240ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.995+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 >> 172.21.15.19:0/3467334513 conn(0x7fad24066e00 msgr2=0x7fad24158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.995+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 shutdown_connections 2024-08-17T02:26:32.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:31.995+0000 7fad2ac9c700 1 -- 172.21.15.19:0/3467334513 wait complete. 2024-08-17T02:26:32.000 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-08-17T02:26:32.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:32.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51f02d700 1 Processor -- start 2024-08-17T02:26:32.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51f02d700 1 -- start start 2024-08-17T02:26:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51f02d700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc518140950 0x7fc5180ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51f02d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5180c97b0 0x7fc5180b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51f02d700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5180aec60 con 0x7fc5180ae800 2024-08-17T02:26:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51f02d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5180b0da0 con 0x7fc5180c97b0 2024-08-17T02:26:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51f02d700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5180c9dd0 con 0x7fc518140950 2024-08-17T02:26:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51e82c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5180c97b0 0x7fc5180b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51e82c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5180c97b0 0x7fc5180b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58170/0 (socket says 172.21.15.19:58170) 2024-08-17T02:26:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51e82c700 1 -- 172.21.15.19:0/3535778442 learned_addr learned my addr 172.21.15.19:0/3535778442 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:32.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51e02b700 1 --2- 172.21.15.19:0/3535778442 >> v2:172.21.15.119:3300/0 conn(0x7fc518140950 0x7fc5180ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51e82c700 1 -- 172.21.15.19:0/3535778442 >> v2:172.21.15.119:3300/0 conn(0x7fc518140950 msgr2=0x7fc5180ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51e82c700 1 --2- 172.21.15.19:0/3535778442 >> v2:172.21.15.119:3300/0 conn(0x7fc518140950 0x7fc5180ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51e82c700 1 -- 172.21.15.19:0/3535778442 >> v1:172.21.15.119:6789/0 conn(0x7fc5180ae800 legacy=0x7fc5180c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51e82c700 1 -- 172.21.15.19:0/3535778442 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180ca0b0 con 0x7fc5180c97b0 2024-08-17T02:26:32.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51e82c700 1 --2- 172.21.15.19:0/3535778442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5180c97b0 0x7fc5180b1230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc510009f20 tx=0x7fc510009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26c647e0ac55139 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.111+0000 7fc51d029700 1 -- 172.21.15.19:0/3535778442 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51000e070 con 0x7fc5180c97b0 2024-08-17T02:26:32.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51d029700 1 -- 172.21.15.19:0/3535778442 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51000ba40 con 0x7fc5180c97b0 2024-08-17T02:26:32.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51d029700 1 -- 172.21.15.19:0/3535778442 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5100092e0 con 0x7fc5180c97b0 2024-08-17T02:26:32.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 -- 172.21.15.19:0/3535778442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5180c97b0 msgr2=0x7fc5180b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 --2- 172.21.15.19:0/3535778442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5180c97b0 0x7fc5180b1230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc510009f20 tx=0x7fc510009840 comp rx=0 tx=0).stop 2024-08-17T02:26:32.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 -- 172.21.15.19:0/3535778442 shutdown_connections 2024-08-17T02:26:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 --2- 172.21.15.19:0/3535778442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5180c97b0 0x7fc5180b1230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 --2- 172.21.15.19:0/3535778442 >> v2:172.21.15.119:3300/0 conn(0x7fc518140950 0x7fc5180ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 -- 172.21.15.19:0/3535778442 >> 172.21.15.19:0/3535778442 conn(0x7fc5180ca900 msgr2=0x7fc5180cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 -- 172.21.15.19:0/3535778442 shutdown_connections 2024-08-17T02:26:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 -- 172.21.15.19:0/3535778442 wait complete. 2024-08-17T02:26:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 Processor -- start 2024-08-17T02:26:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 -- start start 2024-08-17T02:26:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5180ae800 0x7fc518069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5180c97b0 0x7fc5180c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc518140950 0x7fc518138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5180c5480 con 0x7fc518140950 2024-08-17T02:26:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5180c62a0 con 0x7fc5180c97b0 2024-08-17T02:26:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51f02d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5180c5690 con 0x7fc5180ae800 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51e82c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc518140950 0x7fc518138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51e82c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc518140950 0x7fc518138ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58178/0 (socket says 172.21.15.19:58178) 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51e82c700 1 -- 172.21.15.19:0/3887801695 learned_addr learned my addr 172.21.15.19:0/3887801695 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51d82a700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5180c97b0 0x7fc5180c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51e02b700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5180ae800 0x7fc518069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51e82c700 1 -- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5180ae800 msgr2=0x7fc518069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51e82c700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5180ae800 0x7fc518069ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51e82c700 1 -- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5180c97b0 msgr2=0x7fc5180c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51e82c700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5180c97b0 0x7fc5180c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51e82c700 1 -- 172.21.15.19:0/3887801695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc510009ae0 con 0x7fc518140950 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.115+0000 7fc51d82a700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5180c97b0 0x7fc5180c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc51e82c700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc518140950 0x7fc518138ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc51000b6c0 tx=0x7fc510018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc50e7fc700 1 -- 172.21.15.19:0/3887801695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510008e70 con 0x7fc518140950 2024-08-17T02:26:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc50e7fc700 1 -- 172.21.15.19:0/3887801695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc510026460 con 0x7fc518140950 2024-08-17T02:26:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5180c5970 con 0x7fc518140950 2024-08-17T02:26:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc50e7fc700 1 -- 172.21.15.19:0/3887801695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510026840 con 0x7fc518140950 2024-08-17T02:26:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5180c5f30 con 0x7fc518140950 2024-08-17T02:26:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5180643a0 con 0x7fc518140950 2024-08-17T02:26:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc50e7fc700 1 -- 172.21.15.19:0/3887801695 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc510003040 con 0x7fc518140950 2024-08-17T02:26:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc50e7fc700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc4fc060860 0x7fc4fc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc50e7fc700 1 -- 172.21.15.19:0/3887801695 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc51007f120 con 0x7fc518140950 2024-08-17T02:26:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.119+0000 7fc51e02b700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc4fc060860 0x7fc4fc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.123+0000 7fc51e02b700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc4fc060860 0x7fc4fc062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc508006fd0 tx=0x7fc508008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.127+0000 7fc50e7fc700 1 -- 172.21.15.19:0/3887801695 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc51004f4d0 con 0x7fc518140950 2024-08-17T02:26:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.295+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5180681a0 con 0x7fc518140950 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.295+0000 7fc50e7fc700 1 -- 172.21.15.19:0/3887801695 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc510052af0 con 0x7fc518140950 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:32.301 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:32.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc4fc060860 msgr2=0x7fc4fc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc4fc060860 0x7fc4fc062d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc508006fd0 tx=0x7fc508008040 comp rx=0 tx=0).stop 2024-08-17T02:26:32.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc518140950 msgr2=0x7fc518138ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc518140950 0x7fc518138ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc51000b6c0 tx=0x7fc510018000 comp rx=0 tx=0).stop 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 shutdown_connections 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc4fc060860 0x7fc4fc062d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc518140950 0x7fc518138ac0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5180c97b0 0x7fc5180c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 --2- 172.21.15.19:0/3887801695 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5180ae800 0x7fc518069ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 >> 172.21.15.19:0/3887801695 conn(0x7fc5180ca900 msgr2=0x7fc5180b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 shutdown_connections 2024-08-17T02:26:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.299+0000 7fc51f02d700 1 -- 172.21.15.19:0/3887801695 wait complete. 2024-08-17T02:26:32.316 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:26:32.316 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:32.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2cece700 1 Processor -- start 2024-08-17T02:26:32.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2cece700 1 -- start start 2024-08-17T02:26:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2cece700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e28159340 0x7f1e280ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2cece700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1e280cddc0 0x7f1e280cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2cece700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e280cef40 con 0x7f1e280cb240 2024-08-17T02:26:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2cece700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e280ad930 con 0x7f1e280cddc0 2024-08-17T02:26:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2cece700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280af770 con 0x7f1e28159340 2024-08-17T02:26:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e25d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1e280cddc0 0x7f1e280cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e25d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1e280cddc0 0x7f1e280cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58194/0 (socket says 172.21.15.19:58194) 2024-08-17T02:26:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e25d9b700 1 -- 172.21.15.19:0/2702812891 learned_addr learned my addr 172.21.15.19:0/2702812891 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:32.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2659c700 1 --2- 172.21.15.19:0/2702812891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e28159340 0x7f1e280ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e25d9b700 1 -- 172.21.15.19:0/2702812891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e28159340 msgr2=0x7f1e280ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e25d9b700 1 --2- 172.21.15.19:0/2702812891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e28159340 0x7f1e280ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e25d9b700 1 -- 172.21.15.19:0/2702812891 >> v1:172.21.15.19:6789/0 conn(0x7f1e280cb240 legacy=0x7f1e280cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e25d9b700 1 -- 172.21.15.19:0/2702812891 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e280ce330 con 0x7f1e280cddc0 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2659c700 1 --2- 172.21.15.19:0/2702812891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e28159340 0x7f1e280ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e25d9b700 1 --2- 172.21.15.19:0/2702812891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 0x7f1e280cd510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009f50 tx=0x7f1e18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d76b50942f69e4f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2559a700 1 -- 172.21.15.19:0/2702812891 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1800e070 con 0x7f1e280cddc0 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.415+0000 7f1e2559a700 1 -- 172.21.15.19:0/2702812891 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1800bb00 con 0x7f1e280cddc0 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2559a700 1 -- 172.21.15.19:0/2702812891 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180092e0 con 0x7f1e280cddc0 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 -- 172.21.15.19:0/2702812891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 msgr2=0x7f1e280cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 --2- 172.21.15.19:0/2702812891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 0x7f1e280cd510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009f50 tx=0x7f1e18009840 comp rx=0 tx=0).stop 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 -- 172.21.15.19:0/2702812891 shutdown_connections 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 --2- 172.21.15.19:0/2702812891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 0x7f1e280cd510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 --2- 172.21.15.19:0/2702812891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e28159340 0x7f1e280ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 -- 172.21.15.19:0/2702812891 >> 172.21.15.19:0/2702812891 conn(0x7f1e280994e0 msgr2=0x7f1e280675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 -- 172.21.15.19:0/2702812891 shutdown_connections 2024-08-17T02:26:32.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 -- 172.21.15.19:0/2702812891 wait complete. 2024-08-17T02:26:32.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 Processor -- start 2024-08-17T02:26:32.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.419+0000 7f1e2cece700 1 -- start start 2024-08-17T02:26:32.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2cece700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e280cb240 0x7f1e280b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2cece700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 0x7f1e280b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2cece700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e28159340 0x7f1e280b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2cece700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280c8f00 con 0x7f1e280cddc0 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2cece700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280c8020 con 0x7f1e28159340 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2cece700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280b3580 con 0x7f1e280cb240 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e25d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 0x7f1e280b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e25d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 0x7f1e280b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58198/0 (socket says 172.21.15.19:58198) 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e25d9b700 1 -- 172.21.15.19:0/2249933590 learned_addr learned my addr 172.21.15.19:0/2249933590 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2659c700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e280cb240 0x7f1e280b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e26d9d700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e28159340 0x7f1e280b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e25d9b700 1 -- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e280cb240 msgr2=0x7f1e280b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e25d9b700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e280cb240 0x7f1e280b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e25d9b700 1 -- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e28159340 msgr2=0x7f1e280b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e25d9b700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e28159340 0x7f1e280b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e25d9b700 1 -- 172.21.15.19:0/2249933590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18009ae0 con 0x7f1e280cddc0 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2659c700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e280cb240 0x7f1e280b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:32.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e25d9b700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 0x7f1e280b4a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e280892f0 tx=0x7f1e18018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e167fc700 1 -- 172.21.15.19:0/2249933590 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18008c60 con 0x7f1e280cddc0 2024-08-17T02:26:32.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e167fc700 1 -- 172.21.15.19:0/2249933590 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18008de0 con 0x7f1e280cddc0 2024-08-17T02:26:32.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e280c8280 con 0x7f1e280cddc0 2024-08-17T02:26:32.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e167fc700 1 -- 172.21.15.19:0/2249933590 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1801d670 con 0x7f1e280cddc0 2024-08-17T02:26:32.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.423+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e280c8840 con 0x7f1e280cddc0 2024-08-17T02:26:32.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.427+0000 7f1e167fc700 1 -- 172.21.15.19:0/2249933590 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1e18003040 con 0x7f1e280cddc0 2024-08-17T02:26:32.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.427+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e280c9040 con 0x7f1e280cddc0 2024-08-17T02:26:32.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.427+0000 7f1e167fc700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1e08060860 0x7f1e08062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.427+0000 7f1e167fc700 1 -- 172.21.15.19:0/2249933590 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e1807e860 con 0x7f1e280cddc0 2024-08-17T02:26:32.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.427+0000 7f1e2659c700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1e08060860 0x7f1e08062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.427+0000 7f1e2659c700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1e08060860 0x7f1e08062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ab80 tx=0x7f1e1c006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.435+0000 7f1e167fc700 1 -- 172.21.15.19:0/2249933590 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1e280c9040 con 0x7f1e280cddc0 2024-08-17T02:26:32.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.587+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e28064630 con 0x7f1e08060860 2024-08-17T02:26:32.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.607+0000 7f1e167fc700 1 -- 172.21.15.19:0/2249933590 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249745 (secure 0 0 0) 0x7f1e28064630 con 0x7f1e08060860 2024-08-17T02:26:32.615 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1e08060860 msgr2=0x7f1e08062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1e08060860 0x7f1e08062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00ab80 tx=0x7f1e1c006f90 comp rx=0 tx=0).stop 2024-08-17T02:26:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 msgr2=0x7f1e280b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 0x7f1e280b4a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e280892f0 tx=0x7f1e18018000 comp rx=0 tx=0).stop 2024-08-17T02:26:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 shutdown_connections 2024-08-17T02:26:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1e08060860 0x7f1e08062d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e28159340 0x7f1e280b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e280cddc0 0x7f1e280b4a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 --2- 172.21.15.19:0/2249933590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e280cb240 0x7f1e280b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 >> 172.21.15.19:0/2249933590 conn(0x7f1e280994e0 msgr2=0x7f1e28068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 shutdown_connections 2024-08-17T02:26:32.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.611+0000 7f1e2cece700 1 -- 172.21.15.19:0/2249933590 wait complete. 2024-08-17T02:26:32.618 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:26:32.630 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:26:30.761190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2381508,"kb_used_data":2504,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593212,"statfs":{"total":773094113280,"available":770655449088,"internally_reserved":0,"allocated":2564096,"data_stored":1600648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001225"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":159,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:20.430924+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:26:20.430924+0000","last_peered":"2024-08-17T02:26:20.430924+0000","last_clean":"2024-08-17T02:26:20.430924+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:26:20.430924+0000","last_undegraded":"2024-08-17T02:26:20.430924+0000","last_fullsized":"2024-08-17T02:26:20.430924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:28.593827+0000","last_change":"2024-08-17T02:26:28.593827+0000","last_active":"2024-08-17T02:26:28.593827+0000","last_peered":"2024-08-17T02:26:28.593827+0000","last_clean":"2024-08-17T02:26:28.593827+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:28.593827+0000","last_undegraded":"2024-08-17T02:26:28.593827+0000","last_fullsized":"2024-08-17T02:26:28.593827+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:26:27.586174+0000","last_change":"2024-08-17T02:26:27.586174+0000","last_active":"2024-08-17T02:26:27.586174+0000","last_peered":"2024-08-17T02:26:27.586174+0000","last_clean":"2024-08-17T02:26:27.586174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:26:27.586174+0000","last_undegraded":"2024-08-17T02:26:27.586174+0000","last_fullsized":"2024-08-17T02:26:27.586174+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297528,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":172032,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297532,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":172032,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297528,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":172032,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298228,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073612,"statfs":{"total":96636764160,"available":96331378688,"internally_reserved":0,"allocated":765952,"data_stored":642857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297536,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":172032,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297524,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":172032,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297532,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":172032,"data_stored":52489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298100,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073740,"statfs":{"total":96636764160,"available":96331509760,"internally_reserved":0,"allocated":765952,"data_stored":642857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:32.634 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.743+0000 7f114544d700 1 Processor -- start 2024-08-17T02:26:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.743+0000 7f114544d700 1 -- start start 2024-08-17T02:26:32.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1140068ca0 0x7f11400cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400c7750 con 0x7f114006a470 2024-08-17T02:26:32.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400c6e20 con 0x7f11400688d0 2024-08-17T02:26:32.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400cb220 con 0x7f1140068ca0 2024-08-17T02:26:32.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f114006a470 0x7f11400c7be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33868/0 (socket says 172.21.15.19:33868) 2024-08-17T02:26:32.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113f7fe700 1 -- 172.21.15.19:0/3812827161 learned_addr learned my addr 172.21.15.19:0/3812827161 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:32.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113e7fc700 1 --2- 172.21.15.19:0/3812827161 >> v2:172.21.15.119:3300/0 conn(0x7f1140068ca0 0x7f11400cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113dffb700 1 -- 172.21.15.19:0/3812827161 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676241986 0 0) 0x7f11400c7750 con 0x7f114006a470 2024-08-17T02:26:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113dffb700 1 -- 172.21.15.19:0/3812827161 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1128003570 con 0x7f114006a470 2024-08-17T02:26:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113dffb700 1 -- 172.21.15.19:0/3812827161 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897867433 0 0) 0x7f11400c6e20 con 0x7f11400688d0 2024-08-17T02:26:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113dffb700 1 -- 172.21.15.19:0/3812827161 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11400c7750 con 0x7f11400688d0 2024-08-17T02:26:32.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113e7fc700 1 -- 172.21.15.19:0/3812827161 >> v1:172.21.15.119:6789/0 conn(0x7f11400688d0 legacy=0x7f11400caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113e7fc700 1 -- 172.21.15.19:0/3812827161 >> v1:172.21.15.19:6789/0 conn(0x7f114006a470 legacy=0x7f11400c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113dffb700 1 -- 172.21.15.19:0/3812827161 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3030522221 0 0) 0x7f1128003570 con 0x7f114006a470 2024-08-17T02:26:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113e7fc700 1 -- 172.21.15.19:0/3812827161 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400c7100 con 0x7f1140068ca0 2024-08-17T02:26:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113e7fc700 1 --2- 172.21.15.19:0/3812827161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1140068ca0 0x7f11400cc160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f11340098e0 tx=0x7f11340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a8070e4c2e7e929 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113dffb700 1 -- 172.21.15.19:0/3812827161 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380017f0 con 0x7f1140068ca0 2024-08-17T02:26:32.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113dffb700 1 -- 172.21.15.19:0/3812827161 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1134011420 con 0x7f1140068ca0 2024-08-17T02:26:32.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f113dffb700 1 -- 172.21.15.19:0/3812827161 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340117c0 con 0x7f1140068ca0 2024-08-17T02:26:32.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 -- 172.21.15.19:0/3812827161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1140068ca0 msgr2=0x7f11400cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 --2- 172.21.15.19:0/3812827161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1140068ca0 0x7f11400cc160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f11340098e0 tx=0x7f11340091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 -- 172.21.15.19:0/3812827161 shutdown_connections 2024-08-17T02:26:32.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 --2- 172.21.15.19:0/3812827161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1140068ca0 0x7f11400cc160 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 -- 172.21.15.19:0/3812827161 >> 172.21.15.19:0/3812827161 conn(0x7f11400c9c20 msgr2=0x7f114006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 -- 172.21.15.19:0/3812827161 shutdown_connections 2024-08-17T02:26:32.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.747+0000 7f114544d700 1 -- 172.21.15.19:0/3812827161 wait complete. 2024-08-17T02:26:32.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f114544d700 1 Processor -- start 2024-08-17T02:26:32.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f114544d700 1 -- start start 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f114544d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400688d0 0x7f1140156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f114544d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140068ca0 0x7f11400cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f114544d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114006a470 0x7f11400ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f114544d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400aeb00 con 0x7f1140068ca0 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f114544d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140156f30 con 0x7f114006a470 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f114544d700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1140157210 con 0x7f11400688d0 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140068ca0 0x7f11400cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140068ca0 0x7f11400cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58214/0 (socket says 172.21.15.19:58214) 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113e7fc700 1 -- 172.21.15.19:0/2565304221 learned_addr learned my addr 172.21.15.19:0/2565304221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113f7fe700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114006a470 0x7f11400ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113effd700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400688d0 0x7f1140156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113e7fc700 1 -- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400688d0 msgr2=0x7f1140156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113e7fc700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400688d0 0x7f1140156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113e7fc700 1 -- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114006a470 msgr2=0x7f11400ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113e7fc700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114006a470 0x7f11400ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113e7fc700 1 -- 172.21.15.19:0/2565304221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134009420 con 0x7f1140068ca0 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f113e7fc700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140068ca0 0x7f11400cbd70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11400c36a0 tx=0x7f1134016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f1126ffd700 1 -- 172.21.15.19:0/2565304221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113401cb30 con 0x7f1140068ca0 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f1126ffd700 1 -- 172.21.15.19:0/2565304221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113401cc90 con 0x7f1140068ca0 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.751+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11401574f0 con 0x7f1140068ca0 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.755+0000 7f1126ffd700 1 -- 172.21.15.19:0/2565304221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113401a6a0 con 0x7f1140068ca0 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.755+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11400ab820 con 0x7f1140068ca0 2024-08-17T02:26:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.755+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11401675d0 con 0x7f1140068ca0 2024-08-17T02:26:32.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.755+0000 7f1126ffd700 1 -- 172.21.15.19:0/2565304221 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f113401aa90 con 0x7f1140068ca0 2024-08-17T02:26:32.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.755+0000 7f1126ffd700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f112c060860 0x7f112c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.755+0000 7f1126ffd700 1 -- 172.21.15.19:0/2565304221 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f113407e160 con 0x7f1140068ca0 2024-08-17T02:26:32.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.755+0000 7f113effd700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f112c060860 0x7f112c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.759+0000 7f113effd700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f112c060860 0x7f112c062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1130007fd0 tx=0x7f1130007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.763+0000 7f1126ffd700 1 -- 172.21.15.19:0/2565304221 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f113404e5b0 con 0x7f1140068ca0 2024-08-17T02:26:32.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.927+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11400645c0 con 0x7f112c060860 2024-08-17T02:26:32.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.947+0000 7f1126ffd700 1 -- 172.21.15.19:0/2565304221 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264539 (secure 0 0 0) 0x7f11400645c0 con 0x7f112c060860 2024-08-17T02:26:32.954 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f112c060860 msgr2=0x7f112c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f112c060860 0x7f112c062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1130007fd0 tx=0x7f1130007d50 comp rx=0 tx=0).stop 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140068ca0 msgr2=0x7f11400cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140068ca0 0x7f11400cbd70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11400c36a0 tx=0x7f1134016000 comp rx=0 tx=0).stop 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 shutdown_connections 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f112c060860 0x7f112c062d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f114006a470 0x7f11400ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140068ca0 0x7f11400cbd70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 --2- 172.21.15.19:0/2565304221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400688d0 0x7f1140156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 >> 172.21.15.19:0/2565304221 conn(0x7f11400c9c20 msgr2=0x7f11400b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 shutdown_connections 2024-08-17T02:26:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:32.951+0000 7f114544d700 1 -- 172.21.15.19:0/2565304221 wait complete. 2024-08-17T02:26:32.958 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:26:32.970 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:26:32.761743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381736,"kb_used_data":2868,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592984,"statfs":{"total":773094113280,"available":770655215616,"internally_reserved":0,"allocated":2936832,"data_stored":1762260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.165378"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640917+0000","last_change":"2024-08-17T02:26:29.640917+0000","last_active":"2024-08-17T02:26:29.640917+0000","last_peered":"2024-08-17T02:26:29.640917+0000","last_clean":"2024-08-17T02:26:29.640917+0000","last_became_active":"2024-08-17T02:26:29.640351+0000","last_became_peered":"2024-08-17T02:26:29.640351+0000","last_unstale":"2024-08-17T02:26:29.640917+0000","last_undegraded":"2024-08-17T02:26:29.640917+0000","last_fullsized":"2024-08-17T02:26:29.640917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:05.168789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640537+0000","last_change":"2024-08-17T02:26:29.631753+0000","last_active":"2024-08-17T02:26:29.640537+0000","last_peered":"2024-08-17T02:26:29.640537+0000","last_clean":"2024-08-17T02:26:29.640537+0000","last_became_active":"2024-08-17T02:26:29.631252+0000","last_became_peered":"2024-08-17T02:26:29.631252+0000","last_unstale":"2024-08-17T02:26:29.640537+0000","last_undegraded":"2024-08-17T02:26:29.640537+0000","last_fullsized":"2024-08-17T02:26:29.640537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:32.790776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.627763+0000","last_change":"2024-08-17T02:26:29.627763+0000","last_active":"2024-08-17T02:26:29.627763+0000","last_peered":"2024-08-17T02:26:29.627763+0000","last_clean":"2024-08-17T02:26:29.627763+0000","last_became_active":"2024-08-17T02:26:29.627138+0000","last_became_peered":"2024-08-17T02:26:29.627138+0000","last_unstale":"2024-08-17T02:26:29.627763+0000","last_undegraded":"2024-08-17T02:26:29.627763+0000","last_fullsized":"2024-08-17T02:26:29.627763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:17.721814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646429+0000","last_change":"2024-08-17T02:26:29.641271+0000","last_active":"2024-08-17T02:26:29.646429+0000","last_peered":"2024-08-17T02:26:29.646429+0000","last_clean":"2024-08-17T02:26:29.646429+0000","last_became_active":"2024-08-17T02:26:29.640880+0000","last_became_peered":"2024-08-17T02:26:29.640880+0000","last_unstale":"2024-08-17T02:26:29.646429+0000","last_undegraded":"2024-08-17T02:26:29.646429+0000","last_fullsized":"2024-08-17T02:26:29.646429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:14.890075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640518+0000","last_change":"2024-08-17T02:26:29.640518+0000","last_active":"2024-08-17T02:26:29.640518+0000","last_peered":"2024-08-17T02:26:29.640518+0000","last_clean":"2024-08-17T02:26:29.640518+0000","last_became_active":"2024-08-17T02:26:29.640227+0000","last_became_peered":"2024-08-17T02:26:29.640227+0000","last_unstale":"2024-08-17T02:26:29.640518+0000","last_undegraded":"2024-08-17T02:26:29.640518+0000","last_fullsized":"2024-08-17T02:26:29.640518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:00.664060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643595+0000","last_change":"2024-08-17T02:26:29.635633+0000","last_active":"2024-08-17T02:26:29.643595+0000","last_peered":"2024-08-17T02:26:29.643595+0000","last_clean":"2024-08-17T02:26:29.643595+0000","last_became_active":"2024-08-17T02:26:29.635105+0000","last_became_peered":"2024-08-17T02:26:29.635105+0000","last_unstale":"2024-08-17T02:26:29.643595+0000","last_undegraded":"2024-08-17T02:26:29.643595+0000","last_fullsized":"2024-08-17T02:26:29.643595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637618+0000","last_change":"2024-08-17T02:26:29.637618+0000","last_active":"2024-08-17T02:26:29.637618+0000","last_peered":"2024-08-17T02:26:29.637618+0000","last_clean":"2024-08-17T02:26:29.637618+0000","last_became_active":"2024-08-17T02:26:29.637303+0000","last_became_peered":"2024-08-17T02:26:29.637303+0000","last_unstale":"2024-08-17T02:26:29.637618+0000","last_undegraded":"2024-08-17T02:26:29.637618+0000","last_fullsized":"2024-08-17T02:26:29.637618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:52.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638340+0000","last_change":"2024-08-17T02:26:29.633298+0000","last_active":"2024-08-17T02:26:29.638340+0000","last_peered":"2024-08-17T02:26:29.638340+0000","last_clean":"2024-08-17T02:26:29.638340+0000","last_became_active":"2024-08-17T02:26:29.632930+0000","last_became_peered":"2024-08-17T02:26:29.632930+0000","last_unstale":"2024-08-17T02:26:29.638340+0000","last_undegraded":"2024-08-17T02:26:29.638340+0000","last_fullsized":"2024-08-17T02:26:29.638340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:57:32.160542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641107+0000","last_change":"2024-08-17T02:26:29.641107+0000","last_active":"2024-08-17T02:26:29.641107+0000","last_peered":"2024-08-17T02:26:29.641107+0000","last_clean":"2024-08-17T02:26:29.641107+0000","last_became_active":"2024-08-17T02:26:29.640661+0000","last_became_peered":"2024-08-17T02:26:29.640661+0000","last_unstale":"2024-08-17T02:26:29.641107+0000","last_undegraded":"2024-08-17T02:26:29.641107+0000","last_fullsized":"2024-08-17T02:26:29.641107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:15:26.950752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638311+0000","last_change":"2024-08-17T02:26:29.638311+0000","last_active":"2024-08-17T02:26:29.638311+0000","last_peered":"2024-08-17T02:26:29.638311+0000","last_clean":"2024-08-17T02:26:29.638311+0000","last_became_active":"2024-08-17T02:26:29.637822+0000","last_became_peered":"2024-08-17T02:26:29.637822+0000","last_unstale":"2024-08-17T02:26:29.638311+0000","last_undegraded":"2024-08-17T02:26:29.638311+0000","last_fullsized":"2024-08-17T02:26:29.638311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:32.532465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637841+0000","last_change":"2024-08-17T02:26:29.637841+0000","last_active":"2024-08-17T02:26:29.637841+0000","last_peered":"2024-08-17T02:26:29.637841+0000","last_clean":"2024-08-17T02:26:29.637841+0000","last_became_active":"2024-08-17T02:26:29.637507+0000","last_became_peered":"2024-08-17T02:26:29.637507+0000","last_unstale":"2024-08-17T02:26:29.637841+0000","last_undegraded":"2024-08-17T02:26:29.637841+0000","last_fullsized":"2024-08-17T02:26:29.637841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:21.305240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641630+0000","last_change":"2024-08-17T02:26:29.636441+0000","last_active":"2024-08-17T02:26:29.641630+0000","last_peered":"2024-08-17T02:26:29.641630+0000","last_clean":"2024-08-17T02:26:29.641630+0000","last_became_active":"2024-08-17T02:26:29.636162+0000","last_became_peered":"2024-08-17T02:26:29.636162+0000","last_unstale":"2024-08-17T02:26:29.641630+0000","last_undegraded":"2024-08-17T02:26:29.641630+0000","last_fullsized":"2024-08-17T02:26:29.641630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:28.026775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638420+0000","last_change":"2024-08-17T02:26:29.633625+0000","last_active":"2024-08-17T02:26:29.638420+0000","last_peered":"2024-08-17T02:26:29.638420+0000","last_clean":"2024-08-17T02:26:29.638420+0000","last_became_active":"2024-08-17T02:26:29.633239+0000","last_became_peered":"2024-08-17T02:26:29.633239+0000","last_unstale":"2024-08-17T02:26:29.638420+0000","last_undegraded":"2024-08-17T02:26:29.638420+0000","last_fullsized":"2024-08-17T02:26:29.638420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.728445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638395+0000","last_change":"2024-08-17T02:26:29.638395+0000","last_active":"2024-08-17T02:26:29.638395+0000","last_peered":"2024-08-17T02:26:29.638395+0000","last_clean":"2024-08-17T02:26:29.638395+0000","last_became_active":"2024-08-17T02:26:29.638112+0000","last_became_peered":"2024-08-17T02:26:29.638112+0000","last_unstale":"2024-08-17T02:26:29.638395+0000","last_undegraded":"2024-08-17T02:26:29.638395+0000","last_fullsized":"2024-08-17T02:26:29.638395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:34.532005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637720+0000","last_change":"2024-08-17T02:26:29.627828+0000","last_active":"2024-08-17T02:26:29.637720+0000","last_peered":"2024-08-17T02:26:29.637720+0000","last_clean":"2024-08-17T02:26:29.637720+0000","last_became_active":"2024-08-17T02:26:29.627530+0000","last_became_peered":"2024-08-17T02:26:29.627530+0000","last_unstale":"2024-08-17T02:26:29.637720+0000","last_undegraded":"2024-08-17T02:26:29.637720+0000","last_fullsized":"2024-08-17T02:26:29.637720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:18.366384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634326+0000","last_change":"2024-08-17T02:26:29.628945+0000","last_active":"2024-08-17T02:26:29.634326+0000","last_peered":"2024-08-17T02:26:29.634326+0000","last_clean":"2024-08-17T02:26:29.634326+0000","last_became_active":"2024-08-17T02:26:29.628590+0000","last_became_peered":"2024-08-17T02:26:29.628590+0000","last_unstale":"2024-08-17T02:26:29.634326+0000","last_undegraded":"2024-08-17T02:26:29.634326+0000","last_fullsized":"2024-08-17T02:26:29.634326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:17.721814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634543+0000","last_change":"2024-08-17T02:26:29.629331+0000","last_active":"2024-08-17T02:26:29.634543+0000","last_peered":"2024-08-17T02:26:29.634543+0000","last_clean":"2024-08-17T02:26:29.634543+0000","last_became_active":"2024-08-17T02:26:29.629022+0000","last_became_peered":"2024-08-17T02:26:29.629022+0000","last_unstale":"2024-08-17T02:26:29.634543+0000","last_undegraded":"2024-08-17T02:26:29.634543+0000","last_fullsized":"2024-08-17T02:26:29.634543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:15:26.950752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.633865+0000","last_change":"2024-08-17T02:26:29.633865+0000","last_active":"2024-08-17T02:26:29.633865+0000","last_peered":"2024-08-17T02:26:29.633865+0000","last_clean":"2024-08-17T02:26:29.633865+0000","last_became_active":"2024-08-17T02:26:29.633518+0000","last_became_peered":"2024-08-17T02:26:29.633518+0000","last_unstale":"2024-08-17T02:26:29.633865+0000","last_undegraded":"2024-08-17T02:26:29.633865+0000","last_fullsized":"2024-08-17T02:26:29.633865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:35.893643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638651+0000","last_change":"2024-08-17T02:26:29.638651+0000","last_active":"2024-08-17T02:26:29.638651+0000","last_peered":"2024-08-17T02:26:29.638651+0000","last_clean":"2024-08-17T02:26:29.638651+0000","last_became_active":"2024-08-17T02:26:29.638400+0000","last_became_peered":"2024-08-17T02:26:29.638400+0000","last_unstale":"2024-08-17T02:26:29.638651+0000","last_undegraded":"2024-08-17T02:26:29.638651+0000","last_fullsized":"2024-08-17T02:26:29.638651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:59.413875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.644401+0000","last_change":"2024-08-17T02:26:29.644401+0000","last_active":"2024-08-17T02:26:29.644401+0000","last_peered":"2024-08-17T02:26:29.644401+0000","last_clean":"2024-08-17T02:26:29.644401+0000","last_became_active":"2024-08-17T02:26:29.644100+0000","last_became_peered":"2024-08-17T02:26:29.644100+0000","last_unstale":"2024-08-17T02:26:29.644401+0000","last_undegraded":"2024-08-17T02:26:29.644401+0000","last_fullsized":"2024-08-17T02:26:29.644401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:20.713454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.632167+0000","last_change":"2024-08-17T02:26:29.632167+0000","last_active":"2024-08-17T02:26:29.632167+0000","last_peered":"2024-08-17T02:26:29.632167+0000","last_clean":"2024-08-17T02:26:29.632167+0000","last_became_active":"2024-08-17T02:26:29.631704+0000","last_became_peered":"2024-08-17T02:26:29.631704+0000","last_unstale":"2024-08-17T02:26:29.632167+0000","last_undegraded":"2024-08-17T02:26:29.632167+0000","last_fullsized":"2024-08-17T02:26:29.632167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:32.532465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.639628+0000","last_change":"2024-08-17T02:26:29.632372+0000","last_active":"2024-08-17T02:26:29.639628+0000","last_peered":"2024-08-17T02:26:29.639628+0000","last_clean":"2024-08-17T02:26:29.639628+0000","last_became_active":"2024-08-17T02:26:29.632061+0000","last_became_peered":"2024-08-17T02:26:29.632061+0000","last_unstale":"2024-08-17T02:26:29.639628+0000","last_undegraded":"2024-08-17T02:26:29.639628+0000","last_fullsized":"2024-08-17T02:26:29.639628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:59.413875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643634+0000","last_change":"2024-08-17T02:26:29.640414+0000","last_active":"2024-08-17T02:26:29.643634+0000","last_peered":"2024-08-17T02:26:29.643634+0000","last_clean":"2024-08-17T02:26:29.643634+0000","last_became_active":"2024-08-17T02:26:29.640062+0000","last_became_peered":"2024-08-17T02:26:29.640062+0000","last_unstale":"2024-08-17T02:26:29.643634+0000","last_undegraded":"2024-08-17T02:26:29.643634+0000","last_fullsized":"2024-08-17T02:26:29.643634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:18.366384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645047+0000","last_change":"2024-08-17T02:26:29.640158+0000","last_active":"2024-08-17T02:26:29.645047+0000","last_peered":"2024-08-17T02:26:29.645047+0000","last_clean":"2024-08-17T02:26:29.645047+0000","last_became_active":"2024-08-17T02:26:29.639901+0000","last_became_peered":"2024-08-17T02:26:29.639901+0000","last_unstale":"2024-08-17T02:26:29.645047+0000","last_undegraded":"2024-08-17T02:26:29.645047+0000","last_fullsized":"2024-08-17T02:26:29.645047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:25.035787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643592+0000","last_change":"2024-08-17T02:26:29.640300+0000","last_active":"2024-08-17T02:26:29.643592+0000","last_peered":"2024-08-17T02:26:29.643592+0000","last_clean":"2024-08-17T02:26:29.643592+0000","last_became_active":"2024-08-17T02:26:29.639925+0000","last_became_peered":"2024-08-17T02:26:29.639925+0000","last_unstale":"2024-08-17T02:26:29.643592+0000","last_undegraded":"2024-08-17T02:26:29.643592+0000","last_fullsized":"2024-08-17T02:26:29.643592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:12.800333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.632577+0000","last_change":"2024-08-17T02:26:29.632577+0000","last_active":"2024-08-17T02:26:29.632577+0000","last_peered":"2024-08-17T02:26:29.632577+0000","last_clean":"2024-08-17T02:26:29.632577+0000","last_became_active":"2024-08-17T02:26:29.632068+0000","last_became_peered":"2024-08-17T02:26:29.632068+0000","last_unstale":"2024-08-17T02:26:29.632577+0000","last_undegraded":"2024-08-17T02:26:29.632577+0000","last_fullsized":"2024-08-17T02:26:29.632577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:25.035787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640531+0000","last_change":"2024-08-17T02:26:29.635740+0000","last_active":"2024-08-17T02:26:29.640531+0000","last_peered":"2024-08-17T02:26:29.640531+0000","last_clean":"2024-08-17T02:26:29.640531+0000","last_became_active":"2024-08-17T02:26:29.635378+0000","last_became_peered":"2024-08-17T02:26:29.635378+0000","last_unstale":"2024-08-17T02:26:29.640531+0000","last_undegraded":"2024-08-17T02:26:29.640531+0000","last_fullsized":"2024-08-17T02:26:29.640531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:46.990052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643621+0000","last_change":"2024-08-17T02:26:29.640361+0000","last_active":"2024-08-17T02:26:29.643621+0000","last_peered":"2024-08-17T02:26:29.643621+0000","last_clean":"2024-08-17T02:26:29.643621+0000","last_became_active":"2024-08-17T02:26:29.639981+0000","last_became_peered":"2024-08-17T02:26:29.639981+0000","last_unstale":"2024-08-17T02:26:29.643621+0000","last_undegraded":"2024-08-17T02:26:29.643621+0000","last_fullsized":"2024-08-17T02:26:29.643621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:16.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637240+0000","last_change":"2024-08-17T02:26:29.637240+0000","last_active":"2024-08-17T02:26:29.637240+0000","last_peered":"2024-08-17T02:26:29.637240+0000","last_clean":"2024-08-17T02:26:29.637240+0000","last_became_active":"2024-08-17T02:26:29.636928+0000","last_became_peered":"2024-08-17T02:26:29.636928+0000","last_unstale":"2024-08-17T02:26:29.637240+0000","last_undegraded":"2024-08-17T02:26:29.637240+0000","last_fullsized":"2024-08-17T02:26:29.637240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:20.713454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646410+0000","last_change":"2024-08-17T02:26:29.643173+0000","last_active":"2024-08-17T02:26:29.646410+0000","last_peered":"2024-08-17T02:26:29.646410+0000","last_clean":"2024-08-17T02:26:29.646410+0000","last_became_active":"2024-08-17T02:26:29.642920+0000","last_became_peered":"2024-08-17T02:26:29.642920+0000","last_unstale":"2024-08-17T02:26:29.646410+0000","last_undegraded":"2024-08-17T02:26:29.646410+0000","last_fullsized":"2024-08-17T02:26:29.646410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:05.168789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.633051+0000","last_change":"2024-08-17T02:26:29.633051+0000","last_active":"2024-08-17T02:26:29.633051+0000","last_peered":"2024-08-17T02:26:29.633051+0000","last_clean":"2024-08-17T02:26:29.633051+0000","last_became_active":"2024-08-17T02:26:29.632692+0000","last_became_peered":"2024-08-17T02:26:29.632692+0000","last_unstale":"2024-08-17T02:26:29.633051+0000","last_undegraded":"2024-08-17T02:26:29.633051+0000","last_fullsized":"2024-08-17T02:26:29.633051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:37.287663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637059+0000","last_change":"2024-08-17T02:26:29.637059+0000","last_active":"2024-08-17T02:26:29.637059+0000","last_peered":"2024-08-17T02:26:29.637059+0000","last_clean":"2024-08-17T02:26:29.637059+0000","last_became_active":"2024-08-17T02:26:29.634568+0000","last_became_peered":"2024-08-17T02:26:29.634568+0000","last_unstale":"2024-08-17T02:26:29.637059+0000","last_undegraded":"2024-08-17T02:26:29.637059+0000","last_fullsized":"2024-08-17T02:26:29.637059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:15.601838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641098+0000","last_change":"2024-08-17T02:26:29.630504+0000","last_active":"2024-08-17T02:26:29.641098+0000","last_peered":"2024-08-17T02:26:29.641098+0000","last_clean":"2024-08-17T02:26:29.641098+0000","last_became_active":"2024-08-17T02:26:29.629516+0000","last_became_peered":"2024-08-17T02:26:29.629516+0000","last_unstale":"2024-08-17T02:26:29.641098+0000","last_undegraded":"2024-08-17T02:26:29.641098+0000","last_fullsized":"2024-08-17T02:26:29.641098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:42.357817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655894+0000","last_change":"2024-08-17T02:26:28.628658+0000","last_active":"2024-08-17T02:26:29.655894+0000","last_peered":"2024-08-17T02:26:29.655894+0000","last_clean":"2024-08-17T02:26:29.655894+0000","last_became_active":"2024-08-17T02:26:28.628341+0000","last_became_peered":"2024-08-17T02:26:28.628341+0000","last_unstale":"2024-08-17T02:26:29.655894+0000","last_undegraded":"2024-08-17T02:26:29.655894+0000","last_fullsized":"2024-08-17T02:26:29.655894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:42.099769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.630922+0000","last_change":"2024-08-17T02:26:29.630922+0000","last_active":"2024-08-17T02:26:29.630922+0000","last_peered":"2024-08-17T02:26:29.630922+0000","last_clean":"2024-08-17T02:26:29.630922+0000","last_became_active":"2024-08-17T02:26:29.629133+0000","last_became_peered":"2024-08-17T02:26:29.629133+0000","last_unstale":"2024-08-17T02:26:29.630922+0000","last_undegraded":"2024-08-17T02:26:29.630922+0000","last_fullsized":"2024-08-17T02:26:29.630922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:59.413875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.626331+0000","last_change":"2024-08-17T02:26:28.636370+0000","last_active":"2024-08-17T02:26:29.626331+0000","last_peered":"2024-08-17T02:26:29.626331+0000","last_clean":"2024-08-17T02:26:29.626331+0000","last_became_active":"2024-08-17T02:26:28.636030+0000","last_became_peered":"2024-08-17T02:26:28.636030+0000","last_unstale":"2024-08-17T02:26:29.626331+0000","last_undegraded":"2024-08-17T02:26:29.626331+0000","last_fullsized":"2024-08-17T02:26:29.626331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:54.570440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.620818+0000","last_change":"2024-08-17T02:26:28.628598+0000","last_active":"2024-08-17T02:26:29.620818+0000","last_peered":"2024-08-17T02:26:29.620818+0000","last_clean":"2024-08-17T02:26:29.620818+0000","last_became_active":"2024-08-17T02:26:28.627246+0000","last_became_peered":"2024-08-17T02:26:28.627246+0000","last_unstale":"2024-08-17T02:26:29.620818+0000","last_undegraded":"2024-08-17T02:26:29.620818+0000","last_fullsized":"2024-08-17T02:26:29.620818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:39.569935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642967+0000","last_change":"2024-08-17T02:26:29.635943+0000","last_active":"2024-08-17T02:26:29.642967+0000","last_peered":"2024-08-17T02:26:29.642967+0000","last_clean":"2024-08-17T02:26:29.642967+0000","last_became_active":"2024-08-17T02:26:29.634674+0000","last_became_peered":"2024-08-17T02:26:29.634674+0000","last_unstale":"2024-08-17T02:26:29.642967+0000","last_undegraded":"2024-08-17T02:26:29.642967+0000","last_fullsized":"2024-08-17T02:26:29.642967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:46.990052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.621239+0000","last_change":"2024-08-17T02:26:28.627084+0000","last_active":"2024-08-17T02:26:29.621239+0000","last_peered":"2024-08-17T02:26:29.621239+0000","last_clean":"2024-08-17T02:26:29.621239+0000","last_became_active":"2024-08-17T02:26:28.626802+0000","last_became_peered":"2024-08-17T02:26:28.626802+0000","last_unstale":"2024-08-17T02:26:29.621239+0000","last_undegraded":"2024-08-17T02:26:29.621239+0000","last_fullsized":"2024-08-17T02:26:29.621239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:21.706815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637701+0000","last_change":"2024-08-17T02:26:29.626103+0000","last_active":"2024-08-17T02:26:29.637701+0000","last_peered":"2024-08-17T02:26:29.637701+0000","last_clean":"2024-08-17T02:26:29.637701+0000","last_became_active":"2024-08-17T02:26:29.625737+0000","last_became_peered":"2024-08-17T02:26:29.625737+0000","last_unstale":"2024-08-17T02:26:29.637701+0000","last_undegraded":"2024-08-17T02:26:29.637701+0000","last_fullsized":"2024-08-17T02:26:29.637701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:57:32.160542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:28.633404+0000","last_change":"2024-08-17T02:26:28.628951+0000","last_active":"2024-08-17T02:26:28.633404+0000","last_peered":"2024-08-17T02:26:28.633404+0000","last_clean":"2024-08-17T02:26:28.633404+0000","last_became_active":"2024-08-17T02:26:28.628628+0000","last_became_peered":"2024-08-17T02:26:28.628628+0000","last_unstale":"2024-08-17T02:26:28.633404+0000","last_undegraded":"2024-08-17T02:26:28.633404+0000","last_fullsized":"2024-08-17T02:26:28.633404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:52.647000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643759+0000","last_change":"2024-08-17T02:26:29.635675+0000","last_active":"2024-08-17T02:26:29.643759+0000","last_peered":"2024-08-17T02:26:29.643759+0000","last_clean":"2024-08-17T02:26:29.643759+0000","last_became_active":"2024-08-17T02:26:29.635384+0000","last_became_peered":"2024-08-17T02:26:29.635384+0000","last_unstale":"2024-08-17T02:26:29.643759+0000","last_undegraded":"2024-08-17T02:26:29.643759+0000","last_fullsized":"2024-08-17T02:26:29.643759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:32.532465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.622717+0000","last_change":"2024-08-17T02:26:28.629856+0000","last_active":"2024-08-17T02:26:29.622717+0000","last_peered":"2024-08-17T02:26:29.622717+0000","last_clean":"2024-08-17T02:26:29.622717+0000","last_became_active":"2024-08-17T02:26:28.629588+0000","last_became_peered":"2024-08-17T02:26:28.629588+0000","last_unstale":"2024-08-17T02:26:29.622717+0000","last_undegraded":"2024-08-17T02:26:29.622717+0000","last_fullsized":"2024-08-17T02:26:29.622717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:44.839971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634638+0000","last_change":"2024-08-17T02:26:29.634638+0000","last_active":"2024-08-17T02:26:29.634638+0000","last_peered":"2024-08-17T02:26:29.634638+0000","last_clean":"2024-08-17T02:26:29.634638+0000","last_became_active":"2024-08-17T02:26:29.634363+0000","last_became_peered":"2024-08-17T02:26:29.634363+0000","last_unstale":"2024-08-17T02:26:29.634638+0000","last_undegraded":"2024-08-17T02:26:29.634638+0000","last_fullsized":"2024-08-17T02:26:29.634638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:22.120795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655581+0000","last_change":"2024-08-17T02:26:28.628000+0000","last_active":"2024-08-17T02:26:29.655581+0000","last_peered":"2024-08-17T02:26:29.655581+0000","last_clean":"2024-08-17T02:26:29.655581+0000","last_became_active":"2024-08-17T02:26:28.627694+0000","last_became_peered":"2024-08-17T02:26:28.627694+0000","last_unstale":"2024-08-17T02:26:29.655581+0000","last_undegraded":"2024-08-17T02:26:29.655581+0000","last_fullsized":"2024-08-17T02:26:29.655581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:07.911227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641612+0000","last_change":"2024-08-17T02:26:29.630265+0000","last_active":"2024-08-17T02:26:29.641612+0000","last_peered":"2024-08-17T02:26:29.641612+0000","last_clean":"2024-08-17T02:26:29.641612+0000","last_became_active":"2024-08-17T02:26:29.629158+0000","last_became_peered":"2024-08-17T02:26:29.629158+0000","last_unstale":"2024-08-17T02:26:29.641612+0000","last_undegraded":"2024-08-17T02:26:29.641612+0000","last_fullsized":"2024-08-17T02:26:29.641612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:34.066122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.657488+0000","last_change":"2024-08-17T02:26:28.631995+0000","last_active":"2024-08-17T02:26:29.657488+0000","last_peered":"2024-08-17T02:26:29.657488+0000","last_clean":"2024-08-17T02:26:29.657488+0000","last_became_active":"2024-08-17T02:26:28.631346+0000","last_became_peered":"2024-08-17T02:26:28.631346+0000","last_unstale":"2024-08-17T02:26:29.657488+0000","last_undegraded":"2024-08-17T02:26:29.657488+0000","last_fullsized":"2024-08-17T02:26:29.657488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:31.850537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642029+0000","last_change":"2024-08-17T02:26:29.642029+0000","last_active":"2024-08-17T02:26:29.642029+0000","last_peered":"2024-08-17T02:26:29.642029+0000","last_clean":"2024-08-17T02:26:29.642029+0000","last_became_active":"2024-08-17T02:26:29.641516+0000","last_became_peered":"2024-08-17T02:26:29.641516+0000","last_unstale":"2024-08-17T02:26:29.642029+0000","last_undegraded":"2024-08-17T02:26:29.642029+0000","last_fullsized":"2024-08-17T02:26:29.642029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:13.166542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.652847+0000","last_change":"2024-08-17T02:26:28.634455+0000","last_active":"2024-08-17T02:26:29.652847+0000","last_peered":"2024-08-17T02:26:29.652847+0000","last_clean":"2024-08-17T02:26:29.652847+0000","last_became_active":"2024-08-17T02:26:28.633926+0000","last_became_peered":"2024-08-17T02:26:28.633926+0000","last_unstale":"2024-08-17T02:26:29.652847+0000","last_undegraded":"2024-08-17T02:26:29.652847+0000","last_fullsized":"2024-08-17T02:26:29.652847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:12.949717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.631726+0000","last_change":"2024-08-17T02:26:29.631726+0000","last_active":"2024-08-17T02:26:29.631726+0000","last_peered":"2024-08-17T02:26:29.631726+0000","last_clean":"2024-08-17T02:26:29.631726+0000","last_became_active":"2024-08-17T02:26:29.631369+0000","last_became_peered":"2024-08-17T02:26:29.631369+0000","last_unstale":"2024-08-17T02:26:29.631726+0000","last_undegraded":"2024-08-17T02:26:29.631726+0000","last_fullsized":"2024-08-17T02:26:29.631726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:58.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.622746+0000","last_change":"2024-08-17T02:26:28.629917+0000","last_active":"2024-08-17T02:26:29.622746+0000","last_peered":"2024-08-17T02:26:29.622746+0000","last_clean":"2024-08-17T02:26:29.622746+0000","last_became_active":"2024-08-17T02:26:28.629619+0000","last_became_peered":"2024-08-17T02:26:28.629619+0000","last_unstale":"2024-08-17T02:26:29.622746+0000","last_undegraded":"2024-08-17T02:26:29.622746+0000","last_fullsized":"2024-08-17T02:26:29.622746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:54.570440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642329+0000","last_change":"2024-08-17T02:26:29.642329+0000","last_active":"2024-08-17T02:26:29.642329+0000","last_peered":"2024-08-17T02:26:29.642329+0000","last_clean":"2024-08-17T02:26:29.642329+0000","last_became_active":"2024-08-17T02:26:29.642040+0000","last_became_peered":"2024-08-17T02:26:29.642040+0000","last_unstale":"2024-08-17T02:26:29.642329+0000","last_undegraded":"2024-08-17T02:26:29.642329+0000","last_fullsized":"2024-08-17T02:26:29.642329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:09.010696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:28.639142+0000","last_change":"2024-08-17T02:26:28.636363+0000","last_active":"2024-08-17T02:26:28.639142+0000","last_peered":"2024-08-17T02:26:28.639142+0000","last_clean":"2024-08-17T02:26:28.639142+0000","last_became_active":"2024-08-17T02:26:28.636034+0000","last_became_peered":"2024-08-17T02:26:28.636034+0000","last_unstale":"2024-08-17T02:26:28.639142+0000","last_undegraded":"2024-08-17T02:26:28.639142+0000","last_fullsized":"2024-08-17T02:26:28.639142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:29.548053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637246+0000","last_change":"2024-08-17T02:26:29.637246+0000","last_active":"2024-08-17T02:26:29.637246+0000","last_peered":"2024-08-17T02:26:29.637246+0000","last_clean":"2024-08-17T02:26:29.637246+0000","last_became_active":"2024-08-17T02:26:29.636968+0000","last_became_peered":"2024-08-17T02:26:29.636968+0000","last_unstale":"2024-08-17T02:26:29.637246+0000","last_undegraded":"2024-08-17T02:26:29.637246+0000","last_fullsized":"2024-08-17T02:26:29.637246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:22.120795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.658480+0000","last_change":"2024-08-17T02:26:28.629052+0000","last_active":"2024-08-17T02:26:29.658480+0000","last_peered":"2024-08-17T02:26:29.658480+0000","last_clean":"2024-08-17T02:26:29.658480+0000","last_became_active":"2024-08-17T02:26:28.628701+0000","last_became_peered":"2024-08-17T02:26:28.628701+0000","last_unstale":"2024-08-17T02:26:29.658480+0000","last_undegraded":"2024-08-17T02:26:29.658480+0000","last_fullsized":"2024-08-17T02:26:29.658480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:32.650882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642870+0000","last_change":"2024-08-17T02:26:29.642870+0000","last_active":"2024-08-17T02:26:29.642870+0000","last_peered":"2024-08-17T02:26:29.642870+0000","last_clean":"2024-08-17T02:26:29.642870+0000","last_became_active":"2024-08-17T02:26:29.642588+0000","last_became_peered":"2024-08-17T02:26:29.642588+0000","last_unstale":"2024-08-17T02:26:29.642870+0000","last_undegraded":"2024-08-17T02:26:29.642870+0000","last_fullsized":"2024-08-17T02:26:29.642870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:08.902200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.654223+0000","last_change":"2024-08-17T02:26:28.634171+0000","last_active":"2024-08-17T02:26:29.654223+0000","last_peered":"2024-08-17T02:26:29.654223+0000","last_clean":"2024-08-17T02:26:29.654223+0000","last_became_active":"2024-08-17T02:26:28.633826+0000","last_became_peered":"2024-08-17T02:26:28.633826+0000","last_unstale":"2024-08-17T02:26:29.654223+0000","last_undegraded":"2024-08-17T02:26:29.654223+0000","last_fullsized":"2024-08-17T02:26:29.654223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:35.824314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643502+0000","last_change":"2024-08-17T02:26:29.643502+0000","last_active":"2024-08-17T02:26:29.643502+0000","last_peered":"2024-08-17T02:26:29.643502+0000","last_clean":"2024-08-17T02:26:29.643502+0000","last_became_active":"2024-08-17T02:26:29.641864+0000","last_became_peered":"2024-08-17T02:26:29.641864+0000","last_unstale":"2024-08-17T02:26:29.643502+0000","last_undegraded":"2024-08-17T02:26:29.643502+0000","last_fullsized":"2024-08-17T02:26:29.643502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:14.890075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655227+0000","last_change":"2024-08-17T02:26:28.630436+0000","last_active":"2024-08-17T02:26:29.655227+0000","last_peered":"2024-08-17T02:26:29.655227+0000","last_clean":"2024-08-17T02:26:29.655227+0000","last_became_active":"2024-08-17T02:26:28.630171+0000","last_became_peered":"2024-08-17T02:26:28.630171+0000","last_unstale":"2024-08-17T02:26:29.655227+0000","last_undegraded":"2024-08-17T02:26:29.655227+0000","last_fullsized":"2024-08-17T02:26:29.655227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:26:55.149220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643306+0000","last_change":"2024-08-17T02:26:29.643306+0000","last_active":"2024-08-17T02:26:29.643306+0000","last_peered":"2024-08-17T02:26:29.643306+0000","last_clean":"2024-08-17T02:26:29.643306+0000","last_became_active":"2024-08-17T02:26:29.642913+0000","last_became_peered":"2024-08-17T02:26:29.642913+0000","last_unstale":"2024-08-17T02:26:29.643306+0000","last_undegraded":"2024-08-17T02:26:29.643306+0000","last_fullsized":"2024-08-17T02:26:29.643306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:33:07.414644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655429+0000","last_change":"2024-08-17T02:26:28.634383+0000","last_active":"2024-08-17T02:26:29.655429+0000","last_peered":"2024-08-17T02:26:29.655429+0000","last_clean":"2024-08-17T02:26:29.655429+0000","last_became_active":"2024-08-17T02:26:28.634016+0000","last_became_peered":"2024-08-17T02:26:28.634016+0000","last_unstale":"2024-08-17T02:26:29.655429+0000","last_undegraded":"2024-08-17T02:26:29.655429+0000","last_fullsized":"2024-08-17T02:26:29.655429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:43.175503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646736+0000","last_change":"2024-08-17T02:26:29.644720+0000","last_active":"2024-08-17T02:26:29.646736+0000","last_peered":"2024-08-17T02:26:29.646736+0000","last_clean":"2024-08-17T02:26:29.646736+0000","last_became_active":"2024-08-17T02:26:29.644375+0000","last_became_peered":"2024-08-17T02:26:29.644375+0000","last_unstale":"2024-08-17T02:26:29.646736+0000","last_undegraded":"2024-08-17T02:26:29.646736+0000","last_fullsized":"2024-08-17T02:26:29.646736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:00.664060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:28.626427+0000","last_change":"2024-08-17T02:26:28.623679+0000","last_active":"2024-08-17T02:26:28.626427+0000","last_peered":"2024-08-17T02:26:28.626427+0000","last_clean":"2024-08-17T02:26:28.626427+0000","last_became_active":"2024-08-17T02:26:28.623119+0000","last_became_peered":"2024-08-17T02:26:28.623119+0000","last_unstale":"2024-08-17T02:26:28.626427+0000","last_undegraded":"2024-08-17T02:26:28.626427+0000","last_fullsized":"2024-08-17T02:26:28.626427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:42.099769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642849+0000","last_change":"2024-08-17T02:26:29.642849+0000","last_active":"2024-08-17T02:26:29.642849+0000","last_peered":"2024-08-17T02:26:29.642849+0000","last_clean":"2024-08-17T02:26:29.642849+0000","last_became_active":"2024-08-17T02:26:29.642553+0000","last_became_peered":"2024-08-17T02:26:29.642553+0000","last_unstale":"2024-08-17T02:26:29.642849+0000","last_undegraded":"2024-08-17T02:26:29.642849+0000","last_fullsized":"2024-08-17T02:26:29.642849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:28.625387+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:26:28.625387+0000","last_peered":"2024-08-17T02:26:28.625387+0000","last_clean":"2024-08-17T02:26:28.625387+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:26:28.625387+0000","last_undegraded":"2024-08-17T02:26:28.625387+0000","last_fullsized":"2024-08-17T02:26:28.625387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.621608+0000","last_change":"2024-08-17T02:26:28.625688+0000","last_active":"2024-08-17T02:26:29.621608+0000","last_peered":"2024-08-17T02:26:29.621608+0000","last_clean":"2024-08-17T02:26:29.621608+0000","last_became_active":"2024-08-17T02:26:28.625349+0000","last_became_peered":"2024-08-17T02:26:28.625349+0000","last_unstale":"2024-08-17T02:26:29.621608+0000","last_undegraded":"2024-08-17T02:26:29.621608+0000","last_fullsized":"2024-08-17T02:26:29.621608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:29.548053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638507+0000","last_change":"2024-08-17T02:26:29.633562+0000","last_active":"2024-08-17T02:26:29.638507+0000","last_peered":"2024-08-17T02:26:29.638507+0000","last_clean":"2024-08-17T02:26:29.638507+0000","last_became_active":"2024-08-17T02:26:29.632985+0000","last_became_peered":"2024-08-17T02:26:29.632985+0000","last_unstale":"2024-08-17T02:26:29.638507+0000","last_undegraded":"2024-08-17T02:26:29.638507+0000","last_fullsized":"2024-08-17T02:26:29.638507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:51.558217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:28.634432+0000","last_change":"2024-08-17T02:26:28.631707+0000","last_active":"2024-08-17T02:26:28.634432+0000","last_peered":"2024-08-17T02:26:28.634432+0000","last_clean":"2024-08-17T02:26:28.634432+0000","last_became_active":"2024-08-17T02:26:28.631374+0000","last_became_peered":"2024-08-17T02:26:28.631374+0000","last_unstale":"2024-08-17T02:26:28.634432+0000","last_undegraded":"2024-08-17T02:26:28.634432+0000","last_fullsized":"2024-08-17T02:26:28.634432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:41.350163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.630167+0000","last_change":"2024-08-17T02:26:29.630167+0000","last_active":"2024-08-17T02:26:29.630167+0000","last_peered":"2024-08-17T02:26:29.630167+0000","last_clean":"2024-08-17T02:26:29.630167+0000","last_became_active":"2024-08-17T02:26:29.629312+0000","last_became_peered":"2024-08-17T02:26:29.629312+0000","last_unstale":"2024-08-17T02:26:29.630167+0000","last_undegraded":"2024-08-17T02:26:29.630167+0000","last_fullsized":"2024-08-17T02:26:29.630167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:21.305240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:28.629472+0000","last_change":"2024-08-17T02:26:28.628231+0000","last_active":"2024-08-17T02:26:28.629472+0000","last_peered":"2024-08-17T02:26:28.629472+0000","last_clean":"2024-08-17T02:26:28.629472+0000","last_became_active":"2024-08-17T02:26:28.627917+0000","last_became_peered":"2024-08-17T02:26:28.627917+0000","last_unstale":"2024-08-17T02:26:28.629472+0000","last_undegraded":"2024-08-17T02:26:28.629472+0000","last_fullsized":"2024-08-17T02:26:28.629472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:16:07.881276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637667+0000","last_change":"2024-08-17T02:26:29.627626+0000","last_active":"2024-08-17T02:26:29.637667+0000","last_peered":"2024-08-17T02:26:29.637667+0000","last_clean":"2024-08-17T02:26:29.637667+0000","last_became_active":"2024-08-17T02:26:29.627267+0000","last_became_peered":"2024-08-17T02:26:29.627267+0000","last_unstale":"2024-08-17T02:26:29.637667+0000","last_undegraded":"2024-08-17T02:26:29.637667+0000","last_fullsized":"2024-08-17T02:26:29.637667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:59.025392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.622874+0000","last_change":"2024-08-17T02:26:28.631076+0000","last_active":"2024-08-17T02:26:29.622874+0000","last_peered":"2024-08-17T02:26:29.622874+0000","last_clean":"2024-08-17T02:26:29.622874+0000","last_became_active":"2024-08-17T02:26:28.630766+0000","last_became_peered":"2024-08-17T02:26:28.630766+0000","last_unstale":"2024-08-17T02:26:29.622874+0000","last_undegraded":"2024-08-17T02:26:29.622874+0000","last_fullsized":"2024-08-17T02:26:29.622874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:52.647000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642846+0000","last_change":"2024-08-17T02:26:29.640421+0000","last_active":"2024-08-17T02:26:29.642846+0000","last_peered":"2024-08-17T02:26:29.642846+0000","last_clean":"2024-08-17T02:26:29.642846+0000","last_became_active":"2024-08-17T02:26:29.639492+0000","last_became_peered":"2024-08-17T02:26:29.639492+0000","last_unstale":"2024-08-17T02:26:29.642846+0000","last_undegraded":"2024-08-17T02:26:29.642846+0000","last_fullsized":"2024-08-17T02:26:29.642846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:58.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614778+0000","last_change":"2024-08-17T02:26:28.632665+0000","last_active":"2024-08-17T02:26:29.614778+0000","last_peered":"2024-08-17T02:26:29.614778+0000","last_clean":"2024-08-17T02:26:29.614778+0000","last_became_active":"2024-08-17T02:26:28.632323+0000","last_became_peered":"2024-08-17T02:26:28.632323+0000","last_unstale":"2024-08-17T02:26:29.614778+0000","last_undegraded":"2024-08-17T02:26:29.614778+0000","last_fullsized":"2024-08-17T02:26:29.614778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:26:55.149220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646510+0000","last_change":"2024-08-17T02:26:29.644054+0000","last_active":"2024-08-17T02:26:29.646510+0000","last_peered":"2024-08-17T02:26:29.646510+0000","last_clean":"2024-08-17T02:26:29.646510+0000","last_became_active":"2024-08-17T02:26:29.643787+0000","last_became_peered":"2024-08-17T02:26:29.643787+0000","last_unstale":"2024-08-17T02:26:29.646510+0000","last_undegraded":"2024-08-17T02:26:29.646510+0000","last_fullsized":"2024-08-17T02:26:29.646510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:33:07.414644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:28.640834+0000","last_change":"2024-08-17T02:26:28.640251+0000","last_active":"2024-08-17T02:26:28.640834+0000","last_peered":"2024-08-17T02:26:28.640834+0000","last_clean":"2024-08-17T02:26:28.640834+0000","last_became_active":"2024-08-17T02:26:28.639914+0000","last_became_peered":"2024-08-17T02:26:28.639914+0000","last_unstale":"2024-08-17T02:26:28.640834+0000","last_undegraded":"2024-08-17T02:26:28.640834+0000","last_fullsized":"2024-08-17T02:26:28.640834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:36.775419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637630+0000","last_change":"2024-08-17T02:26:29.627697+0000","last_active":"2024-08-17T02:26:29.637630+0000","last_peered":"2024-08-17T02:26:29.637630+0000","last_clean":"2024-08-17T02:26:29.637630+0000","last_became_active":"2024-08-17T02:26:29.627394+0000","last_became_peered":"2024-08-17T02:26:29.627394+0000","last_unstale":"2024-08-17T02:26:29.637630+0000","last_undegraded":"2024-08-17T02:26:29.637630+0000","last_fullsized":"2024-08-17T02:26:29.637630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:07.710268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614788+0000","last_change":"2024-08-17T02:26:28.631203+0000","last_active":"2024-08-17T02:26:29.614788+0000","last_peered":"2024-08-17T02:26:29.614788+0000","last_clean":"2024-08-17T02:26:29.614788+0000","last_became_active":"2024-08-17T02:26:28.630811+0000","last_became_peered":"2024-08-17T02:26:28.630811+0000","last_unstale":"2024-08-17T02:26:29.614788+0000","last_undegraded":"2024-08-17T02:26:29.614788+0000","last_fullsized":"2024-08-17T02:26:29.614788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:18.735646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638361+0000","last_change":"2024-08-17T02:26:29.634101+0000","last_active":"2024-08-17T02:26:29.638361+0000","last_peered":"2024-08-17T02:26:29.638361+0000","last_clean":"2024-08-17T02:26:29.638361+0000","last_became_active":"2024-08-17T02:26:29.633815+0000","last_became_peered":"2024-08-17T02:26:29.633815+0000","last_unstale":"2024-08-17T02:26:29.638361+0000","last_undegraded":"2024-08-17T02:26:29.638361+0000","last_fullsized":"2024-08-17T02:26:29.638361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:32.790776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.658091+0000","last_change":"2024-08-17T02:26:28.632292+0000","last_active":"2024-08-17T02:26:29.658091+0000","last_peered":"2024-08-17T02:26:29.658091+0000","last_clean":"2024-08-17T02:26:29.658091+0000","last_became_active":"2024-08-17T02:26:28.631868+0000","last_became_peered":"2024-08-17T02:26:28.631868+0000","last_unstale":"2024-08-17T02:26:29.658091+0000","last_undegraded":"2024-08-17T02:26:29.658091+0000","last_fullsized":"2024-08-17T02:26:29.658091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:44.839971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.631655+0000","last_change":"2024-08-17T02:26:29.631655+0000","last_active":"2024-08-17T02:26:29.631655+0000","last_peered":"2024-08-17T02:26:29.631655+0000","last_clean":"2024-08-17T02:26:29.631655+0000","last_became_active":"2024-08-17T02:26:29.631271+0000","last_became_peered":"2024-08-17T02:26:29.631271+0000","last_unstale":"2024-08-17T02:26:29.631655+0000","last_undegraded":"2024-08-17T02:26:29.631655+0000","last_fullsized":"2024-08-17T02:26:29.631655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:15.601838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:28.639004+0000","last_change":"2024-08-17T02:26:28.634093+0000","last_active":"2024-08-17T02:26:28.639004+0000","last_peered":"2024-08-17T02:26:28.639004+0000","last_clean":"2024-08-17T02:26:28.639004+0000","last_became_active":"2024-08-17T02:26:28.633526+0000","last_became_peered":"2024-08-17T02:26:28.633526+0000","last_unstale":"2024-08-17T02:26:28.639004+0000","last_undegraded":"2024-08-17T02:26:28.639004+0000","last_fullsized":"2024-08-17T02:26:28.639004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:57.732706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641906+0000","last_change":"2024-08-17T02:26:29.630504+0000","last_active":"2024-08-17T02:26:29.641906+0000","last_peered":"2024-08-17T02:26:29.641906+0000","last_clean":"2024-08-17T02:26:29.641906+0000","last_became_active":"2024-08-17T02:26:29.630225+0000","last_became_peered":"2024-08-17T02:26:29.630225+0000","last_unstale":"2024-08-17T02:26:29.641906+0000","last_undegraded":"2024-08-17T02:26:29.641906+0000","last_fullsized":"2024-08-17T02:26:29.641906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:37.783072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614495+0000","last_change":"2024-08-17T02:26:28.627068+0000","last_active":"2024-08-17T02:26:29.614495+0000","last_peered":"2024-08-17T02:26:29.614495+0000","last_clean":"2024-08-17T02:26:29.614495+0000","last_became_active":"2024-08-17T02:26:28.626727+0000","last_became_peered":"2024-08-17T02:26:28.626727+0000","last_unstale":"2024-08-17T02:26:29.614495+0000","last_undegraded":"2024-08-17T02:26:29.614495+0000","last_fullsized":"2024-08-17T02:26:29.614495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:18:32.727047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638319+0000","last_change":"2024-08-17T02:26:29.630289+0000","last_active":"2024-08-17T02:26:29.638319+0000","last_peered":"2024-08-17T02:26:29.638319+0000","last_clean":"2024-08-17T02:26:29.638319+0000","last_became_active":"2024-08-17T02:26:29.629189+0000","last_became_peered":"2024-08-17T02:26:29.629189+0000","last_unstale":"2024-08-17T02:26:29.638319+0000","last_undegraded":"2024-08-17T02:26:29.638319+0000","last_fullsized":"2024-08-17T02:26:29.638319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:07.710268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614139+0000","last_change":"2024-08-17T02:26:28.630536+0000","last_active":"2024-08-17T02:26:29.614139+0000","last_peered":"2024-08-17T02:26:29.614139+0000","last_clean":"2024-08-17T02:26:29.614139+0000","last_became_active":"2024-08-17T02:26:28.630123+0000","last_became_peered":"2024-08-17T02:26:28.630123+0000","last_unstale":"2024-08-17T02:26:29.614139+0000","last_undegraded":"2024-08-17T02:26:29.614139+0000","last_fullsized":"2024-08-17T02:26:29.614139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:16:07.881276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642880+0000","last_change":"2024-08-17T02:26:29.636188+0000","last_active":"2024-08-17T02:26:29.642880+0000","last_peered":"2024-08-17T02:26:29.642880+0000","last_clean":"2024-08-17T02:26:29.642880+0000","last_became_active":"2024-08-17T02:26:29.634865+0000","last_became_peered":"2024-08-17T02:26:29.634865+0000","last_unstale":"2024-08-17T02:26:29.642880+0000","last_undegraded":"2024-08-17T02:26:29.642880+0000","last_fullsized":"2024-08-17T02:26:29.642880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:59.025392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.657685+0000","last_change":"2024-08-17T02:26:28.639322+0000","last_active":"2024-08-17T02:26:29.657685+0000","last_peered":"2024-08-17T02:26:29.657685+0000","last_clean":"2024-08-17T02:26:29.657685+0000","last_became_active":"2024-08-17T02:26:28.638980+0000","last_became_peered":"2024-08-17T02:26:28.638980+0000","last_unstale":"2024-08-17T02:26:29.657685+0000","last_undegraded":"2024-08-17T02:26:29.657685+0000","last_fullsized":"2024-08-17T02:26:29.657685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:44.839971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643786+0000","last_change":"2024-08-17T02:26:29.643786+0000","last_active":"2024-08-17T02:26:29.643786+0000","last_peered":"2024-08-17T02:26:29.643786+0000","last_clean":"2024-08-17T02:26:29.643786+0000","last_became_active":"2024-08-17T02:26:29.643526+0000","last_became_peered":"2024-08-17T02:26:29.643526+0000","last_unstale":"2024-08-17T02:26:29.643786+0000","last_undegraded":"2024-08-17T02:26:29.643786+0000","last_fullsized":"2024-08-17T02:26:29.643786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:34.532005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.644988+0000","last_change":"2024-08-17T02:26:29.639581+0000","last_active":"2024-08-17T02:26:29.644988+0000","last_peered":"2024-08-17T02:26:29.644988+0000","last_clean":"2024-08-17T02:26:29.644988+0000","last_became_active":"2024-08-17T02:26:29.639288+0000","last_became_peered":"2024-08-17T02:26:29.639288+0000","last_unstale":"2024-08-17T02:26:29.644988+0000","last_undegraded":"2024-08-17T02:26:29.644988+0000","last_fullsized":"2024-08-17T02:26:29.644988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:08.902200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.652508+0000","last_change":"2024-08-17T02:26:28.631767+0000","last_active":"2024-08-17T02:26:29.652508+0000","last_peered":"2024-08-17T02:26:29.652508+0000","last_clean":"2024-08-17T02:26:29.652508+0000","last_became_active":"2024-08-17T02:26:28.631510+0000","last_became_peered":"2024-08-17T02:26:28.631510+0000","last_unstale":"2024-08-17T02:26:29.652508+0000","last_undegraded":"2024-08-17T02:26:29.652508+0000","last_fullsized":"2024-08-17T02:26:29.652508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:52.647000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.644827+0000","last_change":"2024-08-17T02:26:29.639249+0000","last_active":"2024-08-17T02:26:29.644827+0000","last_peered":"2024-08-17T02:26:29.644827+0000","last_clean":"2024-08-17T02:26:29.644827+0000","last_became_active":"2024-08-17T02:26:29.638931+0000","last_became_peered":"2024-08-17T02:26:29.638931+0000","last_unstale":"2024-08-17T02:26:29.644827+0000","last_undegraded":"2024-08-17T02:26:29.644827+0000","last_fullsized":"2024-08-17T02:26:29.644827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:52.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.657681+0000","last_change":"2024-08-17T02:26:28.633038+0000","last_active":"2024-08-17T02:26:29.657681+0000","last_peered":"2024-08-17T02:26:29.657681+0000","last_clean":"2024-08-17T02:26:29.657681+0000","last_became_active":"2024-08-17T02:26:28.632663+0000","last_became_peered":"2024-08-17T02:26:28.632663+0000","last_unstale":"2024-08-17T02:26:29.657681+0000","last_undegraded":"2024-08-17T02:26:29.657681+0000","last_fullsized":"2024-08-17T02:26:29.657681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:33.058469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634810+0000","last_change":"2024-08-17T02:26:29.634810+0000","last_active":"2024-08-17T02:26:29.634810+0000","last_peered":"2024-08-17T02:26:29.634810+0000","last_clean":"2024-08-17T02:26:29.634810+0000","last_became_active":"2024-08-17T02:26:29.634539+0000","last_became_peered":"2024-08-17T02:26:29.634539+0000","last_unstale":"2024-08-17T02:26:29.634810+0000","last_undegraded":"2024-08-17T02:26:29.634810+0000","last_fullsized":"2024-08-17T02:26:29.634810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:25.035787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.652170+0000","last_change":"2024-08-17T02:26:28.632880+0000","last_active":"2024-08-17T02:26:29.652170+0000","last_peered":"2024-08-17T02:26:29.652170+0000","last_clean":"2024-08-17T02:26:29.652170+0000","last_became_active":"2024-08-17T02:26:28.632517+0000","last_became_peered":"2024-08-17T02:26:28.632517+0000","last_unstale":"2024-08-17T02:26:29.652170+0000","last_undegraded":"2024-08-17T02:26:29.652170+0000","last_fullsized":"2024-08-17T02:26:29.652170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:53.080183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642944+0000","last_change":"2024-08-17T02:26:29.636544+0000","last_active":"2024-08-17T02:26:29.642944+0000","last_peered":"2024-08-17T02:26:29.642944+0000","last_clean":"2024-08-17T02:26:29.642944+0000","last_became_active":"2024-08-17T02:26:29.636210+0000","last_became_peered":"2024-08-17T02:26:29.636210+0000","last_unstale":"2024-08-17T02:26:29.642944+0000","last_undegraded":"2024-08-17T02:26:29.642944+0000","last_fullsized":"2024-08-17T02:26:29.642944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:29:04.485592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.656013+0000","last_change":"2024-08-17T02:26:28.631963+0000","last_active":"2024-08-17T02:26:29.656013+0000","last_peered":"2024-08-17T02:26:29.656013+0000","last_clean":"2024-08-17T02:26:29.656013+0000","last_became_active":"2024-08-17T02:26:28.631315+0000","last_became_peered":"2024-08-17T02:26:28.631315+0000","last_unstale":"2024-08-17T02:26:29.656013+0000","last_undegraded":"2024-08-17T02:26:29.656013+0000","last_fullsized":"2024-08-17T02:26:29.656013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:21.706815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":221184,"data_stored":72872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":71320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":77768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":806912,"data_stored":662258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":72872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":212992,"data_stored":71410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":71446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":815104,"data_stored":662314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:32.974 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:26:32.975 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:26:32.975 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:26:32.975 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:26:32.975 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:26:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.075+0000 7fe2f16ea700 1 Processor -- start 2024-08-17T02:26:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.075+0000 7fe2f16ea700 1 -- start start 2024-08-17T02:26:33.082 INFO:tasks.ceph.mds.d.smithi119.stderr:2024-08-17T02:26:33.081+0000 7f97f57f6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe2ec068ca0 0x7fe2ec06abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe2ec06e330 0x7fe2ec069d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec06e7b0 con 0x7fe2ec0688d0 2024-08-17T02:26:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec15ab80 con 0x7fe2ec06e330 2024-08-17T02:26:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2ec0ae390 con 0x7fe2ec068ca0 2024-08-17T02:26:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f0ee9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe2ec06e330 0x7fe2ec069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2ebfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe2ec0688d0 0x7fe2ec0c9fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33870/0 (socket says 172.21.15.19:33870) 2024-08-17T02:26:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2ebfff700 1 -- 172.21.15.19:0/3773542752 learned_addr learned my addr 172.21.15.19:0/3773542752 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2e3fff700 1 --2- 172.21.15.19:0/3773542752 >> v2:172.21.15.119:3300/0 conn(0x7fe2ec068ca0 0x7fe2ec06abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f0ee9700 1 -- 172.21.15.19:0/3773542752 >> v2:172.21.15.119:3300/0 conn(0x7fe2ec068ca0 msgr2=0x7fe2ec06abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f0ee9700 1 --2- 172.21.15.19:0/3773542752 >> v2:172.21.15.119:3300/0 conn(0x7fe2ec068ca0 0x7fe2ec06abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f0ee9700 1 -- 172.21.15.19:0/3773542752 >> v1:172.21.15.19:6789/0 conn(0x7fe2ec0688d0 legacy=0x7fe2ec0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f0ee9700 1 -- 172.21.15.19:0/3773542752 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec0ae670 con 0x7fe2ec06e330 2024-08-17T02:26:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2e3fff700 1 --2- 172.21.15.19:0/3773542752 >> v2:172.21.15.119:3300/0 conn(0x7fe2ec068ca0 0x7fe2ec06abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f0ee9700 1 --2- 172.21.15.19:0/3773542752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 0x7fe2ec069d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0c9b10 tx=0x7fe2e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df565c10401683d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2eb7fe700 1 -- 172.21.15.19:0/3773542752 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400e070 con 0x7fe2ec06e330 2024-08-17T02:26:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2eb7fe700 1 -- 172.21.15.19:0/3773542752 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e400bc30 con 0x7fe2ec06e330 2024-08-17T02:26:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2eb7fe700 1 -- 172.21.15.19:0/3773542752 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4012430 con 0x7fe2ec06e330 2024-08-17T02:26:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3773542752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 msgr2=0x7fe2ec069d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 --2- 172.21.15.19:0/3773542752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 0x7fe2ec069d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0c9b10 tx=0x7fe2e4009780 comp rx=0 tx=0).stop 2024-08-17T02:26:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3773542752 shutdown_connections 2024-08-17T02:26:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 --2- 172.21.15.19:0/3773542752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 0x7fe2ec069d60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 --2- 172.21.15.19:0/3773542752 >> v2:172.21.15.119:3300/0 conn(0x7fe2ec068ca0 0x7fe2ec06abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.079+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3773542752 >> 172.21.15.19:0/3773542752 conn(0x7fe2ec06d820 msgr2=0x7fe2ec06dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3773542752 shutdown_connections 2024-08-17T02:26:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3773542752 wait complete. 2024-08-17T02:26:33.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 Processor -- start 2024-08-17T02:26:33.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 -- start start 2024-08-17T02:26:33.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2ec0688d0 0x7fe2ec069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2ec068ca0 0x7fe2ec0a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 0x7fe2ec0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec169fa0 con 0x7fe2ec06e330 2024-08-17T02:26:33.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec169a70 con 0x7fe2ec068ca0 2024-08-17T02:26:33.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f16ea700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec169cc0 con 0x7fe2ec0688d0 2024-08-17T02:26:33.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f0ee9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 0x7fe2ec0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f0ee9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 0x7fe2ec0a9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58234/0 (socket says 172.21.15.19:58234) 2024-08-17T02:26:33.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2f0ee9700 1 -- 172.21.15.19:0/3977155200 learned_addr learned my addr 172.21.15.19:0/3977155200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:33.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2ebfff700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2ec0688d0 0x7fe2ec069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.083+0000 7fe2e3fff700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2ec068ca0 0x7fe2ec0a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2f0ee9700 1 -- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2ec0688d0 msgr2=0x7fe2ec069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2f0ee9700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2ec0688d0 0x7fe2ec069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2f0ee9700 1 -- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2ec068ca0 msgr2=0x7fe2ec0a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2f0ee9700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2ec068ca0 0x7fe2ec0a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2f0ee9700 1 -- 172.21.15.19:0/3977155200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4009a20 con 0x7fe2ec06e330 2024-08-17T02:26:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2f0ee9700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 0x7fe2ec0a9da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40097c0 tx=0x7fe2e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2e8ff9700 1 -- 172.21.15.19:0/3977155200 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4027470 con 0x7fe2ec06e330 2024-08-17T02:26:33.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2e8ff9700 1 -- 172.21.15.19:0/3977155200 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4027610 con 0x7fe2ec06e330 2024-08-17T02:26:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec0c1c20 con 0x7fe2ec06e330 2024-08-17T02:26:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2e8ff9700 1 -- 172.21.15.19:0/3977155200 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40279d0 con 0x7fe2ec06e330 2024-08-17T02:26:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec157670 con 0x7fe2ec06e330 2024-08-17T02:26:33.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec0638f0 con 0x7fe2ec06e330 2024-08-17T02:26:33.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2e8ff9700 1 -- 172.21.15.19:0/3977155200 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe2e4024070 con 0x7fe2ec06e330 2024-08-17T02:26:33.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.087+0000 7fe2e8ff9700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe2cc060860 0x7fe2cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.091+0000 7fe2e8ff9700 1 -- 172.21.15.19:0/3977155200 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2e407f200 con 0x7fe2ec06e330 2024-08-17T02:26:33.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.091+0000 7fe2ebfff700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe2cc060860 0x7fe2cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.091+0000 7fe2ebfff700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe2cc060860 0x7fe2cc062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc007130 tx=0x7fe2dc007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.099+0000 7fe2e8ff9700 1 -- 172.21.15.19:0/3977155200 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe2e404f700 con 0x7fe2ec06e330 2024-08-17T02:26:33.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.303+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe2ec067300 con 0x7fe2ec06e330 2024-08-17T02:26:33.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.311+0000 7fe2e8ff9700 1 -- 172.21.15.19:0/3977155200 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+154537 (secure 0 0 0) 0x7fe2e4052d20 con 0x7fe2ec06e330 2024-08-17T02:26:33.318 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:33.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe2cc060860 msgr2=0x7fe2cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe2cc060860 0x7fe2cc062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc007130 tx=0x7fe2dc007eb0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 msgr2=0x7fe2ec0a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 0x7fe2ec0a9da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40097c0 tx=0x7fe2e4019000 comp rx=0 tx=0).stop 2024-08-17T02:26:33.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 shutdown_connections 2024-08-17T02:26:33.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe2cc060860 0x7fe2cc062d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2ec06e330 0x7fe2ec0a9da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2ec068ca0 0x7fe2ec0a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 --2- 172.21.15.19:0/3977155200 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2ec0688d0 0x7fe2ec069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 >> 172.21.15.19:0/3977155200 conn(0x7fe2ec06d820 msgr2=0x7fe2ec0ab6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 shutdown_connections 2024-08-17T02:26:33.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.315+0000 7fe2f16ea700 1 -- 172.21.15.19:0/3977155200 wait complete. 2024-08-17T02:26:33.333 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":24148},{"type":"v1","addr":"172.21.15.119:6833","nonce":24148}]},"active_addr":"172.21.15.119:6833/24148","active_change":"2024-08-17T02:26:08.740895+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":984877388}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":434243}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3062323994}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3682831234}]}]} 2024-08-17T02:26:33.336 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:26:33.336 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:26:33.337 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 Processor -- start 2024-08-17T02:26:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 -- start start 2024-08-17T02:26:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc57c0ad1b0 0x7fc57c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc57c15cd90 0x7fc57c0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c0c86e0 con 0x7fc57c15c620 2024-08-17T02:26:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c15d210 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c0cb850 con 0x7fc57c15cd90 2024-08-17T02:26:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc57c0ad1b0 0x7fc57c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc580c8f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc57c15cd90 0x7fc57c0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc57c0ad1b0 0x7fc57c0b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58240/0 (socket says 172.21.15.19:58240) 2024-08-17T02:26:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc580c8f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc57c15cd90 0x7fc57c0c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:44800/0 (socket says 172.21.15.19:44800) 2024-08-17T02:26:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57b7fe700 1 -- 172.21.15.19:0/2765236762 learned_addr learned my addr 172.21.15.19:0/2765236762 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:33.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57b7fe700 1 -- 172.21.15.19:0/2765236762 >> v2:172.21.15.119:3300/0 conn(0x7fc57c15cd90 msgr2=0x7fc57c0c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57b7fe700 1 --2- 172.21.15.19:0/2765236762 >> v2:172.21.15.119:3300/0 conn(0x7fc57c15cd90 0x7fc57c0c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57b7fe700 1 -- 172.21.15.19:0/2765236762 >> v1:172.21.15.119:6789/0 conn(0x7fc57c15c620 legacy=0x7fc57c0acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57b7fe700 1 -- 172.21.15.19:0/2765236762 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c15d490 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57b7fe700 1 --2- 172.21.15.19:0/2765236762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c0ad1b0 0x7fc57c0b0320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0cde20 tx=0x7fc570009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec550d85d698fe4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57affd700 1 -- 172.21.15.19:0/2765236762 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570009e70 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57affd700 1 -- 172.21.15.19:0/2765236762 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57000b860 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc57affd700 1 -- 172.21.15.19:0/2765236762 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000bc00 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 -- 172.21.15.19:0/2765236762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c0ad1b0 msgr2=0x7fc57c0b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 --2- 172.21.15.19:0/2765236762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c0ad1b0 0x7fc57c0b0320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0cde20 tx=0x7fc570009250 comp rx=0 tx=0).stop 2024-08-17T02:26:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 -- 172.21.15.19:0/2765236762 shutdown_connections 2024-08-17T02:26:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 --2- 172.21.15.19:0/2765236762 >> v2:172.21.15.119:3300/0 conn(0x7fc57c15cd90 0x7fc57c0c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 --2- 172.21.15.19:0/2765236762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c0ad1b0 0x7fc57c0b0320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 -- 172.21.15.19:0/2765236762 >> 172.21.15.19:0/2765236762 conn(0x7fc57c0ca900 msgr2=0x7fc57c0cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 -- 172.21.15.19:0/2765236762 shutdown_connections 2024-08-17T02:26:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.443+0000 7fc581490700 1 -- 172.21.15.19:0/2765236762 wait complete. 2024-08-17T02:26:33.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc581490700 1 Processor -- start 2024-08-17T02:26:33.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc581490700 1 -- start start 2024-08-17T02:26:33.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc581490700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc57c0ad1b0 0x7fc57c0abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc581490700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc57c15c620 0x7fc57c14d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc581490700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c15cd90 0x7fc57c0c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc581490700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0aada0 con 0x7fc57c15cd90 2024-08-17T02:26:33.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc581490700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0c5070 con 0x7fc57c15c620 2024-08-17T02:26:33.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc581490700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0aa7e0 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc580c8f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c15cd90 0x7fc57c0c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc57b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc57c15c620 0x7fc57c14d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc580c8f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c15cd90 0x7fc57c0c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58244/0 (socket says 172.21.15.19:58244) 2024-08-17T02:26:33.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc580c8f700 1 -- 172.21.15.19:0/4167207472 learned_addr learned my addr 172.21.15.19:0/4167207472 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:33.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.447+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc57c0ad1b0 0x7fc57c0abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc57bfff700 1 -- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc57c15c620 msgr2=0x7fc57c14d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc57bfff700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc57c15c620 0x7fc57c14d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc57bfff700 1 -- 172.21.15.19:0/4167207472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c15cd90 msgr2=0x7fc57c0c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc57bfff700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c15cd90 0x7fc57c0c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc57bfff700 1 -- 172.21.15.19:0/4167207472 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700094f0 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc57bfff700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc57c0ad1b0 0x7fc57c0abb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c590 tx=0x7fc56c007e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc563fff700 1 -- 172.21.15.19:0/4167207472 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c011590 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc563fff700 1 -- 172.21.15.19:0/4167207472 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c011710 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c0aaac0 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc563fff700 1 -- 172.21.15.19:0/4167207472 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c011ad0 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c0ac0a0 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c0643a0 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc563fff700 1 -- 172.21.15.19:0/4167207472 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc56c033ad0 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc563fff700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc568060860 0x7fc568062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.451+0000 7fc563fff700 1 -- 172.21.15.19:0/4167207472 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc56c07bf30 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.455+0000 7fc57b7fe700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc568060860 0x7fc568062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.455+0000 7fc57b7fe700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc568060860 0x7fc568062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0ca830 tx=0x7fc570017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.463+0000 7fc563fff700 1 -- 172.21.15.19:0/4167207472 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc56c04c360 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.631+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc57c0681a0 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.631+0000 7fc563fff700 1 -- 172.21.15.19:0/4167207472 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc56c017020 con 0x7fc57c0ad1b0 2024-08-17T02:26:33.638 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:33.638 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:33.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc568060860 msgr2=0x7fc568062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc568060860 0x7fc568062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0ca830 tx=0x7fc570017000 comp rx=0 tx=0).stop 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc57c0ad1b0 msgr2=0x7fc57c0abb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc57c0ad1b0 0x7fc57c0abb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c590 tx=0x7fc56c007e80 comp rx=0 tx=0).stop 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 shutdown_connections 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc568060860 0x7fc568062d10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc57c15cd90 0x7fc57c0c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc57c15c620 0x7fc57c14d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 --2- 172.21.15.19:0/4167207472 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc57c0ad1b0 0x7fc57c0abb60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 >> 172.21.15.19:0/4167207472 conn(0x7fc57c0ca900 msgr2=0x7fc57c159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 shutdown_connections 2024-08-17T02:26:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.635+0000 7fc581490700 1 -- 172.21.15.19:0/4167207472 wait complete. 2024-08-17T02:26:33.653 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:26:33.653 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:33.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f3734a700 1 Processor -- start 2024-08-17T02:26:33.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f3734a700 1 -- start start 2024-08-17T02:26:33.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f3734a700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8f301570d0 0x7f8f300cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f3734a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f300cbe30 0x7f8f300afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f3734a700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f300af7d0 con 0x7f8f30156d00 2024-08-17T02:26:33.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f3734a700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f300cc290 con 0x7f8f301570d0 2024-08-17T02:26:33.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f3734a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300ae9b0 con 0x7f8f300cbe30 2024-08-17T02:26:33.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35b47700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8f301570d0 0x7f8f300cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f36b49700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f300cbe30 0x7f8f300afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35b47700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8f301570d0 0x7f8f300cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:44818/0 (socket says 172.21.15.19:44818) 2024-08-17T02:26:33.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35b47700 1 -- 172.21.15.19:0/3404539439 learned_addr learned my addr 172.21.15.19:0/3404539439 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:33.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35b47700 1 -- 172.21.15.19:0/3404539439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f300cbe30 msgr2=0x7f8f300afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35b47700 1 --2- 172.21.15.19:0/3404539439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f300cbe30 0x7f8f300afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35b47700 1 -- 172.21.15.19:0/3404539439 >> v1:172.21.15.119:6789/0 conn(0x7f8f30156d00 legacy=0x7f8f300b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35b47700 1 -- 172.21.15.19:0/3404539439 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f300aebc0 con 0x7f8f301570d0 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35b47700 1 --2- 172.21.15.19:0/3404539439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f301570d0 0x7f8f300cb8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009f20 tx=0x7f8f2c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=479fea5d0928a5f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35346700 1 -- 172.21.15.19:0/3404539439 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00e070 con 0x7f8f301570d0 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35346700 1 -- 172.21.15.19:0/3404539439 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c00b9d0 con 0x7f8f301570d0 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.751+0000 7f8f35346700 1 -- 172.21.15.19:0/3404539439 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0092e0 con 0x7f8f301570d0 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 -- 172.21.15.19:0/3404539439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f301570d0 msgr2=0x7f8f300cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 --2- 172.21.15.19:0/3404539439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f301570d0 0x7f8f300cb8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009f20 tx=0x7f8f2c009840 comp rx=0 tx=0).stop 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 -- 172.21.15.19:0/3404539439 shutdown_connections 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 --2- 172.21.15.19:0/3404539439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f300cbe30 0x7f8f300afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 --2- 172.21.15.19:0/3404539439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f301570d0 0x7f8f300cb8f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 -- 172.21.15.19:0/3404539439 >> 172.21.15.19:0/3404539439 conn(0x7f8f300cdeb0 msgr2=0x7f8f300ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 -- 172.21.15.19:0/3404539439 shutdown_connections 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 -- 172.21.15.19:0/3404539439 wait complete. 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 Processor -- start 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 -- start start 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f300cbe30 0x7f8f3014b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f30156d00 0x7f8f3006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f301570d0 0x7f8f301505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3014f500 con 0x7f8f301570d0 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3014f7e0 con 0x7f8f300cbe30 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f3734a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3014fac0 con 0x7f8f30156d00 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f36b49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f301570d0 0x7f8f301505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f36b49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f301570d0 0x7f8f301505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58258/0 (socket says 172.21.15.19:58258) 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f36b49700 1 -- 172.21.15.19:0/2523807503 learned_addr learned my addr 172.21.15.19:0/2523807503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f35b47700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f30156d00 0x7f8f3006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.755+0000 7f8f36348700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f300cbe30 0x7f8f3014b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f36b49700 1 -- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f30156d00 msgr2=0x7f8f3006ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f36b49700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f30156d00 0x7f8f3006ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f36b49700 1 -- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f300cbe30 msgr2=0x7f8f3014b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f36b49700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f300cbe30 0x7f8f3014b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f36b49700 1 -- 172.21.15.19:0/2523807503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009ae0 con 0x7f8f301570d0 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f36b49700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f301570d0 0x7f8f301505a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800ea50 tx=0x7f8f280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f227fc700 1 -- 172.21.15.19:0/2523807503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800ee90 con 0x7f8f301570d0 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f227fc700 1 -- 172.21.15.19:0/2523807503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2800c850 con 0x7f8f301570d0 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3014fda0 con 0x7f8f301570d0 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f227fc700 1 -- 172.21.15.19:0/2523807503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800cc10 con 0x7f8f301570d0 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3014f090 con 0x7f8f301570d0 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f227fc700 1 -- 172.21.15.19:0/2523807503 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8f28013470 con 0x7f8f301570d0 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f301502a0 con 0x7f8f301570d0 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f227fc700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f14060860 0x7f8f14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f227fc700 1 -- 172.21.15.19:0/2523807503 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f2807ce10 con 0x7f8f301570d0 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.759+0000 7f8f36348700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f14060860 0x7f8f14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.763+0000 7f8f36348700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f14060860 0x7f8f14062d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f24003a80 tx=0x7f8f24007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.767+0000 7f8f227fc700 1 -- 172.21.15.19:0/2523807503 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8f2804d260 con 0x7f8f301570d0 2024-08-17T02:26:33.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.935+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f300638f0 con 0x7f8f301570d0 2024-08-17T02:26:33.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.935+0000 7f8f227fc700 1 -- 172.21.15.19:0/2523807503 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f8f28050880 con 0x7f8f301570d0 2024-08-17T02:26:33.941 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:33.941 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:33.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f14060860 msgr2=0x7f8f14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f14060860 0x7f8f14062d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f24003a80 tx=0x7f8f24007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f301570d0 msgr2=0x7f8f301505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f301570d0 0x7f8f301505a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800ea50 tx=0x7f8f280091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 shutdown_connections 2024-08-17T02:26:33.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f14060860 0x7f8f14062d10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f301570d0 0x7f8f301505a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f30156d00 0x7f8f3006ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 --2- 172.21.15.19:0/2523807503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f300cbe30 0x7f8f3014b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 >> 172.21.15.19:0/2523807503 conn(0x7f8f300cdeb0 msgr2=0x7f8f300b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 shutdown_connections 2024-08-17T02:26:33.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:33.939+0000 7f8f3734a700 1 -- 172.21.15.19:0/2523807503 wait complete. 2024-08-17T02:26:33.956 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:26:33.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:26:33.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:26:33.958 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:26:33.958 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:26:33.958 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:26:33.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:26:33.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:26:34.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.095+0000 7f71c5237700 1 Processor -- start 2024-08-17T02:26:34.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.095+0000 7f71c5237700 1 -- start start 2024-08-17T02:26:34.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.095+0000 7f71c5237700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71c013e6b0 0x7f71c00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.095+0000 7f71c5237700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c0155670 0x7f71c006df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.095+0000 7f71c5237700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c0156700 con 0x7f71c013ea80 2024-08-17T02:26:34.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.095+0000 7f71c5237700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c0155af0 con 0x7f71c013e6b0 2024-08-17T02:26:34.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.095+0000 7f71c5237700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c0155dd0 con 0x7f71c0155670 2024-08-17T02:26:34.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c4a36700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f71c013ea80 0x7f71c0158ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33878/0 (socket says 172.21.15.19:33878) 2024-08-17T02:26:34.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c4a36700 1 -- 172.21.15.19:0/3864304090 learned_addr learned my addr 172.21.15.19:0/3864304090 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:34.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71bf7fe700 1 --2- 172.21.15.19:0/3864304090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c0155670 0x7f71c006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71bffff700 1 --2- 172.21.15.19:0/3864304090 >> v2:172.21.15.119:3300/0 conn(0x7f71c013e6b0 0x7f71c00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71bf7fe700 1 -- 172.21.15.19:0/3864304090 >> v2:172.21.15.119:3300/0 conn(0x7f71c013e6b0 msgr2=0x7f71c00b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71bf7fe700 1 --2- 172.21.15.19:0/3864304090 >> v2:172.21.15.119:3300/0 conn(0x7f71c013e6b0 0x7f71c00b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71bf7fe700 1 -- 172.21.15.19:0/3864304090 >> v1:172.21.15.19:6789/0 conn(0x7f71c013ea80 legacy=0x7f71c0158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71bf7fe700 1 -- 172.21.15.19:0/3864304090 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c01560b0 con 0x7f71c0155670 2024-08-17T02:26:34.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71bf7fe700 1 --2- 172.21.15.19:0/3864304090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c0155670 0x7f71c006df10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71b800ae00 tx=0x7f71b800a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2363e1b657600835 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71beffd700 1 -- 172.21.15.19:0/3864304090 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b800d430 con 0x7f71c0155670 2024-08-17T02:26:34.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71beffd700 1 -- 172.21.15.19:0/3864304090 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b800d590 con 0x7f71c0155670 2024-08-17T02:26:34.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71beffd700 1 -- 172.21.15.19:0/3864304090 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b800d950 con 0x7f71c0155670 2024-08-17T02:26:34.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c5237700 1 -- 172.21.15.19:0/3864304090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c0155670 msgr2=0x7f71c006df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c5237700 1 --2- 172.21.15.19:0/3864304090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c0155670 0x7f71c006df10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f71b800ae00 tx=0x7f71b800a6a0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c5237700 1 -- 172.21.15.19:0/3864304090 shutdown_connections 2024-08-17T02:26:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c5237700 1 --2- 172.21.15.19:0/3864304090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c0155670 0x7f71c006df10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c5237700 1 --2- 172.21.15.19:0/3864304090 >> v2:172.21.15.119:3300/0 conn(0x7f71c013e6b0 0x7f71c00b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c5237700 1 -- 172.21.15.19:0/3864304090 >> 172.21.15.19:0/3864304090 conn(0x7f71c00678d0 msgr2=0x7f71c0067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c5237700 1 -- 172.21.15.19:0/3864304090 shutdown_connections 2024-08-17T02:26:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f71c5237700 1 -- 172.21.15.19:0/3864304090 wait complete. 2024-08-17T02:26:34.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7ffb8adb8700 1 Processor -- start 2024-08-17T02:26:34.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7ffb8adb8700 1 -- start start 2024-08-17T02:26:34.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f5f0359e700 1 Processor -- start 2024-08-17T02:26:34.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.099+0000 7f5f0359e700 1 -- start start 2024-08-17T02:26:34.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd36b4a700 1 Processor -- start 2024-08-17T02:26:34.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd36b4a700 1 -- start start 2024-08-17T02:26:34.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0359e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5f0406e140 0x7f5f0406e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0359e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f04156940 con 0x7f5f0406aff0 2024-08-17T02:26:34.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0359e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f04155d30 con 0x7f5f041556f0 2024-08-17T02:26:34.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0359e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f04156010 con 0x7f5f0406e140 2024-08-17T02:26:34.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb8adb8700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb84155d20 0x7ffb840b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb8adb8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb840ad7c0 0x7ffb840aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f02d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5f0406aff0 0x7f5f04156dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33888/0 (socket says 172.21.15.19:33888) 2024-08-17T02:26:34.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb8adb8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb840af2b0 con 0x7ffb8406df10 2024-08-17T02:26:34.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb8adb8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb840adc10 con 0x7ffb840ad7c0 2024-08-17T02:26:34.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb8adb8700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb840af590 con 0x7ffb84155d20 2024-08-17T02:26:34.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71c5237700 1 Processor -- start 2024-08-17T02:26:34.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71c5237700 1 -- start start 2024-08-17T02:26:34.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb895b5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb840ad7c0 0x7ffb840aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb895b5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb840ad7c0 0x7ffb840aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58266/0 (socket says 172.21.15.19:58266) 2024-08-17T02:26:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb895b5700 1 -- 172.21.15.19:0/2803450245 learned_addr learned my addr 172.21.15.19:0/2803450245 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08c4fc700 1 Processor -- start 2024-08-17T02:26:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f02d9d700 1 -- 172.21.15.19:0/290510630 learned_addr learned my addr 172.21.15.19:0/290510630 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:34.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08c4fc700 1 -- start start 2024-08-17T02:26:34.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555520381 0 0) 0x7f5f04156940 con 0x7f5f0406aff0 2024-08-17T02:26:34.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb89db6700 1 --2- 172.21.15.19:0/2803450245 >> v2:172.21.15.119:3300/0 conn(0x7ffb84155d20 0x7ffb840b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eec003570 con 0x7f5f0406aff0 2024-08-17T02:26:34.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288984026 0 0) 0x7f5f04155d30 con 0x7f5f041556f0 2024-08-17T02:26:34.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f04156940 con 0x7f5f041556f0 2024-08-17T02:26:34.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1088793880 0 0) 0x7f5eec003570 con 0x7f5f0406aff0 2024-08-17T02:26:34.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 >> v2:172.21.15.19:3300/0 conn(0x7f5f0406e140 msgr2=0x7f5f0406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0259c700 1 --2- 172.21.15.19:0/290510630 >> v2:172.21.15.19:3300/0 conn(0x7f5f0406e140 0x7f5f0406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 --2- 172.21.15.19:0/290510630 >> v2:172.21.15.19:3300/0 conn(0x7f5f0406e140 0x7f5f0406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb895b5700 1 -- 172.21.15.19:0/2803450245 >> v2:172.21.15.119:3300/0 conn(0x7ffb84155d20 msgr2=0x7ffb840b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb895b5700 1 --2- 172.21.15.19:0/2803450245 >> v2:172.21.15.119:3300/0 conn(0x7ffb84155d20 0x7ffb840b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb895b5700 1 -- 172.21.15.19:0/2803450245 >> v1:172.21.15.19:6789/0 conn(0x7ffb8406df10 legacy=0x7ffb8406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb895b5700 1 -- 172.21.15.19:0/2803450245 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb840af870 con 0x7ffb840ad7c0 2024-08-17T02:26:34.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 >> v1:172.21.15.119:6789/0 conn(0x7f5f041556f0 legacy=0x7f5f040b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f041562f0 con 0x7f5f0406aff0 2024-08-17T02:26:34.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f5efc0017f0 con 0x7f5f0406aff0 2024-08-17T02:26:34.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71c5237700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c013e6b0 0x7f71c01539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 >> v1:172.21.15.19:6789/0 conn(0x7f5f0406aff0 legacy=0x7f5f04156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb895b5700 1 --2- 172.21.15.19:0/2803450245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 0x7ffb840aea80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffb840b1d50 tx=0x7ffb74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59727c8370f8edb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd36b4a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd30159940 0x7fdd300b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71c5237700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c013ea80 0x7f71c01698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71c5237700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71c0137470 0x7f71c016d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71c5237700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c016d260 con 0x7f71c0137470 2024-08-17T02:26:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71c5237700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c016cf30 con 0x7f71c013ea80 2024-08-17T02:26:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71c5237700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c016a220 con 0x7f71c013e6b0 2024-08-17T02:26:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08c4fc700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe0841593b0 0x7fe08415a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08c4fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe08415a8b0 0x7fe0840aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08c4fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0840aa980 0x7fe0840b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08c4fc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0840acae0 con 0x7fe0840aa980 2024-08-17T02:26:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08c4fc700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0840aade0 con 0x7fe0841593b0 2024-08-17T02:26:34.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08c4fc700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840ac650 con 0x7fe08415a8b0 2024-08-17T02:26:34.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd36b4a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd300b3d20 0x7fdd300b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd36b4a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd300b0fc0 con 0x7fdd30159570 2024-08-17T02:26:34.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd36b4a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd300b1860 con 0x7fdd300b3d20 2024-08-17T02:26:34.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd36b4a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300b4700 con 0x7fdd30159940 2024-08-17T02:26:34.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd350e7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd300b3d20 0x7fdd300b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd350e7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd300b3d20 0x7fdd300b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58288/0 (socket says 172.21.15.19:58288) 2024-08-17T02:26:34.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd350e7700 1 -- 172.21.15.19:0/50991081 learned_addr learned my addr 172.21.15.19:0/50991081 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eec003c40 0x7f5eec004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eec004810 0x7f5eec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd2ffff700 1 --2- 172.21.15.19:0/50991081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd30159940 0x7fdd300b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71bffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c013e6b0 0x7f71c01539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71bffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c013e6b0 0x7f71c01539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39082/0 (socket says 172.21.15.19:39082) 2024-08-17T02:26:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71bffff700 1 -- 172.21.15.19:0/3687699103 learned_addr learned my addr 172.21.15.19:0/3687699103 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71c4a36700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71c0137470 0x7f71c016d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08aa99700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0840aa980 0x7fe0840b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08aa99700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0840aa980 0x7fe0840b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58304/0 (socket says 172.21.15.19:58304) 2024-08-17T02:26:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08aa99700 1 -- 172.21.15.19:0/3625813264 learned_addr learned my addr 172.21.15.19:0/3625813264 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eec0053c0 0x7f5eec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f01d9b700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eec004810 0x7f5eec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08a298700 1 --2- 172.21.15.19:0/3625813264 >> v2:172.21.15.119:3300/0 conn(0x7fe0841593b0 0x7fe08415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe089a97700 1 --2- 172.21.15.19:0/3625813264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe08415a8b0 0x7fe0840aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71bf7fe700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c013ea80 0x7f71c01698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd350e7700 1 -- 172.21.15.19:0/50991081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd30159940 msgr2=0x7fdd300b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd350e7700 1 --2- 172.21.15.19:0/50991081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd30159940 0x7fdd300b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd350e7700 1 -- 172.21.15.19:0/50991081 >> v1:172.21.15.19:6789/0 conn(0x7fdd30159570 legacy=0x7fdd300b0770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd350e7700 1 -- 172.21.15.19:0/50991081 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300b12a0 con 0x7fdd300b3d20 2024-08-17T02:26:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f02d9d700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eec0053c0 0x7f5eec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f04156010 con 0x7f5eec0053c0 2024-08-17T02:26:34.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71bffff700 1 -- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c013ea80 msgr2=0x7f71c01698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71bffff700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c013ea80 0x7f71c01698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f71bffff700 1 -- 172.21.15.19:0/3687699103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71c0137470 msgr2=0x7f71c016d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71bffff700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71c0137470 0x7f71c016d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71bffff700 1 -- 172.21.15.19:0/3687699103 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b800a940 con 0x7f71c013e6b0 2024-08-17T02:26:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71bf7fe700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71c013ea80 0x7f71c01698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec00c280 con 0x7f5eec003c40 2024-08-17T02:26:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7ffb88db4700 1 -- 172.21.15.19:0/2803450245 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7400b760 con 0x7ffb840ad7c0 2024-08-17T02:26:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec00c440 con 0x7f5eec004810 2024-08-17T02:26:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7f5f0259c700 1 --2- 172.21.15.19:0/290510630 >> v2:172.21.15.19:3300/0 conn(0x7f5f0406e140 0x7f5f0406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fdd350e7700 1 --2- 172.21.15.19:0/50991081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd300b3d20 0x7fdd300b41c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009f20 tx=0x7fdd28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffb2603a3102d56 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08aa99700 1 -- 172.21.15.19:0/3625813264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe08415a8b0 msgr2=0x7fe0840aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08aa99700 1 --2- 172.21.15.19:0/3625813264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe08415a8b0 0x7fe0840aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.103+0000 7fe08aa99700 1 -- 172.21.15.19:0/3625813264 >> v2:172.21.15.119:3300/0 conn(0x7fe0841593b0 msgr2=0x7fe08415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08aa99700 1 --2- 172.21.15.19:0/3625813264 >> v2:172.21.15.119:3300/0 conn(0x7fe0841593b0 0x7fe08415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08aa99700 1 -- 172.21.15.19:0/3625813264 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe084159780 con 0x7fe0840aa980 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71bffff700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c013e6b0 0x7f71c01539f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f71b400fe20 tx=0x7f71b4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71a7fff700 1 -- 172.21.15.19:0/3687699103 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400c070 con 0x7f71c013e6b0 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71c5237700 1 -- 172.21.15.19:0/3687699103 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c016a500 con 0x7f71c013e6b0 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71a7fff700 1 -- 172.21.15.19:0/3687699103 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4009e30 con 0x7f71c013e6b0 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71a7fff700 1 -- 172.21.15.19:0/3687699103 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400de20 con 0x7f71c013e6b0 2024-08-17T02:26:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71c5237700 1 -- 172.21.15.19:0/3687699103 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c0153f30 con 0x7f71c013e6b0 2024-08-17T02:26:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0259c700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eec003c40 0x7f5eec004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f01d9b700 1 -- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eec003c40 msgr2=0x7f5eec004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f01d9b700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eec003c40 0x7f5eec004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f01d9b700 1 -- 172.21.15.19:0/290510630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eec0053c0 msgr2=0x7f5eec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f01d9b700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eec0053c0 0x7f5eec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f01d9b700 1 -- 172.21.15.19:0/290510630 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec003570 con 0x7f5eec004810 2024-08-17T02:26:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f02d9d700 1 -- 172.21.15.19:0/290510630 reap_dead start 2024-08-17T02:26:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f01d9b700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eec004810 0x7f5eec004c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8001a20 tx=0x7f5ef8007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c40869fff8affd92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb88db4700 1 -- 172.21.15.19:0/2803450245 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7400b8c0 con 0x7ffb840ad7c0 2024-08-17T02:26:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb88db4700 1 -- 172.21.15.19:0/2803450245 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7400bc60 con 0x7ffb840ad7c0 2024-08-17T02:26:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 -- 172.21.15.19:0/2803450245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 msgr2=0x7ffb840aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 --2- 172.21.15.19:0/2803450245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 0x7ffb840aea80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffb840b1d50 tx=0x7ffb74009250 comp rx=0 tx=0).stop 2024-08-17T02:26:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08aa99700 1 --2- 172.21.15.19:0/3625813264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0840aa980 0x7fe0840b0d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0840705d0 tx=0x7fe07c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f33f4023ae348e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe089296700 1 -- 172.21.15.19:0/3625813264 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c00e070 con 0x7fe0840aa980 2024-08-17T02:26:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe089296700 1 -- 172.21.15.19:0/3625813264 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c00ba20 con 0x7fe0840aa980 2024-08-17T02:26:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe089296700 1 -- 172.21.15.19:0/3625813264 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0092e0 con 0x7fe0840aa980 2024-08-17T02:26:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08c4fc700 1 -- 172.21.15.19:0/3625813264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0840aa980 msgr2=0x7fe0840b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08c4fc700 1 --2- 172.21.15.19:0/3625813264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0840aa980 0x7fe0840b0d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0840705d0 tx=0x7fe07c009840 comp rx=0 tx=0).stop 2024-08-17T02:26:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fdd2f7fe700 1 -- 172.21.15.19:0/50991081 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2800e070 con 0x7fdd300b3d20 2024-08-17T02:26:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fdd2f7fe700 1 -- 172.21.15.19:0/50991081 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2800ba40 con 0x7fdd300b3d20 2024-08-17T02:26:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08c4fc700 1 -- 172.21.15.19:0/3625813264 shutdown_connections 2024-08-17T02:26:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08c4fc700 1 --2- 172.21.15.19:0/3625813264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0840aa980 0x7fe0840b0d40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08c4fc700 1 --2- 172.21.15.19:0/3625813264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe08415a8b0 0x7fe0840aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08c4fc700 1 --2- 172.21.15.19:0/3625813264 >> v2:172.21.15.119:3300/0 conn(0x7fe0841593b0 0x7fe08415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08c4fc700 1 -- 172.21.15.19:0/3625813264 >> 172.21.15.19:0/3625813264 conn(0x7fe084068300 msgr2=0x7fe0840a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fdd36b4a700 1 -- 172.21.15.19:0/50991081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd300b3d20 msgr2=0x7fdd300b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fdd36b4a700 1 --2- 172.21.15.19:0/50991081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd300b3d20 0x7fdd300b41c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009f20 tx=0x7fdd28009840 comp rx=0 tx=0).stop 2024-08-17T02:26:34.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800c5d0 con 0x7f5eec004810 2024-08-17T02:26:34.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef800c730 con 0x7f5eec004810 2024-08-17T02:26:34.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0159a700 1 -- 172.21.15.19:0/290510630 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800cad0 con 0x7f5eec004810 2024-08-17T02:26:34.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 -- 172.21.15.19:0/2803450245 shutdown_connections 2024-08-17T02:26:34.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 --2- 172.21.15.19:0/2803450245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 0x7ffb840aea80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 --2- 172.21.15.19:0/2803450245 >> v2:172.21.15.119:3300/0 conn(0x7ffb84155d20 0x7ffb840b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 -- 172.21.15.19:0/2803450245 >> 172.21.15.19:0/2803450245 conn(0x7ffb840678d0 msgr2=0x7ffb84067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 -- 172.21.15.19:0/2803450245 shutdown_connections 2024-08-17T02:26:34.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 -- 172.21.15.19:0/2803450245 wait complete. 2024-08-17T02:26:34.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0359e700 1 -- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eec004810 msgr2=0x7f5eec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0359e700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eec004810 0x7f5eec004c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8001a20 tx=0x7f5ef8007d10 comp rx=0 tx=0).stop 2024-08-17T02:26:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08c4fc700 1 -- 172.21.15.19:0/3625813264 shutdown_connections 2024-08-17T02:26:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0359e700 1 -- 172.21.15.19:0/290510630 shutdown_connections 2024-08-17T02:26:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0359e700 1 --2- 172.21.15.19:0/290510630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5eec004810 0x7f5eec004c80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0359e700 1 -- 172.21.15.19:0/290510630 >> 172.21.15.19:0/290510630 conn(0x7f5f040678d0 msgr2=0x7f5f04067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0359e700 1 -- 172.21.15.19:0/290510630 shutdown_connections 2024-08-17T02:26:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f5f0359e700 1 -- 172.21.15.19:0/290510630 wait complete. 2024-08-17T02:26:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fdd36b4a700 1 -- 172.21.15.19:0/50991081 shutdown_connections 2024-08-17T02:26:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fdd36b4a700 1 --2- 172.21.15.19:0/50991081 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd300b3d20 0x7fdd300b41c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fdd36b4a700 1 --2- 172.21.15.19:0/50991081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd30159940 0x7fdd300b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fdd36b4a700 1 -- 172.21.15.19:0/50991081 >> 172.21.15.19:0/50991081 conn(0x7fdd300996f0 msgr2=0x7fdd30067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fdd36b4a700 1 -- 172.21.15.19:0/50991081 shutdown_connections 2024-08-17T02:26:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 Processor -- start 2024-08-17T02:26:34.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7ffb8adb8700 1 -- start start 2024-08-17T02:26:34.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7fe08c4fc700 1 -- 172.21.15.19:0/3625813264 wait complete. 2024-08-17T02:26:34.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71a7fff700 1 -- 172.21.15.19:0/3687699103 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f71b401a690 con 0x7f71c013e6b0 2024-08-17T02:26:34.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71a5ffb700 1 -- 172.21.15.19:0/3687699103 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71c00643a0 con 0x7f71c013e6b0 2024-08-17T02:26:34.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71a7fff700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f71ac060890 0x7f71ac062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.107+0000 7f71bf7fe700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f71ac060890 0x7f71ac062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e2e25700 1 Processor -- start 2024-08-17T02:26:34.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f536de22700 1 Processor -- start 2024-08-17T02:26:34.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f0359e700 1 Processor -- start 2024-08-17T02:26:34.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e2e25700 1 -- start start 2024-08-17T02:26:34.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f0359e700 1 -- start start 2024-08-17T02:26:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f71a7fff700 1 -- 172.21.15.19:0/3687699103 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71b4015070 con 0x7f71c013e6b0 2024-08-17T02:26:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8adb8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb8406df10 0x7ffb841489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8adb8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 0x7ffb8414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f71a7fff700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f71ac068a20 0x7f71ac06ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f71a7fff700 1 -- 172.21.15.19:0/3687699103 --> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71ac06b4e0 con 0x7f71ac068a20 2024-08-17T02:26:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f71a7fff700 1 -- 172.21.15.19:0/3687699103 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71b407f780 con 0x7f71c013e6b0 2024-08-17T02:26:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8adb8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb84155d20 0x7ffb8414b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8adb8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84148f10 con 0x7ffb840ad7c0 2024-08-17T02:26:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8adb8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84158f90 con 0x7ffb84155d20 2024-08-17T02:26:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8adb8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84149cf0 con 0x7ffb8406df10 2024-08-17T02:26:34.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb895b5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 0x7ffb8414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb895b5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 0x7ffb8414ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58328/0 (socket says 172.21.15.19:58328) 2024-08-17T02:26:34.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb895b5700 1 -- 172.21.15.19:0/637566437 learned_addr learned my addr 172.21.15.19:0/637566437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fdd36b4a700 1 -- 172.21.15.19:0/50991081 wait complete. 2024-08-17T02:26:34.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe08c4fc700 1 Processor -- start 2024-08-17T02:26:34.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8a5b7700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb84155d20 0x7ffb8414b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb895b5700 1 -- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb8406df10 msgr2=0x7ffb841489d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:34.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb895b5700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb8406df10 0x7ffb841489d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb895b5700 1 -- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb84155d20 msgr2=0x7ffb8414b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb895b5700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb84155d20 0x7ffb8414b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb895b5700 1 -- 172.21.15.19:0/637566437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740094f0 con 0x7ffb840ad7c0 2024-08-17T02:26:34.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8a5b7700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb84155d20 0x7ffb8414b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:34.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe08c4fc700 1 -- start start 2024-08-17T02:26:34.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb895b5700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 0x7ffb8414ac40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb8406c2d0 tx=0x7ffb74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e2e25700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77dc1593b0 0x7f77dc15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e2e25700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77dc0aab50 0x7f77dc0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e2e25700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77dc0acae0 con 0x7f77dc15a8b0 2024-08-17T02:26:34.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e2e25700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77dc0ac650 con 0x7f77dc1593b0 2024-08-17T02:26:34.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e2e25700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc159780 con 0x7f77dc0aab50 2024-08-17T02:26:34.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f71c4a36700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f71ac068a20 0x7f71ac06ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e0bc1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77dc1593b0 0x7f77dc15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e0bc1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77dc1593b0 0x7f77dc15a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58354/0 (socket says 172.21.15.19:58354) 2024-08-17T02:26:34.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e0bc1700 1 -- 172.21.15.19:0/4276725424 learned_addr learned my addr 172.21.15.19:0/4276725424 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f71bf7fe700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f71ac060890 0x7f71ac062d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71b800a2b0 tx=0x7f71b8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb79ffb700 1 -- 172.21.15.19:0/637566437 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74026480 con 0x7ffb840ad7c0 2024-08-17T02:26:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb79ffb700 1 -- 172.21.15.19:0/637566437 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb740265e0 con 0x7ffb840ad7c0 2024-08-17T02:26:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb79ffb700 1 -- 172.21.15.19:0/637566437 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74026980 con 0x7ffb840ad7c0 2024-08-17T02:26:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb841493c0 con 0x7ffb840ad7c0 2024-08-17T02:26:34.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb84149980 con 0x7ffb840ad7c0 2024-08-17T02:26:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e13c2700 1 --2- 172.21.15.19:0/4276725424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77dc0aab50 0x7f77dc0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e0bc1700 1 -- 172.21.15.19:0/4276725424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77dc0aab50 msgr2=0x7f77dc0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e0bc1700 1 --2- 172.21.15.19:0/4276725424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77dc0aab50 0x7f77dc0b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e0bc1700 1 -- 172.21.15.19:0/4276725424 >> v1:172.21.15.119:6789/0 conn(0x7f77dc15a8b0 legacy=0x7f77dc0aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e0bc1700 1 -- 172.21.15.19:0/4276725424 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc0aba40 con 0x7f77dc1593b0 2024-08-17T02:26:34.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77e0bc1700 1 --2- 172.21.15.19:0/4276725424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc1593b0 0x7f77dc15a370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f77d00099b0 tx=0x7f77d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c5eb9ac8c8cff4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f71c4a36700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f71ac068a20 0x7f71ac06ae30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f536de22700 1 -- start start 2024-08-17T02:26:34.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f536de22700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53680ad270 0x7f53681606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f536de22700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53681573c0 con 0x7f5368153520 2024-08-17T02:26:34.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f536de22700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5368156780 con 0x7f5368153150 2024-08-17T02:26:34.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f536de22700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5368156d40 con 0x7f53680ad270 2024-08-17T02:26:34.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77db7fe700 1 -- 172.21.15.19:0/4276725424 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0009ea0 con 0x7f77dc1593b0 2024-08-17T02:26:34.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f77db7fe700 1 -- 172.21.15.19:0/4276725424 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d000b820 con 0x7f77dc1593b0 2024-08-17T02:26:34.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f8f43c0c700 1 Processor -- start 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe08c4fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0840aa980 0x7fe084150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe08c4fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0841593b0 0x7fe0840c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe08c4fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe08415a8b0 0x7fe0840c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe08c4fc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840b0860 con 0x7fe0840aa980 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe08c4fc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe084097020 con 0x7fe08415a8b0 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe08c4fc700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840afc50 con 0x7fe0841593b0 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe089a97700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0841593b0 0x7fe0840c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe089a97700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0841593b0 0x7fe0840c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39128/0 (socket says 172.21.15.19:39128) 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe089a97700 1 -- 172.21.15.19:0/1066185276 learned_addr learned my addr 172.21.15.19:0/1066185276 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe089a97700 1 -- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe08415a8b0 msgr2=0x7fe0840c6c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:34.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe089a97700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe08415a8b0 0x7fe0840c6c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe089a97700 1 -- 172.21.15.19:0/1066185276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0840aa980 msgr2=0x7fe084150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe089a97700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0840aa980 0x7fe084150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7fe089a97700 1 -- 172.21.15.19:0/1066185276 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c009ae0 con 0x7fe0841593b0 2024-08-17T02:26:34.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f43c0c700 1 -- start start 2024-08-17T02:26:34.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f71a7fff700 1 -- 172.21.15.19:0/3687699103 <== osd.0 v2:172.21.15.19:6800/24143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f71ac06b4e0 con 0x7f71ac068a20 2024-08-17T02:26:34.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f0359e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eec004810 0x7f5f04154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f0359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f04127ac0 0x7f5f04125670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f0359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f04129b30 0x7f5f04129fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f0359e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0412a4e0 con 0x7f5f04127ac0 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f0359e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0412bfb0 con 0x7f5eec004810 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f0359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f04155110 con 0x7f5f04129b30 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f01d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f04127ac0 0x7f5f04125670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f01d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f04127ac0 0x7f5f04125670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58344/0 (socket says 172.21.15.19:58344) 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f53677fe700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5368153150 0x7f5368155d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:32864/0 (socket says 172.21.15.19:32864) 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f53677fe700 1 -- 172.21.15.19:0/2185238240 learned_addr learned my addr 172.21.15.19:0/2185238240 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:34.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5367fff700 1 --2- 172.21.15.19:0/2185238240 >> v2:172.21.15.19:3300/0 conn(0x7f53680ad270 0x7f53681606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f01d9b700 1 -- 172.21.15.19:0/1296559525 learned_addr learned my addr 172.21.15.19:0/1296559525 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f0259c700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eec004810 0x7f5f04154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f01d9b700 1 -- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f04129b30 msgr2=0x7f5f04129fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f01d9b700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f04129b30 0x7f5f04129fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f01d9b700 1 -- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eec004810 msgr2=0x7f5f04154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f01d9b700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5eec004810 0x7f5f04154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.111+0000 7f5f01d9b700 1 -- 172.21.15.19:0/1296559525 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f04125ec0 con 0x7f5f04127ac0 2024-08-17T02:26:34.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f77db7fe700 1 -- 172.21.15.19:0/4276725424 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000bbc0 con 0x7f77dc1593b0 2024-08-17T02:26:34.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f77e2e25700 1 -- 172.21.15.19:0/4276725424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc1593b0 msgr2=0x7f77dc15a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd36b4a700 1 Processor -- start 2024-08-17T02:26:34.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f53667fc700 1 -- 172.21.15.19:0/2185238240 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872936780 0 0) 0x7f5368156780 con 0x7f5368153150 2024-08-17T02:26:34.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f53667fc700 1 -- 172.21.15.19:0/2185238240 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5350003570 con 0x7f5368153150 2024-08-17T02:26:34.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5367fff700 1 -- 172.21.15.19:0/2185238240 >> v1:172.21.15.119:6789/0 conn(0x7f5368153150 legacy=0x7f5368155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5367fff700 1 -- 172.21.15.19:0/2185238240 >> v1:172.21.15.19:6789/0 conn(0x7f5368153520 legacy=0x7f53680acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5367fff700 1 -- 172.21.15.19:0/2185238240 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368156a60 con 0x7f53680ad270 2024-08-17T02:26:34.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f77e2e25700 1 --2- 172.21.15.19:0/4276725424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc1593b0 0x7f77dc15a370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f77d00099b0 tx=0x7f77d0009250 comp rx=0 tx=0).stop 2024-08-17T02:26:34.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd36b4a700 1 -- start start 2024-08-17T02:26:34.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fe089a97700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0841593b0 0x7fe0840c66c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe080006b00 tx=0x7fe080008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5f01d9b700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f04127ac0 0x7f5f04125670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800c3c0 tx=0x7f5ef8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5ef27fc700 1 -- 172.21.15.19:0/1296559525 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800c5d0 con 0x7f5f04127ac0 2024-08-17T02:26:34.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5ef27fc700 1 -- 172.21.15.19:0/1296559525 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef800ce80 con 0x7f5f04127ac0 2024-08-17T02:26:34.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5ef27fc700 1 -- 172.21.15.19:0/1296559525 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef801f640 con 0x7f5f04127ac0 2024-08-17T02:26:34.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5f0359e700 1 -- 172.21.15.19:0/1296559525 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f041261a0 con 0x7f5f04127ac0 2024-08-17T02:26:34.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7ffb79ffb700 1 -- 172.21.15.19:0/637566437 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffb74026cf0 con 0x7ffb840ad7c0 2024-08-17T02:26:34.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb840643a0 con 0x7ffb840ad7c0 2024-08-17T02:26:34.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7ffb79ffb700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb68060910 0x7ffb68062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7ffb79ffb700 1 -- 172.21.15.19:0/637566437 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb7407eaa0 con 0x7ffb840ad7c0 2024-08-17T02:26:34.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7ffb79ffb700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7ffb68068aa0 0x7ffb6806aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7ffb79ffb700 1 -- 172.21.15.19:0/637566437 --> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb6806b560 con 0x7ffb68068aa0 2024-08-17T02:26:34.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5f0359e700 1 -- 172.21.15.19:0/1296559525 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f04125bb0 con 0x7f5f04127ac0 2024-08-17T02:26:34.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5f0359e700 1 -- 172.21.15.19:0/1296559525 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f040643a0 con 0x7f5f04127ac0 2024-08-17T02:26:34.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f77e2e25700 1 -- 172.21.15.19:0/4276725424 shutdown_connections 2024-08-17T02:26:34.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f77e2e25700 1 --2- 172.21.15.19:0/4276725424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77dc0aab50 0x7f77dc0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f77e2e25700 1 --2- 172.21.15.19:0/4276725424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc1593b0 0x7f77dc15a370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f77e2e25700 1 -- 172.21.15.19:0/4276725424 >> 172.21.15.19:0/4276725424 conn(0x7f77dc068300 msgr2=0x7f77dc0a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7ffb79ffb700 1 -- 172.21.15.19:0/637566437 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb74024ea0 con 0x7ffb840ad7c0 2024-08-17T02:26:34.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7ffb89db6700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb68060910 0x7ffb68062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7ffb8a5b7700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7ffb68068aa0 0x7ffb6806aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fe07a7fc700 1 -- 172.21.15.19:0/1066185276 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0800125f0 con 0x7fe0841593b0 2024-08-17T02:26:34.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fe07a7fc700 1 -- 172.21.15.19:0/1066185276 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe080012770 con 0x7fe0841593b0 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fe07a7fc700 1 -- 172.21.15.19:0/1066185276 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080012b30 con 0x7fe0841593b0 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0840aff30 con 0x7fe0841593b0 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0840b04f0 con 0x7fe0841593b0 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd36b4a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd300b3d20 0x7fdd301509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd36b4a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd30159570 0x7fdd300aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd36b4a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd30159940 0x7fdd300c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd36b4a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300c66c0 con 0x7fdd30159570 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd36b4a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd30150ef0 con 0x7fdd30159940 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd36b4a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300ac930 con 0x7fdd300b3d20 2024-08-17T02:26:34.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd30159570 0x7fdd300aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd30159570 0x7fdd300aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58390/0 (socket says 172.21.15.19:58390) 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd2ffff700 1 -- 172.21.15.19:0/2931763692 learned_addr learned my addr 172.21.15.19:0/2931763692 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd348e6700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd300b3d20 0x7fdd301509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd350e7700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd30159940 0x7fdd300c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f43c0c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f3c13b630 0x7f8f3c0b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f419a8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f3c13b630 0x7f8f3c0b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f419a8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f3c13b630 0x7f8f3c0b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58388/0 (socket says 172.21.15.19:58388) 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f419a8700 1 -- 172.21.15.19:0/3877308162 learned_addr learned my addr 172.21.15.19:0/3877308162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f43c0c700 1 --2- 172.21.15.19:0/3877308162 >> v2:172.21.15.119:3300/0 conn(0x7f8f3c0b1950 0x7f8f3c13d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f43c0c700 1 -- 172.21.15.19:0/3877308162 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c13cf90 con 0x7f8f3c13bf10 2024-08-17T02:26:34.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f43c0c700 1 -- 172.21.15.19:0/3877308162 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c13c380 con 0x7f8f3c13b630 2024-08-17T02:26:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f43c0c700 1 -- 172.21.15.19:0/3877308162 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c13c660 con 0x7f8f3c0b1950 2024-08-17T02:26:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f421a9700 1 --2- 172.21.15.19:0/3877308162 >> v2:172.21.15.119:3300/0 conn(0x7f8f3c0b1950 0x7f8f3c13d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f419a8700 1 -- 172.21.15.19:0/3877308162 >> v2:172.21.15.119:3300/0 conn(0x7f8f3c0b1950 msgr2=0x7f8f3c13d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f419a8700 1 --2- 172.21.15.19:0/3877308162 >> v2:172.21.15.119:3300/0 conn(0x7f8f3c0b1950 0x7f8f3c13d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f419a8700 1 -- 172.21.15.19:0/3877308162 >> v1:172.21.15.119:6789/0 conn(0x7f8f3c13bf10 legacy=0x7f8f3c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f419a8700 1 -- 172.21.15.19:0/3877308162 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c13c940 con 0x7f8f3c13b630 2024-08-17T02:26:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f8f419a8700 1 --2- 172.21.15.19:0/3877308162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c13b630 0x7f8f3c0b1410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0ae840 tx=0x7f8f38011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f7bd592183989c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f5367fff700 1 --2- 172.21.15.19:0/2185238240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53680ad270 0x7f53681606f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f535c00bb80 tx=0x7f535c00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fc978cba94c74b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd2ffff700 1 -- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd300b3d20 msgr2=0x7fdd301509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd2ffff700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd300b3d20 0x7fdd301509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd2ffff700 1 -- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd30159940 msgr2=0x7fdd300c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd2ffff700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd30159940 0x7fdd300c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7fdd2ffff700 1 -- 172.21.15.19:0/2931763692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd28009ae0 con 0x7fdd30159570 2024-08-17T02:26:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f53667fc700 1 -- 172.21.15.19:0/2185238240 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00db30 con 0x7f53680ad270 2024-08-17T02:26:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f53667fc700 1 -- 172.21.15.19:0/2185238240 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c00dc90 con 0x7f53680ad270 2024-08-17T02:26:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.115+0000 7f53667fc700 1 -- 172.21.15.19:0/2185238240 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00db30 con 0x7f53680ad270 2024-08-17T02:26:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fdd2ffff700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd30159570 0x7fdd300aea90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400d8c0 tx=0x7fdd24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f8f409a6700 1 -- 172.21.15.19:0/3877308162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38016070 con 0x7f8f3c13b630 2024-08-17T02:26:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f8f409a6700 1 -- 172.21.15.19:0/3877308162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38013e60 con 0x7f8f3c13b630 2024-08-17T02:26:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f8f409a6700 1 -- 172.21.15.19:0/3877308162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38011300 con 0x7f8f3c13b630 2024-08-17T02:26:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fdd2cff9700 1 -- 172.21.15.19:0/2931763692 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd240125f0 con 0x7fdd30159570 2024-08-17T02:26:34.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7ffb89db6700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb68060910 0x7ffb68062dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009a40 tx=0x7ffb80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7ffb8a5b7700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7ffb68068aa0 0x7ffb6806aeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fdd2cff9700 1 -- 172.21.15.19:0/2931763692 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd24012750 con 0x7fdd30159570 2024-08-17T02:26:34.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fdd2cff9700 1 -- 172.21.15.19:0/2931763692 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24012af0 con 0x7fdd30159570 2024-08-17T02:26:34.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f536de22700 1 -- 172.21.15.19:0/2185238240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53680ad270 msgr2=0x7f53681606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f536de22700 1 --2- 172.21.15.19:0/2185238240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53680ad270 0x7f53681606f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f535c00bb80 tx=0x7f535c00b420 comp rx=0 tx=0).stop 2024-08-17T02:26:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5ef27fc700 1 -- 172.21.15.19:0/1296559525 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5ef801f9f0 con 0x7f5f04127ac0 2024-08-17T02:26:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5ef27fc700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5ee4060890 0x7f5ee4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5ef27fc700 1 -- 172.21.15.19:0/1296559525 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ef807e600 con 0x7f5f04127ac0 2024-08-17T02:26:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5ef27fc700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f5ee4068aa0 0x7f5ee406aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5ef27fc700 1 -- 172.21.15.19:0/1296559525 --> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ee406b560 con 0x7f5ee4068aa0 2024-08-17T02:26:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5ef27fc700 1 -- 172.21.15.19:0/1296559525 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ef8080be0 con 0x7f5f04127ac0 2024-08-17T02:26:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5f0259c700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5ee4060890 0x7f5ee4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd300c6100 con 0x7fdd30159570 2024-08-17T02:26:34.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5f02d9d700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f5ee4068aa0 0x7f5ee406aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd300ac5c0 con 0x7fdd30159570 2024-08-17T02:26:34.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f536de22700 1 -- 172.21.15.19:0/2185238240 shutdown_connections 2024-08-17T02:26:34.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f536de22700 1 --2- 172.21.15.19:0/2185238240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53680ad270 0x7f53681606f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f536de22700 1 -- 172.21.15.19:0/2185238240 >> 172.21.15.19:0/2185238240 conn(0x7f53680cd160 msgr2=0x7f536806d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5f02d9d700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f5ee4068aa0 0x7f5ee406aeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f77e2e25700 1 -- 172.21.15.19:0/4276725424 shutdown_connections 2024-08-17T02:26:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f77e2e25700 1 -- 172.21.15.19:0/4276725424 wait complete. 2024-08-17T02:26:34.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7ffb79ffb700 1 -- 172.21.15.19:0/637566437 <== osd.3 v2:172.21.15.19:6824/24152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ffb6806b560 con 0x7ffb68068aa0 2024-08-17T02:26:34.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe084070360 con 0x7fe0841593b0 2024-08-17T02:26:34.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe07a7fc700 1 -- 172.21.15.19:0/1066185276 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe08001e460 con 0x7fe0841593b0 2024-08-17T02:26:34.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe07a7fc700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe068060930 0x7fe068062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe07a7fc700 1 -- 172.21.15.19:0/1066185276 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe08007d0d0 con 0x7fe0841593b0 2024-08-17T02:26:34.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe07a7fc700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7fe068068b40 0x7fe06806af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe08a298700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe068060930 0x7fe068062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe07a7fc700 1 -- 172.21.15.19:0/1066185276 --> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe06806b600 con 0x7fe068068b40 2024-08-17T02:26:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe07a7fc700 1 -- 172.21.15.19:0/1066185276 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe08007f710 con 0x7fe0841593b0 2024-08-17T02:26:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f8f43c0c700 1 -- 172.21.15.19:0/3877308162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c13b630 msgr2=0x7f8f3c0b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f8f43c0c700 1 --2- 172.21.15.19:0/3877308162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c13b630 0x7f8f3c0b1410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0ae840 tx=0x7f8f38011af0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f536de22700 1 -- 172.21.15.19:0/2185238240 shutdown_connections 2024-08-17T02:26:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5f0259c700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5ee4060890 0x7f5ee4062d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f04129810 tx=0x7f5ef4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe08aa99700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7fe068068b40 0x7fe06806af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f536de22700 1 -- 172.21.15.19:0/2185238240 wait complete. 2024-08-17T02:26:34.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f5ef27fc700 1 -- 172.21.15.19:0/1296559525 <== osd.1 v2:172.21.15.19:6816/24141 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5ee406b560 con 0x7f5ee4068aa0 2024-08-17T02:26:34.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd300b5e20 con 0x7fdd30159570 2024-08-17T02:26:34.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe08a298700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe068060930 0x7fe068062de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe074009bb0 tx=0x7fe0740091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7fe08aa99700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7fe068068b40 0x7fe06806af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f77e2e25700 1 Processor -- start 2024-08-17T02:26:34.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.119+0000 7f77e2e25700 1 -- start start 2024-08-17T02:26:34.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e2e25700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc0aab50 0x7f77dc157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e2e25700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77dc1593b0 0x7f77dc097600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e2e25700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77dc15a8b0 0x7f77dc06adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e2e25700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc097b40 con 0x7f77dc0aab50 2024-08-17T02:26:34.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e2e25700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc099680 con 0x7f77dc15a8b0 2024-08-17T02:26:34.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e2e25700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc097170 con 0x7f77dc1593b0 2024-08-17T02:26:34.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f536de22700 1 Processor -- start 2024-08-17T02:26:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e0bc1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc0aab50 0x7f77dc157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e0bc1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc0aab50 0x7f77dc157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58396/0 (socket says 172.21.15.19:58396) 2024-08-17T02:26:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e0bc1700 1 -- 172.21.15.19:0/1351951650 learned_addr learned my addr 172.21.15.19:0/1351951650 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e13c2700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77dc15a8b0 0x7f77dc06adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f536de22700 1 -- start start 2024-08-17T02:26:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77dbfff700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77dc1593b0 0x7f77dc097600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fdd2cff9700 1 -- 172.21.15.19:0/2931763692 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdd2401e460 con 0x7fdd30159570 2024-08-17T02:26:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fe07a7fc700 1 -- 172.21.15.19:0/1066185276 <== osd.4 v2:172.21.15.119:6824/24494 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe06806b600 con 0x7fe068068b40 2024-08-17T02:26:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e0bc1700 1 -- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77dc1593b0 msgr2=0x7f77dc097600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e0bc1700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77dc1593b0 0x7f77dc097600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e0bc1700 1 -- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77dc15a8b0 msgr2=0x7f77dc06adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e0bc1700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77dc15a8b0 0x7f77dc06adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e0bc1700 1 -- 172.21.15.19:0/1351951650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00094f0 con 0x7f77dc0aab50 2024-08-17T02:26:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e13c2700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77dc15a8b0 0x7f77dc06adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fdd2cff9700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd1c060930 0x7fdd1c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fdd2cff9700 1 -- 172.21.15.19:0/2931763692 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd2407d030 con 0x7fdd30159570 2024-08-17T02:26:34.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e0bc1700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc0aab50 0x7f77dc157550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77dc068da0 tx=0x7f77d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fdd2cff9700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fdd1c068ac0 0x7fdd1c06aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fdd2cff9700 1 -- 172.21.15.19:0/2931763692 --> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd1c06b580 con 0x7fdd1c068ac0 2024-08-17T02:26:34.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fdd348e6700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd1c060930 0x7fdd1c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f8f43c0c700 1 -- 172.21.15.19:0/3877308162 shutdown_connections 2024-08-17T02:26:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f8f43c0c700 1 --2- 172.21.15.19:0/3877308162 >> v2:172.21.15.119:3300/0 conn(0x7f8f3c0b1950 0x7f8f3c13d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f8f43c0c700 1 --2- 172.21.15.19:0/3877308162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c13b630 0x7f8f3c0b1410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f536de22700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53680ad270 0x7f536816e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fdd350e7700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fdd1c068ac0 0x7fdd1c06aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f536de22700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5368153150 0x7f53680afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f536de22700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5368153520 0x7f53680b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f536de22700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680b02f0 con 0x7f5368153150 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f536de22700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680b0fd0 con 0x7f5368153520 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f536de22700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53680b0070 con 0x7f53680ad270 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f8f43c0c700 1 -- 172.21.15.19:0/3877308162 >> 172.21.15.19:0/3877308162 conn(0x7f8f3c0678d0 msgr2=0x7f8f3c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77d8ff9700 1 -- 172.21.15.19:0/1351951650 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011990 con 0x7f77dc0aab50 2024-08-17T02:26:34.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77d8ff9700 1 -- 172.21.15.19:0/1351951650 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0020070 con 0x7f77dc0aab50 2024-08-17T02:26:34.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77d8ff9700 1 -- 172.21.15.19:0/1351951650 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011d80 con 0x7f77dc0aab50 2024-08-17T02:26:34.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f53677fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53680ad270 0x7f536816e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f53677fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53680ad270 0x7f536816e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39146/0 (socket says 172.21.15.19:39146) 2024-08-17T02:26:34.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f53677fe700 1 -- 172.21.15.19:0/303420941 learned_addr learned my addr 172.21.15.19:0/303420941 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc0993a0 con 0x7f77dc0aab50 2024-08-17T02:26:34.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc096e00 con 0x7f77dc0aab50 2024-08-17T02:26:34.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fdd350e7700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fdd1c068ac0 0x7fdd1c06aed0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7fdd348e6700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd1c060930 0x7fdd1c062de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd20006fd0 tx=0x7fdd20009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f5367fff700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5368153520 0x7f53680b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f53677fe700 1 -- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5368153520 msgr2=0x7f53680b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f53677fe700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5368153520 0x7f53680b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f53677fe700 1 -- 172.21.15.19:0/303420941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5368153150 msgr2=0x7f53680afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f53677fe700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5368153150 0x7f53680afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f53677fe700 1 -- 172.21.15.19:0/303420941 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c00b6c0 con 0x7f53680ad270 2024-08-17T02:26:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.123+0000 7f53677fe700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53680ad270 0x7f536816e630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f535800c790 tx=0x7f5358007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f534f7fe700 1 -- 172.21.15.19:0/303420941 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358005b30 con 0x7f53680ad270 2024-08-17T02:26:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f534f7fe700 1 -- 172.21.15.19:0/303420941 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5358005c90 con 0x7f53680ad270 2024-08-17T02:26:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f534f7fe700 1 -- 172.21.15.19:0/303420941 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358007320 con 0x7f53680ad270 2024-08-17T02:26:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 -- 172.21.15.19:0/3877308162 shutdown_connections 2024-08-17T02:26:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 -- 172.21.15.19:0/3877308162 wait complete. 2024-08-17T02:26:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f77d8ff9700 1 -- 172.21.15.19:0/1351951650 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f77d0022030 con 0x7f77dc0aab50 2024-08-17T02:26:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53680b19a0 con 0x7f53680ad270 2024-08-17T02:26:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7fdd2cff9700 1 -- 172.21.15.19:0/2931763692 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd2404d500 con 0x7fdd30159570 2024-08-17T02:26:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7fdd2cff9700 1 -- 172.21.15.19:0/2931763692 <== osd.5 v2:172.21.15.119:6800/24492 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fdd1c06b580 con 0x7fdd1c068ac0 2024-08-17T02:26:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f77d8ff9700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f77c8060930 0x7f77c8062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f77d8ff9700 1 -- 172.21.15.19:0/1351951650 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77d007e790 con 0x7f77dc0aab50 2024-08-17T02:26:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53680b0980 con 0x7f53680ad270 2024-08-17T02:26:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f77dbfff700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f77c8060930 0x7f77c8062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 Processor -- start 2024-08-17T02:26:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 -- start start 2024-08-17T02:26:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f77dbfff700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f77c8060930 0x7f77c8062de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f77dc16ee30 tx=0x7f77d4009780 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f534f7fe700 1 -- 172.21.15.19:0/303420941 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5358007690 con 0x7f53680ad270 2024-08-17T02:26:34.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f534f7fe700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5354060860 0x7f5354062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f534f7fe700 1 -- 172.21.15.19:0/303420941 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f535807c0e0 con 0x7f53680ad270 2024-08-17T02:26:34.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c0b1950 0x7f8f3c167d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f3c13b630 0x7f8f3c0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f3c13bf10 0x7f8f3c0c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0c74f0 con 0x7f8f3c0b1950 2024-08-17T02:26:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0c1710 con 0x7f8f3c13bf10 2024-08-17T02:26:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f43c0c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0c0b00 con 0x7f8f3c13b630 2024-08-17T02:26:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.127+0000 7f8f419a8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c0b1950 0x7f8f3c167d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f419a8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c0b1950 0x7f8f3c167d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58408/0 (socket says 172.21.15.19:58408) 2024-08-17T02:26:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f419a8700 1 -- 172.21.15.19:0/2093841231 learned_addr learned my addr 172.21.15.19:0/2093841231 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f411a7700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f3c13b630 0x7f8f3c0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f5366ffd700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5354060860 0x7f5354062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f421a9700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f3c13bf10 0x7f8f3c0c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f419a8700 1 -- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f3c13b630 msgr2=0x7f8f3c0c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f419a8700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f3c13b630 0x7f8f3c0c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f419a8700 1 -- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f3c13bf10 msgr2=0x7f8f3c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f419a8700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f3c13bf10 0x7f8f3c0c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f419a8700 1 -- 172.21.15.19:0/2093841231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38011d90 con 0x7f8f3c0b1950 2024-08-17T02:26:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f421a9700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f3c13bf10 0x7f8f3c0c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f419a8700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c0b1950 0x7f8f3c167d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8f38013fd0 tx=0x7f8f38020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f31ffb700 1 -- 172.21.15.19:0/2093841231 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800b070 con 0x7f8f3c0b1950 2024-08-17T02:26:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f5366ffd700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5354060860 0x7f5354062d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5360000f80 tx=0x7f5360007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f31ffb700 1 -- 172.21.15.19:0/2093841231 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38011670 con 0x7f8f3c0b1950 2024-08-17T02:26:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f31ffb700 1 -- 172.21.15.19:0/2093841231 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38010380 con 0x7f8f3c0b1950 2024-08-17T02:26:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c0c0de0 con 0x7f8f3c0b1950 2024-08-17T02:26:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c0c13a0 con 0x7f8f3c0b1950 2024-08-17T02:26:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f77e2e25700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7f77bc0015f0 0x7f77bc003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 --> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77bc006b90 con 0x7f77bc0015f0 2024-08-17T02:26:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f77e13c2700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7f77bc0015f0 0x7f77bc003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f77e13c2700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7f77bc0015f0 0x7f77bc003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f8f31ffb700 1 -- 172.21.15.19:0/2093841231 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8f3800f030 con 0x7f8f3c0b1950 2024-08-17T02:26:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.131+0000 7f77d8ff9700 1 -- 172.21.15.19:0/1351951650 <== osd.2 v2:172.21.15.19:6805/24142 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f77bc006b90 con 0x7f77bc0015f0 2024-08-17T02:26:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.135+0000 7f536de22700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7f536814ede0 0x7f53680a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.135+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 --> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f536806add0 con 0x7f536814ede0 2024-08-17T02:26:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.135+0000 7f5367fff700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7f536814ede0 0x7f53680a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.135+0000 7f5367fff700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7f536814ede0 0x7f53680a5cf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.135+0000 7f534f7fe700 1 -- 172.21.15.19:0/303420941 <== osd.7 v2:172.21.15.119:6808/24493 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f536806add0 con 0x7f536814ede0 2024-08-17T02:26:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 -- 172.21.15.19:0/3687699103 --> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71c016d0a0 con 0x7f71ac068a20 2024-08-17T02:26:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f8f31ffb700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f20060860 0x7f8f20062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a7fff700 1 -- 172.21.15.19:0/3687699103 <== osd.0 v2:172.21.15.19:6800/24143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71c016d0a0 con 0x7f71ac068a20 2024-08-17T02:26:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 --> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffb84149050 con 0x7ffb68068aa0 2024-08-17T02:26:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f8f31ffb700 1 -- 172.21.15.19:0/2093841231 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f3808e8b0 con 0x7f8f3c0b1950 2024-08-17T02:26:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 -- 172.21.15.19:0/3687699103 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f71ac068a20 msgr2=0x7f71ac06ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f71ac068a20 0x7f71ac06ae30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7ffb79ffb700 1 -- 172.21.15.19:0/637566437 <== osd.3 v2:172.21.15.19:6824/24152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffb84149050 con 0x7ffb68068aa0 2024-08-17T02:26:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f8f411a7700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f20060860 0x7f8f20062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f8f43c0c700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f8f1c0015f0 0x7f8f1c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 --> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f1c006b90 con 0x7f8f1c0015f0 2024-08-17T02:26:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 -- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f71ac060890 msgr2=0x7f71ac062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f71ac060890 0x7f71ac062d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71b800a2b0 tx=0x7f71b8016000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 -- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c013e6b0 msgr2=0x7f71c01539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 --2- 172.21.15.19:0/3687699103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71c013e6b0 0x7f71c01539f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f71b400fe20 tx=0x7f71b4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:34.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71c4a36700 1 -- 172.21.15.19:0/3687699103 reap_dead start 2024-08-17T02:26:34.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 -- 172.21.15.19:0/3687699103 shutdown_connections 2024-08-17T02:26:34.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 -- 172.21.15.19:0/3687699103 >> 172.21.15.19:0/3687699103 conn(0x7f71c00678d0 msgr2=0x7f71c006dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 -- 172.21.15.19:0/3687699103 shutdown_connections 2024-08-17T02:26:34.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f71a5ffb700 1 -- 172.21.15.19:0/3687699103 wait complete. 2024-08-17T02:26:34.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f8f421a9700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f8f1c0015f0 0x7f8f1c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.139+0000 7f8f411a7700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f20060860 0x7f8f20062d10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8f34004290 tx=0x7f8f34001650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7ffb68068aa0 msgr2=0x7ffb6806aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7ffb68068aa0 0x7ffb6806aeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7f8f421a9700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f8f1c0015f0 0x7f8f1c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb68060910 msgr2=0x7ffb68062dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb68060910 0x7ffb68062dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009a40 tx=0x7ffb80008040 comp rx=0 tx=0).stop 2024-08-17T02:26:34.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 msgr2=0x7ffb8414ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 --2- 172.21.15.19:0/637566437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb840ad7c0 0x7ffb8414ac40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb8406c2d0 tx=0x7ffb74016000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8a5b7700 1 -- 172.21.15.19:0/637566437 reap_dead start 2024-08-17T02:26:34.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 shutdown_connections 2024-08-17T02:26:34.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 >> 172.21.15.19:0/637566437 conn(0x7ffb840678d0 msgr2=0x7ffb84152ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 shutdown_connections 2024-08-17T02:26:34.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7ffb8adb8700 1 -- 172.21.15.19:0/637566437 wait complete. 2024-08-17T02:26:34.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.143+0000 7f8f31ffb700 1 -- 172.21.15.19:0/2093841231 <== osd.6 v2:172.21.15.119:6816/24496 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8f1c006b90 con 0x7f8f1c0015f0 2024-08-17T02:26:34.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.151+0000 7f5f0359e700 1 -- 172.21.15.19:0/1296559525 --> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5f0406f5f0 con 0x7f5ee4068aa0 2024-08-17T02:26:34.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.151+0000 7f5ef27fc700 1 -- 172.21.15.19:0/1296559525 <== osd.1 v2:172.21.15.19:6816/24141 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5f0406f5f0 con 0x7f5ee4068aa0 2024-08-17T02:26:34.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 --> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f536806e530 con 0x7f536814ede0 2024-08-17T02:26:34.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 -- 172.21.15.19:0/1296559525 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f5ee4068aa0 msgr2=0x7f5ee406aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f5ee4068aa0 0x7f5ee406aeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 -- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5ee4060890 msgr2=0x7f5ee4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5ee4060890 0x7f5ee4062d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5f04129810 tx=0x7f5ef4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:34.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 -- 172.21.15.19:0/1296559525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f04127ac0 msgr2=0x7f5f04125670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 --2- 172.21.15.19:0/1296559525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f04127ac0 0x7f5f04125670 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800c3c0 tx=0x7f5ef8015000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 --> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd300b2e30 con 0x7fdd1c068ac0 2024-08-17T02:26:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5f02d9d700 1 -- 172.21.15.19:0/1296559525 reap_dead start 2024-08-17T02:26:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 -- 172.21.15.19:0/1296559525 shutdown_connections 2024-08-17T02:26:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 -- 172.21.15.19:0/1296559525 >> 172.21.15.19:0/1296559525 conn(0x7f5f040678d0 msgr2=0x7f5f040cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 -- 172.21.15.19:0/1296559525 shutdown_connections 2024-08-17T02:26:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f5ee3fff700 1 -- 172.21.15.19:0/1296559525 wait complete. 2024-08-17T02:26:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7f534f7fe700 1 -- 172.21.15.19:0/303420941 <== osd.7 v2:172.21.15.119:6808/24493 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f536806e530 con 0x7f536814ede0 2024-08-17T02:26:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7fdd2cff9700 1 -- 172.21.15.19:0/2931763692 <== osd.5 v2:172.21.15.119:6800/24492 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd300b2e30 con 0x7fdd1c068ac0 2024-08-17T02:26:34.207 INFO:teuthology.orchestra.run.smithi019.stdout:60129542149 2024-08-17T02:26:34.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:26:34.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fdd1c068ac0 msgr2=0x7fdd1c06aed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7fdd36b4a700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fdd1c068ac0 0x7fdd1c06aed0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd1c060930 msgr2=0x7fdd1c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.155+0000 7fdd36b4a700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd1c060930 0x7fdd1c062de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd20006fd0 tx=0x7fdd20009060 comp rx=0 tx=0).stop 2024-08-17T02:26:34.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd30159570 msgr2=0x7fdd300aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fdd36b4a700 1 --2- 172.21.15.19:0/2931763692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd30159570 0x7fdd300aea90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400d8c0 tx=0x7fdd24008040 comp rx=0 tx=0).stop 2024-08-17T02:26:34.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fdd350e7700 1 -- 172.21.15.19:0/2931763692 reap_dead start 2024-08-17T02:26:34.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 shutdown_connections 2024-08-17T02:26:34.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 >> 172.21.15.19:0/2931763692 conn(0x7fdd300996f0 msgr2=0x7fdd300cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 shutdown_connections 2024-08-17T02:26:34.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fdd36b4a700 1 -- 172.21.15.19:0/2931763692 wait complete. 2024-08-17T02:26:34.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 --> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe084070360 con 0x7fe068068b40 2024-08-17T02:26:34.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe07a7fc700 1 -- 172.21.15.19:0/1066185276 <== osd.4 v2:172.21.15.119:6824/24494 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe084070360 con 0x7fe068068b40 2024-08-17T02:26:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7fe068068b40 msgr2=0x7fe06806af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7fe068068b40 0x7fe06806af50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe068060930 msgr2=0x7fe068062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe068060930 0x7fe068062de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe074009bb0 tx=0x7fe0740091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0841593b0 msgr2=0x7fe0840c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 --2- 172.21.15.19:0/1066185276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0841593b0 0x7fe0840c66c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe080006b00 tx=0x7fe080008040 comp rx=0 tx=0).stop 2024-08-17T02:26:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08aa99700 1 -- 172.21.15.19:0/1066185276 reap_dead start 2024-08-17T02:26:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 shutdown_connections 2024-08-17T02:26:34.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 >> 172.21.15.19:0/1066185276 conn(0x7fe084068300 msgr2=0x7fe084158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 --> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77bc005c80 con 0x7f77bc0015f0 2024-08-17T02:26:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 shutdown_connections 2024-08-17T02:26:34.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7fe08c4fc700 1 -- 172.21.15.19:0/1066185276 wait complete. 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.159+0000 7f77d8ff9700 1 -- 172.21.15.19:0/1351951650 <== osd.2 v2:172.21.15.19:6805/24142 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77bc005c80 con 0x7f77bc0015f0 2024-08-17T02:26:34.214 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-08-17T02:26:34.215 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:26:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7f77bc0015f0 msgr2=0x7f77bc003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f77e2e25700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7f77bc0015f0 0x7f77bc003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7f536814ede0 msgr2=0x7f53680a5cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f536de22700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7f536814ede0 0x7f53680a5cf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f77c8060930 msgr2=0x7f77c8062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f77e2e25700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f77c8060930 0x7f77c8062de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f77dc16ee30 tx=0x7f77d4009780 comp rx=0 tx=0).stop 2024-08-17T02:26:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc0aab50 msgr2=0x7f77dc157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f77e2e25700 1 --2- 172.21.15.19:0/1351951650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77dc0aab50 0x7f77dc157550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77dc068da0 tx=0x7f77d0016000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 --> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f1c005c80 con 0x7f8f1c0015f0 2024-08-17T02:26:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5354060860 msgr2=0x7f5354062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f536de22700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5354060860 0x7f5354062d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5360000f80 tx=0x7f5360007ea0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53680ad270 msgr2=0x7f536816e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f536de22700 1 --2- 172.21.15.19:0/303420941 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53680ad270 0x7f536816e630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f535800c790 tx=0x7f5358007df0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f5367fff700 1 -- 172.21.15.19:0/303420941 reap_dead start 2024-08-17T02:26:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f77e13c2700 1 -- 172.21.15.19:0/1351951650 reap_dead start 2024-08-17T02:26:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 shutdown_connections 2024-08-17T02:26:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.163+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 >> 172.21.15.19:0/1351951650 conn(0x7f77dc068300 msgr2=0x7f77dc0ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 shutdown_connections 2024-08-17T02:26:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 >> 172.21.15.19:0/303420941 conn(0x7f53680cd160 msgr2=0x7f536806b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 shutdown_connections 2024-08-17T02:26:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f536de22700 1 -- 172.21.15.19:0/303420941 wait complete. 2024-08-17T02:26:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f31ffb700 1 -- 172.21.15.19:0/2093841231 <== osd.6 v2:172.21.15.119:6816/24496 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8f1c005c80 con 0x7f8f1c0015f0 2024-08-17T02:26:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f8f1c0015f0 msgr2=0x7f8f1c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f8f1c0015f0 0x7f8f1c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f20060860 msgr2=0x7f8f20062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8f20060860 0x7f8f20062d10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8f34004290 tx=0x7f8f34001650 comp rx=0 tx=0).stop 2024-08-17T02:26:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c0b1950 msgr2=0x7f8f3c167d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 --2- 172.21.15.19:0/2093841231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f3c0b1950 0x7f8f3c167d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8f38013fd0 tx=0x7f8f38020000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f421a9700 1 -- 172.21.15.19:0/2093841231 reap_dead start 2024-08-17T02:26:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 shutdown_connections 2024-08-17T02:26:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 >> 172.21.15.19:0/2093841231 conn(0x7f8f3c0678d0 msgr2=0x7f8f3c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 shutdown_connections 2024-08-17T02:26:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.167+0000 7f8f43c0c700 1 -- 172.21.15.19:0/2093841231 wait complete. 2024-08-17T02:26:34.221 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-08-17T02:26:34.222 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:26:34.222 INFO:teuthology.orchestra.run.smithi019.stdout:60129542149 2024-08-17T02:26:34.223 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:26:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.171+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 shutdown_connections 2024-08-17T02:26:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.171+0000 7f77e2e25700 1 -- 172.21.15.19:0/1351951650 wait complete. 2024-08-17T02:26:34.224 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-08-17T02:26:34.224 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:26:34.225 INFO:teuthology.orchestra.run.smithi019.stdout:60129542149 2024-08-17T02:26:34.225 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:26:34.226 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-08-17T02:26:34.227 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:26:34.227 INFO:teuthology.orchestra.run.smithi019.stdout:60129542152 2024-08-17T02:26:34.228 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:26:34.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc075010700 1 Processor -- start 2024-08-17T02:26:34.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67b59e700 1 Processor -- start 2024-08-17T02:26:34.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc075010700 1 -- start start 2024-08-17T02:26:34.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67b59e700 1 -- start start 2024-08-17T02:26:34.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67b59e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa67c158eb0 0x7fa67c0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67b59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67c06e620 0x7fa67c0ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67b59e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c0ac000 con 0x7fa67c0aecc0 2024-08-17T02:26:34.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67b59e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67c0ab3f0 con 0x7fa67c158eb0 2024-08-17T02:26:34.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67b59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0ab6d0 con 0x7fa67c06e620 2024-08-17T02:26:34.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc075010700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0700b14a0 0x7fc070157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc075010700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0700ad750 0x7fc0700adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc075010700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0701580e0 con 0x7fc070156d80 2024-08-17T02:26:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc075010700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0701577b0 con 0x7fc0700ad750 2024-08-17T02:26:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc075010700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc070157a90 con 0x7fc0700b14a0 2024-08-17T02:26:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa67c158eb0 0x7fa67c0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc07480f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0700ad750 0x7fc0700adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc07480f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0700ad750 0x7fc0700adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:44930/0 (socket says 172.21.15.19:44930) 2024-08-17T02:26:34.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fc07480f700 1 -- 172.21.15.19:0/503375105 learned_addr learned my addr 172.21.15.19:0/503375105 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa67c158eb0 0x7fa67c0aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58424/0 (socket says 172.21.15.19:58424) 2024-08-17T02:26:34.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.407+0000 7fa67a59c700 1 -- 172.21.15.19:0/2852589962 learned_addr learned my addr 172.21.15.19:0/2852589962 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc06f7fe700 1 --2- 172.21.15.19:0/503375105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0700b14a0 0x7fc070157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc07480f700 1 -- 172.21.15.19:0/503375105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0700b14a0 msgr2=0x7fc070157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc07480f700 1 --2- 172.21.15.19:0/503375105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0700b14a0 0x7fc070157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc07480f700 1 -- 172.21.15.19:0/503375105 >> v1:172.21.15.119:6789/0 conn(0x7fc070156d80 legacy=0x7fc0700b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc07480f700 1 -- 172.21.15.19:0/503375105 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070157d70 con 0x7fc0700ad750 2024-08-17T02:26:34.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67a59c700 1 -- 172.21.15.19:0/2852589962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67c06e620 msgr2=0x7fa67c0ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67a59c700 1 --2- 172.21.15.19:0/2852589962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67c06e620 0x7fa67c0ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67a59c700 1 -- 172.21.15.19:0/2852589962 >> v1:172.21.15.119:6789/0 conn(0x7fa67c0aecc0 legacy=0x7fa67c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67a59c700 1 -- 172.21.15.19:0/2852589962 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0ab9b0 con 0x7fa67c158eb0 2024-08-17T02:26:34.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67a59c700 1 --2- 172.21.15.19:0/2852589962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c158eb0 0x7fa67c0aaa80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa674009f20 tx=0x7fa674009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd56bba01d1933e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc07480f700 1 --2- 172.21.15.19:0/503375105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0700ad750 0x7fc0700adbf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc068009f20 tx=0x7fc068009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dab34568f47c15d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67959a700 1 -- 172.21.15.19:0/2852589962 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67400e070 con 0x7fa67c158eb0 2024-08-17T02:26:34.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67959a700 1 -- 172.21.15.19:0/2852589962 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67400ba80 con 0x7fa67c158eb0 2024-08-17T02:26:34.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67959a700 1 -- 172.21.15.19:0/2852589962 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6740092e0 con 0x7fa67c158eb0 2024-08-17T02:26:34.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc06effd700 1 -- 172.21.15.19:0/503375105 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06800e070 con 0x7fc0700ad750 2024-08-17T02:26:34.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc06effd700 1 -- 172.21.15.19:0/503375105 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06800ba80 con 0x7fc0700ad750 2024-08-17T02:26:34.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc06effd700 1 -- 172.21.15.19:0/503375105 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0680092e0 con 0x7fc0700ad750 2024-08-17T02:26:34.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc075010700 1 -- 172.21.15.19:0/503375105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0700ad750 msgr2=0x7fc0700adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc075010700 1 --2- 172.21.15.19:0/503375105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0700ad750 0x7fc0700adbf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc068009f20 tx=0x7fc068009840 comp rx=0 tx=0).stop 2024-08-17T02:26:34.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67b59e700 1 -- 172.21.15.19:0/2852589962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c158eb0 msgr2=0x7fa67c0aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67b59e700 1 --2- 172.21.15.19:0/2852589962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c158eb0 0x7fa67c0aaa80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa674009f20 tx=0x7fa674009840 comp rx=0 tx=0).stop 2024-08-17T02:26:34.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67b59e700 1 -- 172.21.15.19:0/2852589962 shutdown_connections 2024-08-17T02:26:34.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67b59e700 1 --2- 172.21.15.19:0/2852589962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67c06e620 0x7fa67c0ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67b59e700 1 --2- 172.21.15.19:0/2852589962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c158eb0 0x7fa67c0aaa80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67b59e700 1 -- 172.21.15.19:0/2852589962 >> 172.21.15.19:0/2852589962 conn(0x7fa67c0678d0 msgr2=0x7fa67c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc075010700 1 -- 172.21.15.19:0/503375105 shutdown_connections 2024-08-17T02:26:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc075010700 1 --2- 172.21.15.19:0/503375105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0700ad750 0x7fc0700adbf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc075010700 1 --2- 172.21.15.19:0/503375105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0700b14a0 0x7fc070157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc075010700 1 -- 172.21.15.19:0/503375105 >> 172.21.15.19:0/503375105 conn(0x7fc0700678d0 msgr2=0x7fc070067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67b59e700 1 -- 172.21.15.19:0/2852589962 shutdown_connections 2024-08-17T02:26:34.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc075010700 1 -- 172.21.15.19:0/503375105 shutdown_connections 2024-08-17T02:26:34.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fa67b59e700 1 -- 172.21.15.19:0/2852589962 wait complete. 2024-08-17T02:26:34.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7fc075010700 1 -- 172.21.15.19:0/503375105 wait complete. 2024-08-17T02:26:34.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7f7c49940700 1 Processor -- start 2024-08-17T02:26:34.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.411+0000 7f7c49940700 1 -- start start 2024-08-17T02:26:34.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67b59e700 1 Processor -- start 2024-08-17T02:26:34.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc075010700 1 Processor -- start 2024-08-17T02:26:34.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67b59e700 1 -- start start 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc075010700 1 -- start start 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc075010700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0700ad750 0x7fc07016e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc075010700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0700b14a0 0x7fc0700b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc075010700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc070156d80 0x7fc0700aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc075010700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07016e5a0 con 0x7fc0700ad750 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc075010700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070170960 con 0x7fc0700b14a0 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc075010700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700a56f0 con 0x7fc070156d80 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c49940700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c441593b0 0x7f7c4415a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c49940700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c440aab50 0x7f7c440b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c49940700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c440acae0 con 0x7f7c4415a8b0 2024-08-17T02:26:34.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c49940700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c440ac650 con 0x7f7c441593b0 2024-08-17T02:26:34.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67b59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa67c06e620 0x7fa67c149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c49940700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c44159780 con 0x7f7c440aab50 2024-08-17T02:26:34.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c427fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7c4415a8b0 0x7f7c440aa440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33922/0 (socket says 172.21.15.19:33922) 2024-08-17T02:26:34.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c42ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c441593b0 0x7f7c4415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c427fc700 1 -- 172.21.15.19:0/3093326858 learned_addr learned my addr 172.21.15.19:0/3093326858 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:34.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c437fe700 1 --2- 172.21.15.19:0/3093326858 >> v2:172.21.15.119:3300/0 conn(0x7f7c440aab50 0x7f7c440b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c42ffd700 1 -- 172.21.15.19:0/3093326858 >> v2:172.21.15.119:3300/0 conn(0x7f7c440aab50 msgr2=0x7f7c440b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c42ffd700 1 --2- 172.21.15.19:0/3093326858 >> v2:172.21.15.119:3300/0 conn(0x7f7c440aab50 0x7f7c440b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c42ffd700 1 -- 172.21.15.19:0/3093326858 >> v1:172.21.15.19:6789/0 conn(0x7f7c4415a8b0 legacy=0x7f7c440aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c42ffd700 1 -- 172.21.15.19:0/3093326858 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440aba40 con 0x7f7c441593b0 2024-08-17T02:26:34.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c42ffd700 1 --2- 172.21.15.19:0/3093326858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c441593b0 0x7f7c4415a370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c44068b70 tx=0x7f7c380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cf696cf0e89f20 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67b59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c0aecc0 0x7fa67c14cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc07480f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc070156d80 0x7fc0700aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc07480f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc070156d80 0x7fc0700aa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39186/0 (socket says 172.21.15.19:39186) 2024-08-17T02:26:34.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc07480f700 1 -- 172.21.15.19:0/1881855356 learned_addr learned my addr 172.21.15.19:0/1881855356 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67b59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67c158eb0 0x7fa67c14b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc06ffff700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0700ad750 0x7fc07016e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa679d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c0aecc0 0x7fa67c14cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa679d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c0aecc0 0x7fa67c14cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58444/0 (socket says 172.21.15.19:58444) 2024-08-17T02:26:34.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa67c06e620 0x7fa67c149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa679d9b700 1 -- 172.21.15.19:0/2132983330 learned_addr learned my addr 172.21.15.19:0/2132983330 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c14beb0 con 0x7fa67c0aecc0 2024-08-17T02:26:34.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0c9c20 con 0x7fa67c06e620 2024-08-17T02:26:34.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc06f7fe700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0700b14a0 0x7fc0700b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c14c0c0 con 0x7fa67c158eb0 2024-08-17T02:26:34.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c41ffb700 1 -- 172.21.15.19:0/3093326858 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38011630 con 0x7f7c441593b0 2024-08-17T02:26:34.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c41ffb700 1 -- 172.21.15.19:0/3093326858 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c38011790 con 0x7f7c441593b0 2024-08-17T02:26:34.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c41ffb700 1 -- 172.21.15.19:0/3093326858 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38011b30 con 0x7f7c441593b0 2024-08-17T02:26:34.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa2c6e5e700 1 Processor -- start 2024-08-17T02:26:34.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc06ffff700 1 -- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc070156d80 msgr2=0x7fc0700aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc06ffff700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc070156d80 0x7fc0700aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc06ffff700 1 -- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0700b14a0 msgr2=0x7fc0700b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc06ffff700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0700b14a0 0x7fc0700b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc06ffff700 1 -- 172.21.15.19:0/1881855356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068009ae0 con 0x7fc0700ad750 2024-08-17T02:26:34.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa2c6e5e700 1 -- start start 2024-08-17T02:26:34.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fc06ffff700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0700ad750 0x7fc07016e060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c490 tx=0x7fc060007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c49940700 1 -- 172.21.15.19:0/3093326858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c441593b0 msgr2=0x7f7c4415a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7f7c49940700 1 --2- 172.21.15.19:0/3093326858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c441593b0 0x7f7c4415a370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c44068b70 tx=0x7f7c380091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa67ad9d700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67c158eb0 0x7fa67c14b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa679d9b700 1 -- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67c158eb0 msgr2=0x7fa67c14b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa679d9b700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67c158eb0 0x7fa67c14b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa679d9b700 1 -- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa67c06e620 msgr2=0x7fa67c149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa679d9b700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa67c06e620 0x7fa67c149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa679d9b700 1 -- 172.21.15.19:0/2132983330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009ae0 con 0x7fa67c0aecc0 2024-08-17T02:26:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fa679d9b700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c0aecc0 0x7fa67c14cfe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c790 tx=0x7fa670007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fd1f4673700 1 Processor -- start 2024-08-17T02:26:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fd1f4673700 1 -- start start 2024-08-17T02:26:34.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.415+0000 7fd1f4673700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f4673700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec167bd0 con 0x7fd1ec0876e0 2024-08-17T02:26:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f4673700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec166bb0 con 0x7fd1ec087ab0 2024-08-17T02:26:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f4673700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec166e70 con 0x7fd1ec0ac560 2024-08-17T02:26:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f240f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd1ec0876e0 0x7fd1ec1664a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33934/0 (socket says 172.21.15.19:33934) 2024-08-17T02:26:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f240f700 1 -- 172.21.15.19:0/2635824482 learned_addr learned my addr 172.21.15.19:0/2635824482 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c6e5e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2c01593b0 0x7fa2c015a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c6e5e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2c015a8b0 0x7fa2c00aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f2c10700 1 --2- 172.21.15.19:0/2635824482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f140d700 1 -- 172.21.15.19:0/2635824482 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246636524 0 0) 0x7fd1ec167bd0 con 0x7fd1ec0876e0 2024-08-17T02:26:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f140d700 1 -- 172.21.15.19:0/2635824482 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d8003550 con 0x7fd1ec0876e0 2024-08-17T02:26:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c6e5e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c00acae0 con 0x7fa2c00aa980 2024-08-17T02:26:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c6e5e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c00aade0 con 0x7fa2c01593b0 2024-08-17T02:26:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c6e5e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00ac650 con 0x7fa2c015a8b0 2024-08-17T02:26:34.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fc057fff700 1 -- 172.21.15.19:0/1881855356 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06000ce40 con 0x7fc0700ad750 2024-08-17T02:26:34.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fc057fff700 1 -- 172.21.15.19:0/1881855356 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060011590 con 0x7fc0700ad750 2024-08-17T02:26:34.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07014a170 con 0x7fc0700ad750 2024-08-17T02:26:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa66a7fc700 1 -- 172.21.15.19:0/2132983330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670011590 con 0x7fa67c0aecc0 2024-08-17T02:26:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa66a7fc700 1 -- 172.21.15.19:0/2132983330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6700116f0 con 0x7fa67c0aecc0 2024-08-17T02:26:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa66a7fc700 1 -- 172.21.15.19:0/2132983330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670011ab0 con 0x7fa67c0aecc0 2024-08-17T02:26:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07014a730 con 0x7fc0700ad750 2024-08-17T02:26:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c4bfa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2c01593b0 0x7fa2c015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fc057fff700 1 -- 172.21.15.19:0/1881855356 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060011950 con 0x7fc0700ad750 2024-08-17T02:26:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e89378700 1 Processor -- start 2024-08-17T02:26:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c4bfa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2c01593b0 0x7fa2c015a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58458/0 (socket says 172.21.15.19:58458) 2024-08-17T02:26:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c4bfa700 1 -- 172.21.15.19:0/1315592262 learned_addr learned my addr 172.21.15.19:0/1315592262 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f140d700 1 -- 172.21.15.19:0/2635824482 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059638168 0 0) 0x7fd1ec166bb0 con 0x7fd1ec087ab0 2024-08-17T02:26:34.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f140d700 1 -- 172.21.15.19:0/2635824482 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec167bd0 con 0x7fd1ec087ab0 2024-08-17T02:26:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c4bfa700 1 -- 172.21.15.19:0/1315592262 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2c015a8b0 msgr2=0x7fa2c00aa440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:26:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c4bfa700 1 --2- 172.21.15.19:0/1315592262 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2c015a8b0 0x7fa2c00aa440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c4bfa700 1 -- 172.21.15.19:0/1315592262 >> v1:172.21.15.19:6789/0 conn(0x7fa2c00aa980 legacy=0x7fa2c00b0d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c4bfa700 1 -- 172.21.15.19:0/1315592262 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0159780 con 0x7fa2c01593b0 2024-08-17T02:26:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f2c10700 1 -- 172.21.15.19:0/2635824482 >> v1:172.21.15.119:6789/0 conn(0x7fd1ec087ab0 legacy=0x7fd1ec0abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f140d700 1 -- 172.21.15.19:0/2635824482 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537675824 0 0) 0x7fd1ec167bd0 con 0x7fd1ec087ab0 2024-08-17T02:26:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f2c10700 1 -- 172.21.15.19:0/2635824482 >> v1:172.21.15.19:6789/0 conn(0x7fd1ec0876e0 legacy=0x7fd1ec1664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2c4bfa700 1 --2- 172.21.15.19:0/1315592262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c01593b0 0x7fa2c015a370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009c10 tx=0x7fa2b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab90a76e9dce63 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f041ffff700 1 Processor -- start 2024-08-17T02:26:34.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f7c49940700 1 -- 172.21.15.19:0/3093326858 shutdown_connections 2024-08-17T02:26:34.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f7c49940700 1 --2- 172.21.15.19:0/3093326858 >> v2:172.21.15.119:3300/0 conn(0x7f7c440aab50 0x7f7c440b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f7c49940700 1 --2- 172.21.15.19:0/3093326858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c441593b0 0x7f7c4415a370 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f7c49940700 1 -- 172.21.15.19:0/3093326858 >> 172.21.15.19:0/3093326858 conn(0x7f7c44068300 msgr2=0x7f7c440a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f7c49940700 1 -- 172.21.15.19:0/3093326858 shutdown_connections 2024-08-17T02:26:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f2c10700 1 -- 172.21.15.19:0/2635824482 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec167150 con 0x7fd1ec0ac560 2024-08-17T02:26:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0500052b0 con 0x7fc0700ad750 2024-08-17T02:26:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e89378700 1 -- start start 2024-08-17T02:26:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e89378700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e84155670 0x7f0e8406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e89378700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413ea80 0x7f0e8406e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e89378700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e84156700 con 0x7f0e8413e6b0 2024-08-17T02:26:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e89378700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e84155af0 con 0x7f0e84155670 2024-08-17T02:26:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e89378700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e84155dd0 con 0x7f0e8413ea80 2024-08-17T02:26:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fd1f2c10700 1 --2- 172.21.15.19:0/2635824482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec0b0d40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4007c40 tx=0x7fd1e4007550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb9a7f0049a8c545 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f7c49940700 1 -- 172.21.15.19:0/3093326858 wait complete. 2024-08-17T02:26:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c14c3a0 con 0x7fa67c0aecc0 2024-08-17T02:26:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c0c98b0 con 0x7fa67c0aecc0 2024-08-17T02:26:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e83fff700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0e8413e6b0 0x7f0e840b1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:32914/0 (socket says 172.21.15.19:32914) 2024-08-17T02:26:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e83fff700 1 -- 172.21.15.19:0/2519943117 learned_addr learned my addr 172.21.15.19:0/2519943117 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e837fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e84155670 0x7f0e8406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e88b77700 1 --2- 172.21.15.19:0/2519943117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413ea80 0x7f0e8406e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e82ffd700 1 -- 172.21.15.19:0/2519943117 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246985119 0 0) 0x7f0e84156700 con 0x7f0e8413e6b0 2024-08-17T02:26:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e82ffd700 1 -- 172.21.15.19:0/2519943117 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e6c003570 con 0x7f0e8413e6b0 2024-08-17T02:26:34.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e837fe700 1 -- 172.21.15.19:0/2519943117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413ea80 msgr2=0x7f0e8406e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e837fe700 1 --2- 172.21.15.19:0/2519943117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413ea80 0x7f0e8406e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e837fe700 1 -- 172.21.15.19:0/2519943117 >> v1:172.21.15.119:6789/0 conn(0x7f0e8413e6b0 legacy=0x7f0e840b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e837fe700 1 -- 172.21.15.19:0/2519943117 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e841560b0 con 0x7f0e84155670 2024-08-17T02:26:34.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f041ffff700 1 -- start start 2024-08-17T02:26:34.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f041ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042006e620 0x7f04200b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f041ffff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0420141a00 con 0x7f04200b1630 2024-08-17T02:26:34.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f041ffff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0420140b10 con 0x7f04200b0d20 2024-08-17T02:26:34.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f041ffff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0420140df0 con 0x7f042006e620 2024-08-17T02:26:34.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f7c49940700 1 Processor -- start 2024-08-17T02:26:34.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f0e837fe700 1 --2- 172.21.15.19:0/2519943117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e84155670 0x7f0e8406df10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e780098e0 tx=0x7f0e780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee5f68a7ba37b10 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f041f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f04200b1630 0x7f0420141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33946/0 (socket says 172.21.15.19:33946) 2024-08-17T02:26:34.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7f041f7fe700 1 -- 172.21.15.19:0/603675449 learned_addr learned my addr 172.21.15.19:0/603675449 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:34.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2bf7fe700 1 -- 172.21.15.19:0/1315592262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400b7c0 con 0x7fa2c01593b0 2024-08-17T02:26:34.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2bf7fe700 1 -- 172.21.15.19:0/1315592262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b400b920 con 0x7fa2c01593b0 2024-08-17T02:26:34.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.419+0000 7fa2bf7fe700 1 -- 172.21.15.19:0/1315592262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400bcc0 con 0x7fa2c01593b0 2024-08-17T02:26:34.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/1315592262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c01593b0 msgr2=0x7fa2c015a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 --2- 172.21.15.19:0/1315592262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c01593b0 0x7fa2c015a370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009c10 tx=0x7fa2b4009250 comp rx=0 tx=0).stop 2024-08-17T02:26:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fd1f140d700 1 -- 172.21.15.19:0/2635824482 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc001450 con 0x7fd1ec0ac560 2024-08-17T02:26:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fd1f140d700 1 -- 172.21.15.19:0/2635824482 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e400c930 con 0x7fd1ec0ac560 2024-08-17T02:26:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fd1f140d700 1 -- 172.21.15.19:0/2635824482 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400ccb0 con 0x7fd1ec0ac560 2024-08-17T02:26:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fc057fff700 1 -- 172.21.15.19:0/1881855356 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc060011cc0 con 0x7fc0700ad750 2024-08-17T02:26:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fc057fff700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc05c060930 0x7fc05c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041e7fc700 1 --2- 172.21.15.19:0/603675449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042006e620 0x7f04200b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041e7fc700 1 -- 172.21.15.19:0/603675449 >> v1:172.21.15.119:6789/0 conn(0x7f04200b0d20 legacy=0x7f042006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041e7fc700 1 -- 172.21.15.19:0/603675449 >> v1:172.21.15.19:6789/0 conn(0x7f04200b1630 legacy=0x7f0420141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041e7fc700 1 -- 172.21.15.19:0/603675449 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04201410d0 con 0x7f042006e620 2024-08-17T02:26:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fc057fff700 1 -- 172.21.15.19:0/1881855356 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc06007c240 con 0x7fc0700ad750 2024-08-17T02:26:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fc06f7fe700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc05c060930 0x7fc05c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa66a7fc700 1 -- 172.21.15.19:0/2132983330 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa67001b3b0 con 0x7fa67c0aecc0 2024-08-17T02:26:34.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c49940700 1 -- start start 2024-08-17T02:26:34.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c49940700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c440aab50 0x7f7c44175d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/1315592262 shutdown_connections 2024-08-17T02:26:34.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 --2- 172.21.15.19:0/1315592262 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2c015a8b0 0x7fa2c00aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 --2- 172.21.15.19:0/1315592262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c01593b0 0x7fa2c015a370 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/1315592262 >> 172.21.15.19:0/1315592262 conn(0x7fa2c0068300 msgr2=0x7fa2c00a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c49940700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c441593b0 0x7f7c44096b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c49940700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4415a8b0 0x7f7c440970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fd1f4673700 1 -- 172.21.15.19:0/2635824482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 msgr2=0x7fd1ec0b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fd1f4673700 1 --2- 172.21.15.19:0/2635824482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec0b0d40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4007c40 tx=0x7fd1e4007550 comp rx=0 tx=0).stop 2024-08-17T02:26:34.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041e7fc700 1 --2- 172.21.15.19:0/603675449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042006e620 0x7f04200b10f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0418009e90 tx=0x7f0418009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b01cd5a5ac4a48 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c42ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c440aab50 0x7f7c44175d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa66a7fc700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa65c060930 0x7fa65c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/1315592262 shutdown_connections 2024-08-17T02:26:34.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c42ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c440aab50 0x7f7c44175d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39234/0 (socket says 172.21.15.19:39234) 2024-08-17T02:26:34.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c437fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4415a8b0 0x7f7c440970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c437fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4415a8b0 0x7f7c440970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58470/0 (socket says 172.21.15.19:58470) 2024-08-17T02:26:34.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c427fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c441593b0 0x7f7c44096b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c42ffd700 1 -- 172.21.15.19:0/1845890970 learned_addr learned my addr 172.21.15.19:0/1845890970 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c0643a0 con 0x7fa67c0aecc0 2024-08-17T02:26:34.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/1315592262 wait complete. 2024-08-17T02:26:34.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041dffb700 1 -- 172.21.15.19:0/603675449 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800e070 con 0x7f042006e620 2024-08-17T02:26:34.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f3b3302b700 1 Processor -- start 2024-08-17T02:26:34.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fd1f4673700 1 -- 172.21.15.19:0/2635824482 shutdown_connections 2024-08-17T02:26:34.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fd1f4673700 1 --2- 172.21.15.19:0/2635824482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec0b0d40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fd1f4673700 1 -- 172.21.15.19:0/2635824482 >> 172.21.15.19:0/2635824482 conn(0x7fd1ec068300 msgr2=0x7fd1ec0a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa67a59c700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa65c060930 0x7fa65c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041dffb700 1 -- 172.21.15.19:0/603675449 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041800bc30 con 0x7f042006e620 2024-08-17T02:26:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f3b3302b700 1 -- start start 2024-08-17T02:26:34.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa67a59c700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa65c060930 0x7fa65c062de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa674009880 tx=0x7fa674018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041ffff700 1 -- 172.21.15.19:0/603675449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042006e620 msgr2=0x7f04200b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041ffff700 1 --2- 172.21.15.19:0/603675449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042006e620 0x7f04200b10f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0418009e90 tx=0x7f0418009780 comp rx=0 tx=0).stop 2024-08-17T02:26:34.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041ffff700 1 -- 172.21.15.19:0/603675449 shutdown_connections 2024-08-17T02:26:34.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041ffff700 1 --2- 172.21.15.19:0/603675449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042006e620 0x7f04200b10f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041ffff700 1 -- 172.21.15.19:0/603675449 >> 172.21.15.19:0/603675449 conn(0x7f04200678d0 msgr2=0x7f0420067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041ffff700 1 -- 172.21.15.19:0/603675449 shutdown_connections 2024-08-17T02:26:34.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f041ffff700 1 -- 172.21.15.19:0/603675449 wait complete. 2024-08-17T02:26:34.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f3b3302b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3b2c06e620 0x7f3b2c164000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 Processor -- start 2024-08-17T02:26:34.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440cb250 con 0x7f7c4415a8b0 2024-08-17T02:26:34.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440ca640 con 0x7f7c441593b0 2024-08-17T02:26:34.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440ca920 con 0x7f7c440aab50 2024-08-17T02:26:34.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c437fe700 1 -- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c440aab50 msgr2=0x7f7c44175d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c437fe700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c440aab50 0x7f7c44175d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c437fe700 1 -- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c441593b0 msgr2=0x7f7c44096b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c437fe700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c441593b0 0x7f7c44096b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c437fe700 1 -- 172.21.15.19:0/1845890970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c38009420 con 0x7f7c4415a8b0 2024-08-17T02:26:34.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f7c437fe700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4415a8b0 0x7f7c440970c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400e950 tx=0x7f7c340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7fa2c6e5e700 1 -- start start 2024-08-17T02:26:34.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f3b3302b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0ad380 con 0x7f3b2c158fb0 2024-08-17T02:26:34.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f3b3302b700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0ab2d0 con 0x7f3b2c15d910 2024-08-17T02:26:34.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f3b3302b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c0ab5b0 con 0x7f3b2c06e620 2024-08-17T02:26:34.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f3b32029700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3b2c158fb0 0x7f3b2c0aaa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33948/0 (socket says 172.21.15.19:33948) 2024-08-17T02:26:34.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.423+0000 7f3b32029700 1 -- 172.21.15.19:0/1443685480 learned_addr learned my addr 172.21.15.19:0/1443685480 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:34.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fc06f7fe700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc05c060930 0x7fc05c062de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc07014b7f0 tx=0x7fc064008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 Processor -- start 2024-08-17T02:26:34.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fd1f4673700 1 -- 172.21.15.19:0/2635824482 shutdown_connections 2024-08-17T02:26:34.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 -- start start 2024-08-17T02:26:34.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c6e5e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2c00aa980 0x7fa2c0098c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c6e5e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2c01593b0 0x7fa2c01571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c6e5e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c015a8b0 0x7fa2c01714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c6e5e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00996d0 con 0x7fa2c015a8b0 2024-08-17T02:26:34.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c6e5e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c92d0 con 0x7fa2c01593b0 2024-08-17T02:26:34.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c6e5e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c00c89a0 con 0x7fa2c00aa980 2024-08-17T02:26:34.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f3b3282a700 1 --2- 172.21.15.19:0/1443685480 >> v2:172.21.15.19:3300/0 conn(0x7f3b2c06e620 0x7f3b2c164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c53fb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c015a8b0 0x7fa2c01714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c53fb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c015a8b0 0x7fa2c01714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58488/0 (socket says 172.21.15.19:58488) 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c53fb700 1 -- 172.21.15.19:0/965829378 learned_addr learned my addr 172.21.15.19:0/965829378 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c4bfa700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2c00aa980 0x7fa2c0098c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2bffff700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2c01593b0 0x7fa2c01571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c53fb700 1 -- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2c00aa980 msgr2=0x7fa2c0098c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c53fb700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2c00aa980 0x7fa2c0098c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c53fb700 1 -- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2c01593b0 msgr2=0x7fa2c01571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c53fb700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2c01593b0 0x7fa2c01571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c53fb700 1 -- 172.21.15.19:0/965829378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b40094f0 con 0x7fa2c015a8b0 2024-08-17T02:26:34.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042006e620 0x7f042013ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04200b0d20 0x7f0420157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04200b1630 0x7f0420069d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0420159300 con 0x7f04200b0d20 2024-08-17T02:26:34.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04201404a0 con 0x7f042006e620 2024-08-17T02:26:34.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04201586f0 con 0x7f04200b1630 2024-08-17T02:26:34.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f3b3282a700 1 -- 172.21.15.19:0/1443685480 >> v1:172.21.15.119:6789/0 conn(0x7f3b2c15d910 legacy=0x7f3b2c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f3b3282a700 1 -- 172.21.15.19:0/1443685480 >> v1:172.21.15.19:6789/0 conn(0x7f3b2c158fb0 legacy=0x7f3b2c0aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fd1f4673700 1 -- 172.21.15.19:0/2635824482 wait complete. 2024-08-17T02:26:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f3b3282a700 1 -- 172.21.15.19:0/1443685480 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0ab890 con 0x7f3b2c06e620 2024-08-17T02:26:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c53fb700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c015a8b0 0x7fa2c01714b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800bc60 tx=0x7fa2b8009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2bffff700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2c01593b0 0x7fa2c01571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:34.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04200b0d20 0x7f0420157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f3b3282a700 1 --2- 172.21.15.19:0/1443685480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c06e620 0x7f3b2c164000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009de0 tx=0x7f3b24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3275265c087ee1a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04200b0d20 0x7f0420157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58494/0 (socket says 172.21.15.19:58494) 2024-08-17T02:26:34.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041e7fc700 1 -- 172.21.15.19:0/3281162151 learned_addr learned my addr 172.21.15.19:0/3281162151 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041effd700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042006e620 0x7f042013ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041f7fe700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04200b1630 0x7f0420069d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f3b31027700 1 -- 172.21.15.19:0/1443685480 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400e070 con 0x7f3b2c06e620 2024-08-17T02:26:34.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2bcff9700 1 -- 172.21.15.19:0/965829378 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800c8f0 con 0x7fa2c015a8b0 2024-08-17T02:26:34.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f0e82ffd700 1 -- 172.21.15.19:0/2519943117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780108a0 con 0x7f0e84155670 2024-08-17T02:26:34.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041f7fe700 1 -- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042006e620 msgr2=0x7f042013ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c00c8c80 con 0x7fa2c015a8b0 2024-08-17T02:26:34.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c00992f0 con 0x7fa2c015a8b0 2024-08-17T02:26:34.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041f7fe700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042006e620 0x7f042013ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041f7fe700 1 -- 172.21.15.19:0/3281162151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04200b0d20 msgr2=0x7f0420157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041f7fe700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04200b0d20 0x7f0420157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041f7fe700 1 -- 172.21.15.19:0/3281162151 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009a20 con 0x7f04200b1630 2024-08-17T02:26:34.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041effd700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042006e620 0x7f042013ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:34.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f7c2affd700 1 -- 172.21.15.19:0/1845890970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34013680 con 0x7f7c4415a8b0 2024-08-17T02:26:34.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c440cac00 con 0x7f7c4415a8b0 2024-08-17T02:26:34.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c440ca2f0 con 0x7f7c4415a8b0 2024-08-17T02:26:34.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041f7fe700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04200b1630 0x7f0420069d60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f041400c560 tx=0x7f0414007e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fc057fff700 1 -- 172.21.15.19:0/1881855356 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc06004c6f0 con 0x7fc0700ad750 2024-08-17T02:26:34.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fd1f4673700 1 Processor -- start 2024-08-17T02:26:34.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fd1f4673700 1 -- start start 2024-08-17T02:26:34.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f0406ffd700 1 -- 172.21.15.19:0/3281162151 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414005b30 con 0x7f04200b1630 2024-08-17T02:26:34.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04201589d0 con 0x7f04200b1630 2024-08-17T02:26:34.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f0406ffd700 1 -- 172.21.15.19:0/3281162151 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414005c90 con 0x7f04200b1630 2024-08-17T02:26:34.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f0406ffd700 1 -- 172.21.15.19:0/3281162151 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414007320 con 0x7f04200b1630 2024-08-17T02:26:34.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0420158f90 con 0x7f04200b1630 2024-08-17T02:26:34.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c00c9460 con 0x7fa2c015a8b0 2024-08-17T02:26:34.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.427+0000 7fa66a7fc700 1 -- 172.21.15.19:0/2132983330 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa670011ea0 con 0x7fa67c0aecc0 2024-08-17T02:26:34.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0420159440 con 0x7f04200b1630 2024-08-17T02:26:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f4673700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1ec0876e0 0x7fd1ec17b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f4673700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1ec087ab0 0x7fd1ec1872c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f4673700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec187800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f4673700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec1653e0 con 0x7fd1ec0876e0 2024-08-17T02:26:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f4673700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec187ea0 con 0x7fd1ec087ab0 2024-08-17T02:26:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f4673700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ec188180 con 0x7fd1ec0ac560 2024-08-17T02:26:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f240f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1ec0876e0 0x7fd1ec17b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f240f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1ec0876e0 0x7fd1ec17b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58508/0 (socket says 172.21.15.19:58508) 2024-08-17T02:26:34.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f240f700 1 -- 172.21.15.19:0/3087082107 learned_addr learned my addr 172.21.15.19:0/3087082107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c440cb400 con 0x7f7c4415a8b0 2024-08-17T02:26:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f2c10700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec187800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f1c0e700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1ec087ab0 0x7fd1ec1872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f240f700 1 -- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 msgr2=0x7fd1ec187800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f240f700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec187800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f240f700 1 -- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1ec087ab0 msgr2=0x7fd1ec1872c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f240f700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1ec087ab0 0x7fd1ec1872c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f240f700 1 -- 172.21.15.19:0/3087082107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e40077d0 con 0x7fd1ec0876e0 2024-08-17T02:26:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f2c10700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec187800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7fd1f240f700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1ec0876e0 0x7fd1ec17b010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80011e0 tx=0x7fd1e8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7f0406ffd700 1 -- 172.21.15.19:0/3281162151 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f041401b3b0 con 0x7f04200b1630 2024-08-17T02:26:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7f0406ffd700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f040c060860 0x7f040c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7f0406ffd700 1 -- 172.21.15.19:0/3281162151 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f041407c1b0 con 0x7f04200b1630 2024-08-17T02:26:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7f041effd700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f040c060860 0x7f040c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7f041effd700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f040c060860 0x7f040c062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0410001dc0 tx=0x7f0410009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7f0e82ffd700 1 -- 172.21.15.19:0/2519943117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e78010a00 con 0x7f0e84155670 2024-08-17T02:26:34.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.431+0000 7f0e82ffd700 1 -- 172.21.15.19:0/2519943117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78010d80 con 0x7f0e84155670 2024-08-17T02:26:34.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f7c2affd700 1 -- 172.21.15.19:0/1845890970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34005a00 con 0x7f7c4415a8b0 2024-08-17T02:26:34.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f7c2affd700 1 -- 172.21.15.19:0/1845890970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34005b90 con 0x7f7c4415a8b0 2024-08-17T02:26:34.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7fa2bcff9700 1 -- 172.21.15.19:0/965829378 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b8009960 con 0x7fa2c015a8b0 2024-08-17T02:26:34.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7fa2bcff9700 1 -- 172.21.15.19:0/965829378 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800cc60 con 0x7fa2c015a8b0 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7fa66a7fc700 1 -- 172.21.15.19:0/2132983330 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa670017020 con 0x7fa67c0aecc0 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b31027700 1 -- 172.21.15.19:0/1443685480 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400bbb0 con 0x7f3b2c06e620 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b31027700 1 -- 172.21.15.19:0/1443685480 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24012430 con 0x7f3b2c06e620 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 -- 172.21.15.19:0/2519943117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e84155670 msgr2=0x7f0e8406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 --2- 172.21.15.19:0/2519943117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e84155670 0x7f0e8406df10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e780098e0 tx=0x7f0e780091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 -- 172.21.15.19:0/1443685480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c06e620 msgr2=0x7f3b2c164000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 --2- 172.21.15.19:0/1443685480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c06e620 0x7f3b2c164000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009de0 tx=0x7f3b24009780 comp rx=0 tx=0).stop 2024-08-17T02:26:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 -- 172.21.15.19:0/2519943117 shutdown_connections 2024-08-17T02:26:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 --2- 172.21.15.19:0/2519943117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413ea80 0x7f0e8406e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 --2- 172.21.15.19:0/2519943117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e84155670 0x7f0e8406df10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 -- 172.21.15.19:0/2519943117 >> 172.21.15.19:0/2519943117 conn(0x7f0e840678d0 msgr2=0x7f0e84067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 -- 172.21.15.19:0/2519943117 shutdown_connections 2024-08-17T02:26:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 -- 172.21.15.19:0/2519943117 wait complete. 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 -- 172.21.15.19:0/1443685480 shutdown_connections 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 --2- 172.21.15.19:0/1443685480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c06e620 0x7f3b2c164000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 -- 172.21.15.19:0/1443685480 >> 172.21.15.19:0/1443685480 conn(0x7f3b2c0678d0 msgr2=0x7f3b2c067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 -- 172.21.15.19:0/1443685480 shutdown_connections 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 -- 172.21.15.19:0/1443685480 wait complete. 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 Processor -- start 2024-08-17T02:26:34.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 -- start start 2024-08-17T02:26:34.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 Processor -- start 2024-08-17T02:26:34.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f0e89378700 1 -- start start 2024-08-17T02:26:34.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b2c06e620 0x7f3b2c14a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c158fb0 0x7f3b2c0c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b2c15d910 0x7f3b2c06a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c14add0 con 0x7f3b2c158fb0 2024-08-17T02:26:34.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0ca680 con 0x7f3b2c15d910 2024-08-17T02:26:34.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b3302b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0c9a70 con 0x7f3b2c06e620 2024-08-17T02:26:34.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b32029700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b2c06e620 0x7f3b2c14a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b32029700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b2c06e620 0x7f3b2c14a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39278/0 (socket says 172.21.15.19:39278) 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.435+0000 7f3b32029700 1 -- 172.21.15.19:0/3667124635 learned_addr learned my addr 172.21.15.19:0/3667124635 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b31828700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c158fb0 0x7f3b2c0c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b32029700 1 -- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b2c15d910 msgr2=0x7f3b2c06a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b32029700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b2c15d910 0x7f3b2c06a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b32029700 1 -- 172.21.15.19:0/3667124635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c158fb0 msgr2=0x7f3b2c0c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b32029700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c158fb0 0x7f3b2c0c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b32029700 1 -- 172.21.15.19:0/3667124635 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24009a20 con 0x7f3b2c06e620 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b31828700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c158fb0 0x7f3b2c0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e89378700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413e6b0 0x7f0e840c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e89378700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8413ea80 0x7f0e84168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e89378700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e84168ab0 0x7f0e84154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e89378700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840c5b30 con 0x7f0e8413ea80 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e89378700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840c78c0 con 0x7f0e84168ab0 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e89378700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e84169110 con 0x7f0e8413e6b0 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e83fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413e6b0 0x7f0e840c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e83fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413e6b0 0x7f0e840c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39292/0 (socket says 172.21.15.19:39292) 2024-08-17T02:26:34.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e83fff700 1 -- 172.21.15.19:0/596760144 learned_addr learned my addr 172.21.15.19:0/596760144 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:34.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b32029700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b2c06e620 0x7f3b2c14a890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c7c0 tx=0x7f3b1c007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0406ffd700 1 -- 172.21.15.19:0/3281162151 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f041404c600 con 0x7f04200b1630 2024-08-17T02:26:34.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b227fc700 1 -- 172.21.15.19:0/3667124635 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c005b30 con 0x7f3b2c06e620 2024-08-17T02:26:34.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e83fff700 1 -- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e84168ab0 msgr2=0x7f0e84154500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:34.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e83fff700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e84168ab0 0x7f0e84154500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e83fff700 1 -- 172.21.15.19:0/596760144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8413ea80 msgr2=0x7f0e84168570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e83fff700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8413ea80 0x7f0e84168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e83fff700 1 -- 172.21.15.19:0/596760144 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e78009420 con 0x7f0e8413e6b0 2024-08-17T02:26:34.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c0c9d50 con 0x7f3b2c06e620 2024-08-17T02:26:34.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c0ca310 con 0x7f3b2c06e620 2024-08-17T02:26:34.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b227fc700 1 -- 172.21.15.19:0/3667124635 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c005cb0 con 0x7f3b2c06e620 2024-08-17T02:26:34.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f3b227fc700 1 -- 172.21.15.19:0/3667124635 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c007320 con 0x7f3b2c06e620 2024-08-17T02:26:34.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7fa2bcff9700 1 -- 172.21.15.19:0/965829378 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa2b8014410 con 0x7fa2c015a8b0 2024-08-17T02:26:34.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7fa2bcff9700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa2ac060860 0x7fa2ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7fa2bcff9700 1 -- 172.21.15.19:0/965829378 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2b807d290 con 0x7fa2c015a8b0 2024-08-17T02:26:34.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f0e83fff700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413e6b0 0x7f0e840c7380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00ccf0 tx=0x7f0e7c001a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.443+0000 7fa2c4bfa700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa2ac060860 0x7fa2ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.443+0000 7fa2c4bfa700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa2ac060860 0x7fa2ac062d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009c10 tx=0x7fa2b4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.443+0000 7f3b227fc700 1 -- 172.21.15.19:0/3667124635 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3b1c007690 con 0x7f3b2c06e620 2024-08-17T02:26:34.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.443+0000 7f3b227fc700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b10060960 0x7f3b10062e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.443+0000 7f3b227fc700 1 -- 172.21.15.19:0/3667124635 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b1c07bf60 con 0x7f3b2c06e620 2024-08-17T02:26:34.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.443+0000 7f3b31828700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b10060960 0x7f3b10062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f7c2affd700 1 -- 172.21.15.19:0/1845890970 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7c340139f0 con 0x7f7c4415a8b0 2024-08-17T02:26:34.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f7c2affd700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7c30060860 0x7f7c30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f7c2affd700 1 -- 172.21.15.19:0/1845890970 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c3407cf70 con 0x7f7c4415a8b0 2024-08-17T02:26:34.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f7c42ffd700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7c30060860 0x7f7c30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f7c2affd700 1 -- 172.21.15.19:0/1845890970 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7c3404d3c0 con 0x7f7c4415a8b0 2024-08-17T02:26:34.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.439+0000 7f7c42ffd700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7c30060860 0x7f7c30062d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c380091e0 tx=0x7f7c38017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fd1e27fc700 1 -- 172.21.15.19:0/3087082107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8005b30 con 0x7fd1ec0876e0 2024-08-17T02:26:34.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fd1e27fc700 1 -- 172.21.15.19:0/3087082107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8005c90 con 0x7fd1ec0876e0 2024-08-17T02:26:34.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec188460 con 0x7fd1ec0876e0 2024-08-17T02:26:34.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fd1e27fc700 1 -- 172.21.15.19:0/3087082107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80072e0 con 0x7fd1ec0876e0 2024-08-17T02:26:34.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec188a20 con 0x7fd1ec0876e0 2024-08-17T02:26:34.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7f3b31828700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b10060960 0x7f3b10062e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c150cd0 tx=0x7f3b28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b140052b0 con 0x7f3b2c06e620 2024-08-17T02:26:34.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fa2bcff9700 1 -- 172.21.15.19:0/965829378 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa2b804d6e0 con 0x7fa2c015a8b0 2024-08-17T02:26:34.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fd1e27fc700 1 -- 172.21.15.19:0/3087082107 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd1e8007650 con 0x7fd1ec0876e0 2024-08-17T02:26:34.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fd1e27fc700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd1d0060860 0x7fd1d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fd1e27fc700 1 -- 172.21.15.19:0/3087082107 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1e807bf90 con 0x7fd1ec0876e0 2024-08-17T02:26:34.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.447+0000 7fd1f1c0e700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd1d0060860 0x7fd1d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.451+0000 7f0e6bfff700 1 -- 172.21.15.19:0/596760144 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c00ab30 con 0x7f0e8413e6b0 2024-08-17T02:26:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.451+0000 7fd1f1c0e700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd1d0060860 0x7fd1d0062d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0c3120 tx=0x7fd1dc000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.451+0000 7f0e6bfff700 1 -- 172.21.15.19:0/596760144 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c00ac90 con 0x7f0e8413e6b0 2024-08-17T02:26:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.451+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e840c4f20 con 0x7f0e8413e6b0 2024-08-17T02:26:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.451+0000 7f0e6bfff700 1 -- 172.21.15.19:0/596760144 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c007340 con 0x7f0e8413e6b0 2024-08-17T02:26:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.451+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e840c54e0 con 0x7f0e8413e6b0 2024-08-17T02:26:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.451+0000 7f3b227fc700 1 -- 172.21.15.19:0/3667124635 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3b1c04c430 con 0x7f3b2c06e620 2024-08-17T02:26:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.455+0000 7f0e6bfff700 1 -- 172.21.15.19:0/596760144 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0e7c007770 con 0x7f0e8413e6b0 2024-08-17T02:26:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.455+0000 7f0e6bfff700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e70060930 0x7f0e70062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.455+0000 7f0e6bfff700 1 -- 172.21.15.19:0/596760144 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e7c07cf70 con 0x7f0e8413e6b0 2024-08-17T02:26:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.455+0000 7f0e837fe700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e70060930 0x7f0e70062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.455+0000 7f0e837fe700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e70060930 0x7f0e70062de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e840c3a90 tx=0x7f0e78017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.459+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e840643a0 con 0x7f0e8413e6b0 2024-08-17T02:26:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.459+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d40052b0 con 0x7fd1ec0876e0 2024-08-17T02:26:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.463+0000 7fd1e27fc700 1 -- 172.21.15.19:0/3087082107 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd1e804a480 con 0x7fd1ec0876e0 2024-08-17T02:26:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.467+0000 7f0e6bfff700 1 -- 172.21.15.19:0/596760144 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0e7c04d520 con 0x7f0e8413e6b0 2024-08-17T02:26:34.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.759+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0420159440 con 0x7f04200b1630 2024-08-17T02:26:34.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.759+0000 7f0406ffd700 1 -- 172.21.15.19:0/3281162151 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0420159440 con 0x7f04200b1630 2024-08-17T02:26:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c440cb400 con 0x7f7c4415a8b0 2024-08-17T02:26:34.768 INFO:teuthology.orchestra.run.smithi019.stdout:60129542149 2024-08-17T02:26:34.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa67c0c9d60 con 0x7fa67c0aecc0 2024-08-17T02:26:34.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa66a7fc700 1 -- 172.21.15.19:0/2132983330 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa67004c490 con 0x7fa67c0aecc0 2024-08-17T02:26:34.769 INFO:teuthology.orchestra.run.smithi019.stdout:60129542151 2024-08-17T02:26:34.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f7c2affd700 1 -- 172.21.15.19:0/1845890970 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c34020020 con 0x7f7c4415a8b0 2024-08-17T02:26:34.769 INFO:teuthology.orchestra.run.smithi019.stdout:64424509445 2024-08-17T02:26:34.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa65c060930 msgr2=0x7fa65c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa65c060930 0x7fa65c062de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa674009880 tx=0x7fa674018000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c0aecc0 msgr2=0x7fa67c14cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c0aecc0 0x7fa67c14cfe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c790 tx=0x7fa670007f40 comp rx=0 tx=0).stop 2024-08-17T02:26:34.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 shutdown_connections 2024-08-17T02:26:34.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa65c060930 0x7fa65c062de0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67c158eb0 0x7fa67c14b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa67c0aecc0 0x7fa67c14cfe0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 --2- 172.21.15.19:0/2132983330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa67c06e620 0x7fa67c149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 >> 172.21.15.19:0/2132983330 conn(0x7fa67c0678d0 msgr2=0x7fa67c0aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 shutdown_connections 2024-08-17T02:26:34.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f040c060860 msgr2=0x7f040c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f041ffff700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f040c060860 0x7f040c062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0410001dc0 tx=0x7f0410009040 comp rx=0 tx=0).stop 2024-08-17T02:26:34.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04200b1630 msgr2=0x7f0420069d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f041ffff700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04200b1630 0x7f0420069d60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f041400c560 tx=0x7f0414007e40 comp rx=0 tx=0).stop 2024-08-17T02:26:34.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7fa67b59e700 1 -- 172.21.15.19:0/2132983330 wait complete. 2024-08-17T02:26:34.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 shutdown_connections 2024-08-17T02:26:34.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f041ffff700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f040c060860 0x7f040c062d10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f041ffff700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04200b1630 0x7f0420069d60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f041ffff700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04200b0d20 0x7f0420157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.763+0000 7f041ffff700 1 --2- 172.21.15.19:0/3281162151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042006e620 0x7f042013ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 >> 172.21.15.19:0/3281162151 conn(0x7f04200678d0 msgr2=0x7f04200caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 shutdown_connections 2024-08-17T02:26:34.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f041ffff700 1 -- 172.21.15.19:0/3281162151 wait complete. 2024-08-17T02:26:34.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7c30060860 msgr2=0x7f7c30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7c30060860 0x7f7c30062d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c380091e0 tx=0x7f7c38017000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4415a8b0 msgr2=0x7f7c440970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4415a8b0 0x7f7c440970c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400e950 tx=0x7f7c340091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 shutdown_connections 2024-08-17T02:26:34.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7c30060860 0x7f7c30062d10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c4415a8b0 0x7f7c440970c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c441593b0 0x7f7c44096b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 --2- 172.21.15.19:0/1845890970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c440aab50 0x7f7c44175d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 >> 172.21.15.19:0/1845890970 conn(0x7f7c44068300 msgr2=0x7f7c4406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.767+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 shutdown_connections 2024-08-17T02:26:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.771+0000 7f7c49940700 1 -- 172.21.15.19:0/1845890970 wait complete. 2024-08-17T02:26:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.771+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3b14005830 con 0x7f3b2c06e620 2024-08-17T02:26:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.771+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc050005830 con 0x7fc0700ad750 2024-08-17T02:26:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.771+0000 7fc057fff700 1 -- 172.21.15.19:0/1881855356 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc060017020 con 0x7fc0700ad750 2024-08-17T02:26:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.771+0000 7f3b227fc700 1 -- 172.21.15.19:0/3667124635 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b1c017020 con 0x7f3b2c06e620 2024-08-17T02:26:34.778 INFO:teuthology.orchestra.run.smithi019.stdout:60129542148 2024-08-17T02:26:34.779 INFO:teuthology.orchestra.run.smithi019.stdout:60129542148 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b10060960 msgr2=0x7f3b10062e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b10060960 0x7f3b10062e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c150cd0 tx=0x7f3b28009040 comp rx=0 tx=0).stop 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b2c06e620 msgr2=0x7f3b2c14a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b2c06e620 0x7f3b2c14a890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c7c0 tx=0x7f3b1c007f30 comp rx=0 tx=0).stop 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 shutdown_connections 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3b10060960 0x7f3b10062e10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b2c15d910 0x7f3b2c06a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2c158fb0 0x7f3b2c0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 --2- 172.21.15.19:0/3667124635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b2c06e620 0x7f3b2c14a890 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 >> 172.21.15.19:0/3667124635 conn(0x7f3b2c0678d0 msgr2=0x7f3b2c0aa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 shutdown_connections 2024-08-17T02:26:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7f3b3302b700 1 -- 172.21.15.19:0/3667124635 wait complete. 2024-08-17T02:26:34.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2024-08-17T02:26:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2c0070360 con 0x7fa2c015a8b0 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc05c060930 msgr2=0x7fc05c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc05c060930 0x7fc05c062de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc07014b7f0 tx=0x7fc064008040 comp rx=0 tx=0).stop 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0700ad750 msgr2=0x7fc07016e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0700ad750 0x7fc07016e060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c490 tx=0x7fc060007ea0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 shutdown_connections 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc05c060930 0x7fc05c062de0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc070156d80 0x7fc0700aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0700b14a0 0x7fc0700b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 --2- 172.21.15.19:0/1881855356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0700ad750 0x7fc07016e060 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 >> 172.21.15.19:0/1881855356 conn(0x7fc0700678d0 msgr2=0x7fc0701586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 shutdown_connections 2024-08-17T02:26:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fa2bcff9700 1 -- 172.21.15.19:0/965829378 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2b8022090 con 0x7fa2c015a8b0 2024-08-17T02:26:34.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fc075010700 1 -- 172.21.15.19:0/1881855356 wait complete. 2024-08-17T02:26:34.787 INFO:teuthology.orchestra.run.smithi019.stdout:60129542148 2024-08-17T02:26:34.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.6 2024-08-17T02:26:34.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa2ac060860 msgr2=0x7fa2ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fa2c6e5e700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa2ac060860 0x7fa2ac062d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009c10 tx=0x7fa2b4016000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c015a8b0 msgr2=0x7fa2c01714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.779+0000 7fa2c6e5e700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c015a8b0 0x7fa2c01714b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800bc60 tx=0x7fa2b8009820 comp rx=0 tx=0).stop 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.783+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 shutdown_connections 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.783+0000 7fa2c6e5e700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa2ac060860 0x7fa2ac062d10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.783+0000 7fa2c6e5e700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2c015a8b0 0x7fa2c01714b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.783+0000 7fa2c6e5e700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2c01593b0 0x7fa2c01571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.783+0000 7fa2c6e5e700 1 --2- 172.21.15.19:0/965829378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2c00aa980 0x7fa2c0098c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.783+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 >> 172.21.15.19:0/965829378 conn(0x7fa2c0068300 msgr2=0x7fa2c006ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.783+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 shutdown_connections 2024-08-17T02:26:34.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.783+0000 7fa2c6e5e700 1 -- 172.21.15.19:0/965829378 wait complete. 2024-08-17T02:26:34.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-08-17T02:26:34.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-08-17T02:26:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.791+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd1d4005830 con 0x7fd1ec0876e0 2024-08-17T02:26:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.791+0000 7fd1e27fc700 1 -- 172.21.15.19:0/3087082107 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1e8017080 con 0x7fd1ec0876e0 2024-08-17T02:26:34.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-08-17T02:26:34.799 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-08-17T02:26:34.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-08-17T02:26:34.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd1d0060860 msgr2=0x7fd1d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd1d0060860 0x7fd1d0062d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0c3120 tx=0x7fd1dc000bc0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1ec0876e0 msgr2=0x7fd1ec17b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1ec0876e0 0x7fd1ec17b010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80011e0 tx=0x7fd1e8007df0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 shutdown_connections 2024-08-17T02:26:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd1d0060860 0x7fd1d0062d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1ec0ac560 0x7fd1ec187800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1ec087ab0 0x7fd1ec1872c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 --2- 172.21.15.19:0/3087082107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1ec0876e0 0x7fd1ec17b010 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 >> 172.21.15.19:0/3087082107 conn(0x7fd1ec068300 msgr2=0x7fd1ec069280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 shutdown_connections 2024-08-17T02:26:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7fd1f4673700 1 -- 172.21.15.19:0/3087082107 wait complete. 2024-08-17T02:26:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0e8406f5f0 con 0x7f0e8413e6b0 2024-08-17T02:26:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.795+0000 7f0e6bfff700 1 -- 172.21.15.19:0/596760144 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e7c050b40 con 0x7f0e8413e6b0 2024-08-17T02:26:34.804 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-08-17T02:26:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e70060930 msgr2=0x7f0e70062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e70060930 0x7f0e70062de0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e840c3a90 tx=0x7f0e78017000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413e6b0 msgr2=0x7f0e840c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413e6b0 0x7f0e840c7380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00ccf0 tx=0x7f0e7c001a80 comp rx=0 tx=0).stop 2024-08-17T02:26:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 shutdown_connections 2024-08-17T02:26:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e70060930 0x7f0e70062de0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e84168ab0 0x7f0e84154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8413ea80 0x7f0e84168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 --2- 172.21.15.19:0/596760144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e8413e6b0 0x7f0e840c7380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 >> 172.21.15.19:0/596760144 conn(0x7f0e840678d0 msgr2=0x7f0e84063770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 shutdown_connections 2024-08-17T02:26:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:34.799+0000 7f0e89378700 1 -- 172.21.15.19:0/596760144 wait complete. 2024-08-17T02:26:34.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-08-17T02:26:34.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-08-17T02:26:35.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:26:35.788 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:26:35.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:26:35.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:26:35.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:26:35.800 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:26:35.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:26:35.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:26:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.915+0000 7fb6c208c700 1 Processor -- start 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.915+0000 7fb6c208c700 1 -- start start 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c208c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb6bc13e6b0 0x7fb6bc0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c208c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6bc13ea80 0x7fb6bc156b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c208c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc156700 con 0x7fb6bc155670 2024-08-17T02:26:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c208c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc155af0 con 0x7fb6bc13e6b0 2024-08-17T02:26:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c208c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc155dd0 con 0x7fb6bc13ea80 2024-08-17T02:26:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c108a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb6bc13e6b0 0x7fb6bc0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c108a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb6bc13e6b0 0x7fb6bc0b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58530/0 (socket says 172.21.15.19:58530) 2024-08-17T02:26:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c108a700 1 -- 172.21.15.19:0/3552541707 learned_addr learned my addr 172.21.15.19:0/3552541707 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb0a5a9c700 1 Processor -- start 2024-08-17T02:26:35.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb0a5a9c700 1 -- start start 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390942344 0 0) 0x7fb6bc156700 con 0x7fb6bc155670 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a8003570 con 0x7fb6bc155670 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c188b700 1 --2- 172.21.15.19:0/3552541707 >> v2:172.21.15.119:3300/0 conn(0x7fb6bc13ea80 0x7fb6bc156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313307297 0 0) 0x7fb6a8003570 con 0x7fb6bc155670 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 >> v2:172.21.15.119:3300/0 conn(0x7fb6bc13ea80 msgr2=0x7fb6bc156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 --2- 172.21.15.19:0/3552541707 >> v2:172.21.15.119:3300/0 conn(0x7fb6bc13ea80 0x7fb6bc156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 >> v2:172.21.15.19:3300/0 conn(0x7fb6bc13e6b0 msgr2=0x7fb6bc0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 --2- 172.21.15.19:0/3552541707 >> v2:172.21.15.19:3300/0 conn(0x7fb6bc13e6b0 0x7fb6bc0b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc1560b0 con 0x7fb6bc155670 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7fb6ac001470 con 0x7fb6bc155670 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 >> v1:172.21.15.19:6789/0 conn(0x7fb6bc155670 legacy=0x7fb6bc06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a8003a60 0x7fb6a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a8004810 0x7fb6a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6a80051c0 0x7fb6a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc155af0 con 0x7fb6a8003a60 2024-08-17T02:26:35.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc155dd0 con 0x7fb6a8004810 2024-08-17T02:26:35.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a800c130 con 0x7fb6a80051c0 2024-08-17T02:26:35.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c188b700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6a80051c0 0x7fb6a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c108a700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a8003a60 0x7fb6a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb0a5a9c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb0a013f5e0 0x7fb0a00ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb0a5a9c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a00afb90 0x7fb0a00aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb0a5a9c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a00ad280 con 0x7fb0a013f9b0 2024-08-17T02:26:35.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb0a5a9c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a006ea80 con 0x7fb0a013f5e0 2024-08-17T02:26:35.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb0a5a9c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00adc50 con 0x7fb0a00afb90 2024-08-17T02:26:35.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb09effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb0a013f9b0 0x7fb0a006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33960/0 (socket says 172.21.15.19:33960) 2024-08-17T02:26:35.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb09effd700 1 -- 172.21.15.19:0/1401929350 learned_addr learned my addr 172.21.15.19:0/1401929350 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:35.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7f1a60aa6700 1 Processor -- start 2024-08-17T02:26:35.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb09ffff700 1 --2- 172.21.15.19:0/1401929350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a00afb90 0x7fb0a00aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c188b700 1 -- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a8004810 msgr2=0x7fb6a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c0889700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a8004810 0x7fb6a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c188b700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a8004810 0x7fb6a8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c188b700 1 -- 172.21.15.19:0/3552541707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a8003a60 msgr2=0x7fb6a8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c188b700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a8003a60 0x7fb6a8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c188b700 1 -- 172.21.15.19:0/3552541707 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a8003570 con 0x7fb6a80051c0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb09f7fe700 1 --2- 172.21.15.19:0/1401929350 >> v2:172.21.15.119:3300/0 conn(0x7fb0a013f5e0 0x7fb0a00ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c188b700 1 -- 172.21.15.19:0/3552541707 reap_dead start 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb09e7fc700 1 -- 172.21.15.19:0/1401929350 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667535395 0 0) 0x7fb0a00ad280 con 0x7fb0a013f9b0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c108a700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a8003a60 0x7fb6a8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:35.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb09e7fc700 1 -- 172.21.15.19:0/1401929350 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb088003570 con 0x7fb0a013f9b0 2024-08-17T02:26:35.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb6c188b700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6a80051c0 0x7fb6a800ba60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400bde0 tx=0x7fb6b400b1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d943399e33f1882 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7f1a60aa6700 1 -- start start 2024-08-17T02:26:35.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb09e7fc700 1 -- 172.21.15.19:0/1401929350 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4095892126 0 0) 0x7fb088003570 con 0x7fb0a013f9b0 2024-08-17T02:26:35.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4009ca0 con 0x7fb6a80051c0 2024-08-17T02:26:35.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6b3fff700 1 -- 172.21.15.19:0/3552541707 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4011040 con 0x7fb6a80051c0 2024-08-17T02:26:35.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.919+0000 7fb09ffff700 1 -- 172.21.15.19:0/1401929350 >> v2:172.21.15.119:3300/0 conn(0x7fb0a013f5e0 msgr2=0x7fb0a00ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb09ffff700 1 --2- 172.21.15.19:0/1401929350 >> v2:172.21.15.119:3300/0 conn(0x7fb0a013f5e0 0x7fb0a00ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb09ffff700 1 -- 172.21.15.19:0/1401929350 >> v1:172.21.15.19:6789/0 conn(0x7fb0a013f9b0 legacy=0x7fb0a006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb09ffff700 1 -- 172.21.15.19:0/1401929350 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a015a910 con 0x7fb0a00afb90 2024-08-17T02:26:35.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb09ffff700 1 --2- 172.21.15.19:0/1401929350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a00afb90 0x7fb0a00aff80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb098009e60 tx=0x7fb098009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1459d4d3da00ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb09e7fc700 1 -- 172.21.15.19:0/1401929350 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800e070 con 0x7fb0a00afb90 2024-08-17T02:26:35.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb09e7fc700 1 -- 172.21.15.19:0/1401929350 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800b7a0 con 0x7fb0a00afb90 2024-08-17T02:26:35.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb09e7fc700 1 -- 172.21.15.19:0/1401929350 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094001470 con 0x7fb0a00afb90 2024-08-17T02:26:35.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6c208c700 1 -- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6a80051c0 msgr2=0x7fb6a800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6c208c700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6a80051c0 0x7fb6a800ba60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400bde0 tx=0x7fb6b400b1c0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a60aa6700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1a5c06e7d0 0x7f1a5c146690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a60aa6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a5c146bd0 0x7f1a5c144930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a60aa6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c15da10 con 0x7f1a5c06e400 2024-08-17T02:26:35.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a60aa6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c1444a0 con 0x7f1a5c146bd0 2024-08-17T02:26:35.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a60aa6700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c147020 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6c208c700 1 -- 172.21.15.19:0/3552541707 shutdown_connections 2024-08-17T02:26:35.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6c208c700 1 --2- 172.21.15.19:0/3552541707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6a80051c0 0x7fb6a800ba60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6c208c700 1 -- 172.21.15.19:0/3552541707 >> 172.21.15.19:0/3552541707 conn(0x7fb6bc0678d0 msgr2=0x7fb6bc067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6c208c700 1 -- 172.21.15.19:0/3552541707 shutdown_connections 2024-08-17T02:26:35.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a5a59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1a5c06e400 0x7f1a5c0b0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33972/0 (socket says 172.21.15.19:33972) 2024-08-17T02:26:35.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a5a59c700 1 -- 172.21.15.19:0/1449354731 learned_addr learned my addr 172.21.15.19:0/1449354731 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:35.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6c208c700 1 -- 172.21.15.19:0/3552541707 wait complete. 2024-08-17T02:26:35.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb0a5a9c700 1 -- 172.21.15.19:0/1401929350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a00afb90 msgr2=0x7fb0a00aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb0a5a9c700 1 --2- 172.21.15.19:0/1401929350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a00afb90 0x7fb0a00aff80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb098009e60 tx=0x7fb098009780 comp rx=0 tx=0).stop 2024-08-17T02:26:35.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb0a5a9c700 1 -- 172.21.15.19:0/1401929350 shutdown_connections 2024-08-17T02:26:35.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb0a5a9c700 1 --2- 172.21.15.19:0/1401929350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a00afb90 0x7fb0a00aff80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb0a5a9c700 1 --2- 172.21.15.19:0/1401929350 >> v2:172.21.15.119:3300/0 conn(0x7fb0a013f5e0 0x7fb0a00ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb0a5a9c700 1 -- 172.21.15.19:0/1401929350 >> 172.21.15.19:0/1401929350 conn(0x7fb0a0067890 msgr2=0x7fb0a0067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a59d9b700 1 --2- 172.21.15.19:0/1449354731 >> v2:172.21.15.119:3300/0 conn(0x7f1a5c06e7d0 0x7f1a5c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a5ad9d700 1 --2- 172.21.15.19:0/1449354731 >> v2:172.21.15.19:3300/0 conn(0x7f1a5c146bd0 0x7f1a5c144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a5959a700 1 -- 172.21.15.19:0/1449354731 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945916337 0 0) 0x7f1a5c15da10 con 0x7f1a5c06e400 2024-08-17T02:26:35.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a5959a700 1 -- 172.21.15.19:0/1449354731 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a44003570 con 0x7f1a5c06e400 2024-08-17T02:26:35.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb0a5a9c700 1 -- 172.21.15.19:0/1401929350 shutdown_connections 2024-08-17T02:26:35.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a59d9b700 1 -- 172.21.15.19:0/1449354731 >> v2:172.21.15.19:3300/0 conn(0x7f1a5c146bd0 msgr2=0x7f1a5c144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6c208c700 1 Processor -- start 2024-08-17T02:26:35.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a59d9b700 1 --2- 172.21.15.19:0/1449354731 >> v2:172.21.15.19:3300/0 conn(0x7f1a5c146bd0 0x7f1a5c144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a59d9b700 1 -- 172.21.15.19:0/1449354731 >> v1:172.21.15.19:6789/0 conn(0x7f1a5c06e400 legacy=0x7f1a5c0b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a59d9b700 1 -- 172.21.15.19:0/1449354731 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c144170 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a5ad9d700 1 --2- 172.21.15.19:0/1449354731 >> v2:172.21.15.19:3300/0 conn(0x7f1a5c146bd0 0x7f1a5c144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:35.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7f1a59d9b700 1 --2- 172.21.15.19:0/1449354731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e7d0 0x7f1a5c146690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c161090 tx=0x7f1a4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=710de96ccc79fcb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a5959a700 1 -- 172.21.15.19:0/1449354731 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c011630 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a5959a700 1 -- 172.21.15.19:0/1449354731 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c011790 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb6c208c700 1 -- start start 2024-08-17T02:26:35.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c208c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a80051c0 0x7fb6bc139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c208c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6bc13ccb0 0x7fb6bc0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c208c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6bc0c8d40 0x7fb6bc0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c208c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0cb320 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c208c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc139fd0 con 0x7fb6a80051c0 2024-08-17T02:26:35.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c208c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0c88b0 con 0x7fb6bc0c8d40 2024-08-17T02:26:35.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.923+0000 7fb0a5a9c700 1 -- 172.21.15.19:0/1401929350 wait complete. 2024-08-17T02:26:35.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 Processor -- start 2024-08-17T02:26:35.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c0889700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6bc13ccb0 0x7fb6bc0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c0889700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6bc13ccb0 0x7fb6bc0c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58550/0 (socket says 172.21.15.19:58550) 2024-08-17T02:26:35.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c0889700 1 -- 172.21.15.19:0/1707138908 learned_addr learned my addr 172.21.15.19:0/1707138908 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c0889700 1 -- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6bc0c8d40 msgr2=0x7fb6bc0c5990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:35.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c0889700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6bc0c8d40 0x7fb6bc0c5990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c0889700 1 -- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a80051c0 msgr2=0x7fb6bc139a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:35.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c0889700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a80051c0 0x7fb6bc139a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c0889700 1 -- 172.21.15.19:0/1707138908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0c7ca0 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a60aa6700 1 -- 172.21.15.19:0/1449354731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e7d0 msgr2=0x7f1a5c146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a60aa6700 1 --2- 172.21.15.19:0/1449354731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e7d0 0x7f1a5c146690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c161090 tx=0x7f1a4c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb6c0889700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6bc13ccb0 0x7fb6bc0c49a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00db80 tx=0x7fb6ac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 -- start start 2024-08-17T02:26:35.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0a00afb90 0x7fb0a0170e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a013f5e0 0x7fb0a00cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a013f9b0 0x7fb0a0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00cab70 con 0x7fb0a013f9b0 2024-08-17T02:26:35.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00c9f60 con 0x7fb0a00afb90 2024-08-17T02:26:35.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00ca240 con 0x7fb0a013f5e0 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a013f9b0 0x7fb0a0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a013f9b0 0x7fb0a0151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58556/0 (socket says 172.21.15.19:58556) 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09ffff700 1 -- 172.21.15.19:0/1228251926 learned_addr learned my addr 172.21.15.19:0/1228251926 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09f7fe700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0a00afb90 0x7fb0a0170e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09effd700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a013f5e0 0x7fb0a00cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09ffff700 1 -- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a013f5e0 msgr2=0x7fb0a00cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09ffff700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a013f5e0 0x7fb0a00cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09ffff700 1 -- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0a00afb90 msgr2=0x7fb0a0170e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09ffff700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0a00afb90 0x7fb0a0170e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09ffff700 1 -- 172.21.15.19:0/1228251926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098009a20 con 0x7fb0a013f9b0 2024-08-17T02:26:35.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09effd700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a013f5e0 0x7fb0a00cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:35.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a60aa6700 1 -- 172.21.15.19:0/1449354731 shutdown_connections 2024-08-17T02:26:35.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a60aa6700 1 --2- 172.21.15.19:0/1449354731 >> v2:172.21.15.19:3300/0 conn(0x7f1a5c146bd0 0x7f1a5c144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a60aa6700 1 --2- 172.21.15.19:0/1449354731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e7d0 0x7f1a5c146690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a60aa6700 1 -- 172.21.15.19:0/1449354731 >> 172.21.15.19:0/1449354731 conn(0x7f1a5c067890 msgr2=0x7f1a5c067c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a60aa6700 1 -- 172.21.15.19:0/1449354731 shutdown_connections 2024-08-17T02:26:35.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb09ffff700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a013f9b0 0x7fb0a0151c50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb0a006c320 tx=0x7fb098018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7f1a60aa6700 1 -- 172.21.15.19:0/1449354731 wait complete. 2024-08-17T02:26:35.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fb6b17fa700 1 -- 172.21.15.19:0/1707138908 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac006b00 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fb6b17fa700 1 -- 172.21.15.19:0/1707138908 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac006c60 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fb6b17fa700 1 -- 172.21.15.19:0/1707138908 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac007050 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fdc16c96700 1 Processor -- start 2024-08-17T02:26:35.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fb6c208c700 1 -- 172.21.15.19:0/1707138908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc0c7f80 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fb6c208c700 1 -- 172.21.15.19:0/1707138908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc0c8540 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a60aa6700 1 Processor -- start 2024-08-17T02:26:35.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb08f7fe700 1 -- 172.21.15.19:0/1228251926 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098012c70 con 0x7fb0a013f9b0 2024-08-17T02:26:35.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb08f7fe700 1 -- 172.21.15.19:0/1228251926 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb098012e10 con 0x7fb0a013f9b0 2024-08-17T02:26:35.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 -- 172.21.15.19:0/1228251926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a00ca520 con 0x7fb0a013f9b0 2024-08-17T02:26:35.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.927+0000 7fb0a5a9c700 1 -- 172.21.15.19:0/1228251926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a0151580 con 0x7fb0a013f9b0 2024-08-17T02:26:35.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fdc16c96700 1 -- start start 2024-08-17T02:26:35.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fb0a5a9c700 1 -- 172.21.15.19:0/1228251926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a00643a0 con 0x7fb0a013f9b0 2024-08-17T02:26:35.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fb08f7fe700 1 -- 172.21.15.19:0/1228251926 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09801d680 con 0x7fb0a013f9b0 2024-08-17T02:26:35.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a60aa6700 1 -- start start 2024-08-17T02:26:35.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fdc16c96700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdc100ca660 0x7fdc100caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fdc16c96700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc100cb3f0 con 0x7fdc100b14a0 2024-08-17T02:26:35.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fdc16c96700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc100abb70 con 0x7fdc10156ef0 2024-08-17T02:26:35.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fdc16c96700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc100caac0 con 0x7fdc100ca660 2024-08-17T02:26:35.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a60aa6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e400 0x7f1a5c15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a60aa6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a5c06e7d0 0x7f1a5c0c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a60aa6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a5c146bd0 0x7f1a5c15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a60aa6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c143700 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a60aa6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c1423a0 con 0x7f1a5c06e400 2024-08-17T02:26:35.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a60aa6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c142680 con 0x7f1a5c146bd0 2024-08-17T02:26:35.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fdc14a32700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fdc10156ef0 0x7fdc100b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:32936/0 (socket says 172.21.15.19:32936) 2024-08-17T02:26:35.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fdc14a32700 1 -- 172.21.15.19:0/360643443 learned_addr learned my addr 172.21.15.19:0/360643443 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:35.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fdc15233700 1 --2- 172.21.15.19:0/360643443 >> v2:172.21.15.119:3300/0 conn(0x7fdc100ca660 0x7fdc100caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a59d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a5c06e7d0 0x7f1a5c0c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a59d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a5c06e7d0 0x7f1a5c0c7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58566/0 (socket says 172.21.15.19:58566) 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a59d9b700 1 -- 172.21.15.19:0/2631386332 learned_addr learned my addr 172.21.15.19:0/2631386332 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a5ad9d700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a5c146bd0 0x7f1a5c15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7f1a5a59c700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e400 0x7f1a5c15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7f1a59d9b700 1 -- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a5c146bd0 msgr2=0x7f1a5c15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7f1a59d9b700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a5c146bd0 0x7f1a5c15ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7f1a59d9b700 1 -- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e400 msgr2=0x7f1a5c15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7f1a59d9b700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e400 0x7f1a5c15f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7f1a59d9b700 1 -- 172.21.15.19:0/2631386332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c009420 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7f1a5a59c700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e400 0x7f1a5c15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:35.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fb08f7fe700 1 -- 172.21.15.19:0/1228251926 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb098024070 con 0x7fb0a013f9b0 2024-08-17T02:26:35.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7f1a59d9b700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a5c06e7d0 0x7f1a5c0c7160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c013000 tx=0x7f1a4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fb08f7fe700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb088060bc0 0x7fb088063070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680589151 0 0) 0x7fdc100abb70 con 0x7fdc10156ef0 2024-08-17T02:26:35.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf8003570 con 0x7fdc10156ef0 2024-08-17T02:26:35.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fb08f7fe700 1 -- 172.21.15.19:0/1228251926 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb09807f200 con 0x7fb0a013f9b0 2024-08-17T02:26:35.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.931+0000 7fb6c208c700 1 -- 172.21.15.19:0/1707138908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc0643a0 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fb09f7fe700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb088060bc0 0x7fb088063070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3493777374 0 0) 0x7fdbf8003570 con 0x7fdc10156ef0 2024-08-17T02:26:35.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 >> v2:172.21.15.119:3300/0 conn(0x7fdc100ca660 msgr2=0x7fdc100caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 --2- 172.21.15.19:0/360643443 >> v2:172.21.15.119:3300/0 conn(0x7fdc100ca660 0x7fdc100caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 >> v1:172.21.15.19:6789/0 conn(0x7fdc100b14a0 legacy=0x7fdc100ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100ac130 con 0x7fdc10156ef0 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7fdc080017f0 con 0x7fdc10156ef0 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 >> v1:172.21.15.119:6789/0 conn(0x7fdc10156ef0 legacy=0x7fdc100b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbf8003a60 0x7fdbf8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf8004810 0x7fdbf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbf80051c0 0x7fdbf800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc100caac0 con 0x7fdbf80051c0 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf800c130 con 0x7fdbf8004810 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf8010700 con 0x7fdbf8003a60 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc0ffff700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf8004810 0x7fdbf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc14a32700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbf8003a60 0x7fdbf8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fb09f7fe700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb088060bc0 0x7fb088063070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb090009db0 tx=0x7fb0900091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc15233700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbf80051c0 0x7fdbf800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc15233700 1 -- 172.21.15.19:0/360643443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbf8003a60 msgr2=0x7fdbf8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc15233700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbf8003a60 0x7fdbf8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc15233700 1 -- 172.21.15.19:0/360643443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf8004810 msgr2=0x7fdbf8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc15233700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf8004810 0x7fdbf8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc15233700 1 -- 172.21.15.19:0/360643443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc100ac130 con 0x7fdbf80051c0 2024-08-17T02:26:35.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc14a32700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbf8003a60 0x7fdbf8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:35.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc15233700 1 -- 172.21.15.19:0/360643443 reap_dead start 2024-08-17T02:26:35.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7fdc15233700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbf80051c0 0x7fdbf800ba60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006f00 tx=0x7fdc000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06f741b08a52991 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7f48a506e700 1 Processor -- start 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.935+0000 7f48a506e700 1 -- start start 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f48a506e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a0156d80 0x7f48a0157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f48a506e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f48a00b0d90 0x7f48a00b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f48a506e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a01580e0 con 0x7f48a00ad750 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f48a506e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a00b1720 con 0x7f48a00b0d90 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f48a506e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a01577b0 con 0x7f48a0156d80 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f489ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a0156d80 0x7f48a0157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f489f7fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f48a00b0d90 0x7f48a00b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f489ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a0156d80 0x7f48a0157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39352/0 (socket says 172.21.15.19:39352) 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f489ffff700 1 -- 172.21.15.19:0/555056272 learned_addr learned my addr 172.21.15.19:0/555056272 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f489f7fe700 1 -- 172.21.15.19:0/555056272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a0156d80 msgr2=0x7f48a0157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f489f7fe700 1 --2- 172.21.15.19:0/555056272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a0156d80 0x7f48a0157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f489f7fe700 1 -- 172.21.15.19:0/555056272 >> v1:172.21.15.119:6789/0 conn(0x7f48a00ad750 legacy=0x7f48a00adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f489f7fe700 1 -- 172.21.15.19:0/555056272 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0157a90 con 0x7f48a00b0d90 2024-08-17T02:26:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7fb08f7fe700 1 -- 172.21.15.19:0/1228251926 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb09804f6d0 con 0x7fb0a013f9b0 2024-08-17T02:26:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f489f7fe700 1 --2- 172.21.15.19:0/555056272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48a00b0d90 0x7f48a00b11e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48940098e0 tx=0x7f48940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5472656ef2fa7c4e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000e710 con 0x7fdbf80051c0 2024-08-17T02:26:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0000e8b0 con 0x7fdbf80051c0 2024-08-17T02:26:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7fdc0f7fe700 1 -- 172.21.15.19:0/360643443 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000ec70 con 0x7fdbf80051c0 2024-08-17T02:26:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f1a4a7fc700 1 -- 172.21.15.19:0/2631386332 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c01f070 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f1a4a7fc700 1 -- 172.21.15.19:0/2631386332 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c011900 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f1a60aa6700 1 -- 172.21.15.19:0/2631386332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c142960 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f1a60aa6700 1 -- 172.21.15.19:0/2631386332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c142f20 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.939+0000 7f1a4a7fc700 1 -- 172.21.15.19:0/2631386332 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c025420 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f489effd700 1 -- 172.21.15.19:0/555056272 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400b640 con 0x7f48a00b0d90 2024-08-17T02:26:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f489effd700 1 -- 172.21.15.19:0/555056272 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489400b7a0 con 0x7f48a00b0d90 2024-08-17T02:26:35.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f489effd700 1 -- 172.21.15.19:0/555056272 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400bb40 con 0x7f48a00b0d90 2024-08-17T02:26:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f1a3bfff700 1 -- 172.21.15.19:0/2631386332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c0643a0 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fdc16c96700 1 -- 172.21.15.19:0/360643443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbf80051c0 msgr2=0x7fdbf800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fdc16c96700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbf80051c0 0x7fdbf800ba60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006f00 tx=0x7fdc000091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fb6b17fa700 1 -- 172.21.15.19:0/1707138908 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb6ac007440 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fb6b17fa700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb6a0060960 0x7fb6a0062e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fb6b17fa700 1 -- 172.21.15.19:0/1707138908 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb6ac07d600 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fdc16c96700 1 -- 172.21.15.19:0/360643443 shutdown_connections 2024-08-17T02:26:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fdc16c96700 1 --2- 172.21.15.19:0/360643443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbf80051c0 0x7fdbf800ba60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fdc16c96700 1 -- 172.21.15.19:0/360643443 >> 172.21.15.19:0/360643443 conn(0x7fdc100678d0 msgr2=0x7fdc10067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fb6c108a700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb6a0060960 0x7fb6a0062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fdc16c96700 1 -- 172.21.15.19:0/360643443 shutdown_connections 2024-08-17T02:26:35.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fdc16c96700 1 -- 172.21.15.19:0/360643443 wait complete. 2024-08-17T02:26:35.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fb6c108a700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb6a0060960 0x7fb6a0062e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009ab0 tx=0x7fb6b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f48a506e700 1 -- 172.21.15.19:0/555056272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48a00b0d90 msgr2=0x7f48a00b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f48a506e700 1 --2- 172.21.15.19:0/555056272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48a00b0d90 0x7f48a00b11e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48940098e0 tx=0x7f48940091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f48a506e700 1 -- 172.21.15.19:0/555056272 shutdown_connections 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f48a506e700 1 --2- 172.21.15.19:0/555056272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48a00b0d90 0x7f48a00b11e0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48940098e0 tx=0x7f48940091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f48a506e700 1 --2- 172.21.15.19:0/555056272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a0156d80 0x7f48a0157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7f48a506e700 1 -- 172.21.15.19:0/555056272 >> 172.21.15.19:0/555056272 conn(0x7f48a00678d0 msgr2=0x7f48a0067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fdc16c96700 1 Processor -- start 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.943+0000 7fdc16c96700 1 -- start start 2024-08-17T02:26:35.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7f48a506e700 1 -- 172.21.15.19:0/555056272 shutdown_connections 2024-08-17T02:26:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc16c96700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf80051c0 0x7fdc1014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc16c96700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101536b0 0x7fdc1014f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc16c96700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc10153b20 0x7fdc1014fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc16c96700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10151bc0 con 0x7fdc101536b0 2024-08-17T02:26:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc16c96700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10151ea0 con 0x7fdbf80051c0 2024-08-17T02:26:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc16c96700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10152180 con 0x7fdc10153b20 2024-08-17T02:26:35.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7f48a506e700 1 -- 172.21.15.19:0/555056272 wait complete. 2024-08-17T02:26:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc14a32700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf80051c0 0x7fdc1014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc0ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101536b0 0x7fdc1014f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc14a32700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf80051c0 0x7fdc1014a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:45114/0 (socket says 172.21.15.19:45114) 2024-08-17T02:26:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc14a32700 1 -- 172.21.15.19:0/407883983 learned_addr learned my addr 172.21.15.19:0/407883983 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc15233700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc10153b20 0x7fdc1014fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fb6b17fa700 1 -- 172.21.15.19:0/1707138908 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb6ac04dab0 con 0x7fb6bc13ccb0 2024-08-17T02:26:35.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7f48a506e700 1 Processor -- start 2024-08-17T02:26:35.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc14a32700 1 -- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc10153b20 msgr2=0x7fdc1014fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc14a32700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc10153b20 0x7fdc1014fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc14a32700 1 -- 172.21.15.19:0/407883983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101536b0 msgr2=0x7fdc1014f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc14a32700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101536b0 0x7fdc1014f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc14a32700 1 -- 172.21.15.19:0/407883983 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10152460 con 0x7fdbf80051c0 2024-08-17T02:26:35.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc14a32700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf80051c0 0x7fdc1014a740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc080073e0 tx=0x7fdc0800a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7f1a4a7fc700 1 -- 172.21.15.19:0/2631386332 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1a4c023070 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc0cff9700 1 -- 172.21.15.19:0/407883983 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc080136d0 con 0x7fdbf80051c0 2024-08-17T02:26:35.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc0cff9700 1 -- 172.21.15.19:0/407883983 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc08013830 con 0x7fdbf80051c0 2024-08-17T02:26:35.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc0cff9700 1 -- 172.21.15.19:0/407883983 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08013bb0 con 0x7fdbf80051c0 2024-08-17T02:26:35.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc10152740 con 0x7fdbf80051c0 2024-08-17T02:26:35.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.947+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1014ac80 con 0x7fdbf80051c0 2024-08-17T02:26:35.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.951+0000 7fdc0cff9700 1 -- 172.21.15.19:0/407883983 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdc0801c400 con 0x7fdbf80051c0 2024-08-17T02:26:35.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.951+0000 7fdc0cff9700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbfc060910 0x7fdbfc062dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.951+0000 7fdc0cff9700 1 -- 172.21.15.19:0/407883983 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc0807ddb0 con 0x7fdbf80051c0 2024-08-17T02:26:35.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.951+0000 7f48a506e700 1 -- start start 2024-08-17T02:26:35.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.951+0000 7fdc0ffff700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbfc060910 0x7fdbfc062dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc100643a0 con 0x7fdbf80051c0 2024-08-17T02:26:35.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f48a506e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a00ad750 0x7f48a0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f48a506e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a0156d80 0x7f48a00aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a0156d80 0x7f48a00aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a0156d80 0x7f48a00aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58606/0 (socket says 172.21.15.19:58606) 2024-08-17T02:26:35.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a00ad750 0x7f48a0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a00ad750 0x7f48a0151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39366/0 (socket says 172.21.15.19:39366) 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489f7fe700 1 -- 172.21.15.19:0/4191236854 learned_addr learned my addr 172.21.15.19:0/4191236854 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f48a506e700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48a0155c90 0x7f48a0154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00af4f0 con 0x7f48a0156d80 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00af7d0 con 0x7f48a0155c90 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00afab0 con 0x7f48a00ad750 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f48a486d700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48a0155c90 0x7f48a0154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489f7fe700 1 -- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a00ad750 msgr2=0x7f48a0151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489f7fe700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a00ad750 0x7f48a0151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489f7fe700 1 -- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48a0155c90 msgr2=0x7f48a0154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489f7fe700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48a0155c90 0x7f48a0154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489f7fe700 1 -- 172.21.15.19:0/4191236854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894009420 con 0x7f48a0156d80 2024-08-17T02:26:35.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7f489f7fe700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a0156d80 0x7f48a00aeb80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48940093f0 tx=0x7f4894017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.955+0000 7fdc0ffff700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbfc060910 0x7fdbfc062dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc04007e40 tx=0x7fdc04007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f1a4a7fc700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a3c060860 0x7f1a3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f1a4a7fc700 1 -- 172.21.15.19:0/2631386332 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a4c07e450 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f1a4a7fc700 1 -- 172.21.15.19:0/2631386332 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1a4c07e980 con 0x7f1a5c06e7d0 2024-08-17T02:26:35.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f1a5a59c700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a3c060860 0x7f1a3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f4887fff700 1 -- 172.21.15.19:0/4191236854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489401bc60 con 0x7f48a0156d80 2024-08-17T02:26:35.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f4887fff700 1 -- 172.21.15.19:0/4191236854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489401bde0 con 0x7f48a0156d80 2024-08-17T02:26:35.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a00afd90 con 0x7f48a0156d80 2024-08-17T02:26:35.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f4887fff700 1 -- 172.21.15.19:0/4191236854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894011670 con 0x7f48a0156d80 2024-08-17T02:26:35.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a00af0c0 con 0x7f48a0156d80 2024-08-17T02:26:35.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f1a5a59c700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a3c060860 0x7f1a3c062d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a54005c50 tx=0x7f1a54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.959+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a00643a0 con 0x7f48a0156d80 2024-08-17T02:26:35.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.963+0000 7f4887fff700 1 -- 172.21.15.19:0/4191236854 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4894011a60 con 0x7f48a0156d80 2024-08-17T02:26:35.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.963+0000 7f4887fff700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f488c060930 0x7f488c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.963+0000 7f4887fff700 1 -- 172.21.15.19:0/4191236854 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f489407e360 con 0x7f48a0156d80 2024-08-17T02:26:35.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.963+0000 7f489ffff700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f488c060930 0x7f488c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.963+0000 7f489ffff700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f488c060930 0x7f488c062de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4890006fd0 tx=0x7f4890009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.967+0000 7fdc0cff9700 1 -- 172.21.15.19:0/407883983 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdc0804e160 con 0x7fdbf80051c0 2024-08-17T02:26:35.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.971+0000 7f4887fff700 1 -- 172.21.15.19:0/4191236854 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f489404e910 con 0x7f48a0156d80 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc040097700 1 Processor -- start 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc040097700 1 -- start start 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc040097700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc03814fc20 0x7fc038156200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc040097700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0380ae5d0 0x7fc0380aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc040097700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc038069a40 con 0x7fc03814f850 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc040097700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc038069d20 con 0x7fc0380ae5d0 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc040097700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03806a000 con 0x7fc03814fc20 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03e634700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0380ae5d0 0x7fc0380aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03e634700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0380ae5d0 0x7fc0380aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58616/0 (socket says 172.21.15.19:58616) 2024-08-17T02:26:35.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03e634700 1 -- 172.21.15.19:0/3554495471 learned_addr learned my addr 172.21.15.19:0/3554495471 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03d632700 1 --2- 172.21.15.19:0/3554495471 >> v2:172.21.15.119:3300/0 conn(0x7fc03814fc20 0x7fc038156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7f2f85d23700 1 Processor -- start 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03e634700 1 -- 172.21.15.19:0/3554495471 >> v2:172.21.15.119:3300/0 conn(0x7fc03814fc20 msgr2=0x7fc038156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03e634700 1 --2- 172.21.15.19:0/3554495471 >> v2:172.21.15.119:3300/0 conn(0x7fc03814fc20 0x7fc038156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03e634700 1 -- 172.21.15.19:0/3554495471 >> v1:172.21.15.19:6789/0 conn(0x7fc03814f850 legacy=0x7fc0380691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03e634700 1 -- 172.21.15.19:0/3554495471 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc038155ce0 con 0x7fc0380ae5d0 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03e634700 1 --2- 172.21.15.19:0/3554495471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0380ae5d0 0x7fc0380aa440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0340089b0 tx=0x7fc0340082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cfeb89dfa372ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03ce31700 1 -- 172.21.15.19:0/3554495471 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034010070 con 0x7fc0380ae5d0 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03ce31700 1 -- 172.21.15.19:0/3554495471 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03400dab0 con 0x7fc0380ae5d0 2024-08-17T02:26:35.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7fc03ce31700 1 -- 172.21.15.19:0/3554495471 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400de50 con 0x7fc0380ae5d0 2024-08-17T02:26:35.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7f2f85d23700 1 -- start start 2024-08-17T02:26:35.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7f2f85d23700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2f8006f2b0 0x7f2f800691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7f2f85d23700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2f800ae5d0 0x7f2f8014f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7f2f85d23700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f80156200 0x7f2f800aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7f2f85d23700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f80069a40 con 0x7f2f800ae5d0 2024-08-17T02:26:35.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7f2f85d23700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f80069d20 con 0x7f2f8006f2b0 2024-08-17T02:26:35.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7f2f85d23700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8006a000 con 0x7f2f80156200 2024-08-17T02:26:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.983+0000 7f2f7effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2f800ae5d0 0x7f2f8014f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2f800ae5d0 0x7f2f8014f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58626/0 (socket says 172.21.15.19:58626) 2024-08-17T02:26:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7effd700 1 -- 172.21.15.19:0/1208509368 learned_addr learned my addr 172.21.15.19:0/1208509368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7effd700 1 -- 172.21.15.19:0/1208509368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f80156200 msgr2=0x7f2f800aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7effd700 1 --2- 172.21.15.19:0/1208509368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f80156200 0x7f2f800aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7effd700 1 -- 172.21.15.19:0/1208509368 >> v2:172.21.15.119:3300/0 conn(0x7f2f8006f2b0 msgr2=0x7f2f800691f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7effd700 1 --2- 172.21.15.19:0/1208509368 >> v2:172.21.15.119:3300/0 conn(0x7f2f8006f2b0 0x7f2f800691f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7effd700 1 -- 172.21.15.19:0/1208509368 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80155ce0 con 0x7f2f800ae5d0 2024-08-17T02:26:35.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 -- 172.21.15.19:0/3554495471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0380ae5d0 msgr2=0x7fc0380aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7effd700 1 --2- 172.21.15.19:0/1208509368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f800ae5d0 0x7f2f8014f7c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f800705d0 tx=0x7f2f70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04820191d49785c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 --2- 172.21.15.19:0/3554495471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0380ae5d0 0x7fc0380aa440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0340089b0 tx=0x7fc0340082d0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 -- 172.21.15.19:0/3554495471 shutdown_connections 2024-08-17T02:26:35.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 --2- 172.21.15.19:0/3554495471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0380ae5d0 0x7fc0380aa440 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7e7fc700 1 -- 172.21.15.19:0/1208509368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000b8f0 con 0x7f2f800ae5d0 2024-08-17T02:26:35.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 --2- 172.21.15.19:0/3554495471 >> v2:172.21.15.119:3300/0 conn(0x7fc03814fc20 0x7fc038156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 -- 172.21.15.19:0/3554495471 >> 172.21.15.19:0/3554495471 conn(0x7fc038068300 msgr2=0x7fc0380a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 -- 172.21.15.19:0/3554495471 shutdown_connections 2024-08-17T02:26:35.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7e7fc700 1 -- 172.21.15.19:0/1208509368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7000ba50 con 0x7f2f800ae5d0 2024-08-17T02:26:35.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f7e7fc700 1 -- 172.21.15.19:0/1208509368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000bdf0 con 0x7f2f800ae5d0 2024-08-17T02:26:35.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f85d23700 1 -- 172.21.15.19:0/1208509368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f800ae5d0 msgr2=0x7f2f8014f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f85d23700 1 --2- 172.21.15.19:0/1208509368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f800ae5d0 0x7f2f8014f7c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f800705d0 tx=0x7f2f70009250 comp rx=0 tx=0).stop 2024-08-17T02:26:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 -- 172.21.15.19:0/3554495471 wait complete. 2024-08-17T02:26:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f85d23700 1 -- 172.21.15.19:0/1208509368 shutdown_connections 2024-08-17T02:26:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f85d23700 1 --2- 172.21.15.19:0/1208509368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f800ae5d0 0x7f2f8014f7c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f85d23700 1 --2- 172.21.15.19:0/1208509368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f80156200 0x7f2f800aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f85d23700 1 --2- 172.21.15.19:0/1208509368 >> v2:172.21.15.119:3300/0 conn(0x7f2f8006f2b0 0x7f2f800691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f85d23700 1 -- 172.21.15.19:0/1208509368 >> 172.21.15.19:0/1208509368 conn(0x7f2f80068300 msgr2=0x7f2f800a8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 Processor -- start 2024-08-17T02:26:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7fc040097700 1 -- start start 2024-08-17T02:26:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f85d23700 1 -- 172.21.15.19:0/1208509368 shutdown_connections 2024-08-17T02:26:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.987+0000 7f2f85d23700 1 -- 172.21.15.19:0/1208509368 wait complete. 2024-08-17T02:26:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc040097700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0380ae5d0 0x7fc0380cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc040097700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc03814f850 0x7fc038150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc040097700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc03814fc20 0x7fc038151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc040097700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc038151660 con 0x7fc03814fc20 2024-08-17T02:26:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc040097700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc038150ae0 con 0x7fc0380ae5d0 2024-08-17T02:26:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc040097700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc038150dc0 con 0x7fc03814f850 2024-08-17T02:26:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03e634700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc03814fc20 0x7fc038151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03e634700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc03814fc20 0x7fc038151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58634/0 (socket says 172.21.15.19:58634) 2024-08-17T02:26:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03e634700 1 -- 172.21.15.19:0/727836796 learned_addr learned my addr 172.21.15.19:0/727836796 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:35.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7ff64ad66700 1 Processor -- start 2024-08-17T02:26:35.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03de33700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0380ae5d0 0x7fc0380cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f85d23700 1 Processor -- start 2024-08-17T02:26:35.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7ff64ad66700 1 -- start start 2024-08-17T02:26:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7ff64ad66700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff64413e6b0 0x7ff6440b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7ff64ad66700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff644155670 0x7ff64406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7ff64ad66700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff64413ea80 0x7ff64406e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7ff64ad66700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff644156700 con 0x7ff64413e6b0 2024-08-17T02:26:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7ff64ad66700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff644155af0 con 0x7ff644155670 2024-08-17T02:26:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7ff64ad66700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff644155dd0 con 0x7ff64413ea80 2024-08-17T02:26:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03e634700 1 -- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc03814f850 msgr2=0x7fc038150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03e634700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc03814f850 0x7fc038150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03e634700 1 -- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0380ae5d0 msgr2=0x7fc0380cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03e634700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0380ae5d0 0x7fc0380cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03e634700 1 -- 172.21.15.19:0/727836796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034008570 con 0x7fc03814fc20 2024-08-17T02:26:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc03e634700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc03814fc20 0x7fc038151970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc038068d50 tx=0x7fc03401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f85d23700 1 -- start start 2024-08-17T02:26:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f85d23700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f8006f2b0 0x7f2f801378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f85d23700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f800ae5d0 0x7f2f800b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f85d23700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f80156200 0x7f2f80140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f85d23700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800b16c0 con 0x7f2f80156200 2024-08-17T02:26:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f85d23700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800b0ab0 con 0x7f2f800ae5d0 2024-08-17T02:26:36.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f85d23700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800b0d90 con 0x7f2f8006f2b0 2024-08-17T02:26:36.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7ff649563700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff644155670 0x7ff64406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649d64700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff64413e6b0 0x7ff6440b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649d64700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff64413e6b0 0x7ff6440b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58636/0 (socket says 172.21.15.19:58636) 2024-08-17T02:26:36.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649d64700 1 -- 172.21.15.19:0/3016736820 learned_addr learned my addr 172.21.15.19:0/3016736820 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:36.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc02dffb700 1 -- 172.21.15.19:0/727836796 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400b120 con 0x7fc03814fc20 2024-08-17T02:26:36.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc02dffb700 1 -- 172.21.15.19:0/727836796 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03400b280 con 0x7fc03814fc20 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc02dffb700 1 -- 172.21.15.19:0/727836796 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400b620 con 0x7fc03814fc20 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0381510a0 con 0x7fc03814fc20 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0380ac3a0 con 0x7fc03814fc20 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f7f7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f8006f2b0 0x7f2f801378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f7f7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f8006f2b0 0x7f2f801378b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:39390/0 (socket says 172.21.15.19:39390) 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f7f7fe700 1 -- 172.21.15.19:0/250267775 learned_addr learned my addr 172.21.15.19:0/250267775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.991+0000 7f2f7effd700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f800ae5d0 0x7f2f800b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7f2f7ffff700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f80156200 0x7f2f80140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7f2f7effd700 1 -- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f8006f2b0 msgr2=0x7f2f801378b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7f2f7effd700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f8006f2b0 0x7f2f801378b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7f2f7effd700 1 -- 172.21.15.19:0/250267775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f80156200 msgr2=0x7f2f80140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7f2f7effd700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f80156200 0x7f2f80140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7f2f7effd700 1 -- 172.21.15.19:0/250267775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f700094f0 con 0x7f2f800ae5d0 2024-08-17T02:26:36.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff64a565700 1 --2- 172.21.15.19:0/3016736820 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff64413ea80 0x7ff64406e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649563700 1 -- 172.21.15.19:0/3016736820 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff64413ea80 msgr2=0x7ff64406e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7f2f7effd700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f800ae5d0 0x7f2f800b0160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f80158ed0 tx=0x7f2f70017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7fc02dffb700 1 -- 172.21.15.19:0/727836796 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc03402d460 con 0x7fc03814fc20 2024-08-17T02:26:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649563700 1 --2- 172.21.15.19:0/3016736820 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff64413ea80 0x7ff64406e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649563700 1 -- 172.21.15.19:0/3016736820 >> v2:172.21.15.19:3300/0 conn(0x7ff64413e6b0 msgr2=0x7ff6440b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649563700 1 --2- 172.21.15.19:0/3016736820 >> v2:172.21.15.19:3300/0 conn(0x7ff64413e6b0 0x7ff6440b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649563700 1 -- 172.21.15.19:0/3016736820 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6441560b0 con 0x7ff644155670 2024-08-17T02:26:36.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff64a565700 1 --2- 172.21.15.19:0/3016736820 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff64413ea80 0x7ff64406e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:36.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7fc02dffb700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc01c060930 0x7fc01c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649563700 1 --2- 172.21.15.19:0/3016736820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff644155670 0x7ff64406df10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff64406c9b0 tx=0x7ff63c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7af708bdf51fcab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7fc02dffb700 1 -- 172.21.15.19:0/727836796 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc034082880 con 0x7fc03814fc20 2024-08-17T02:26:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7ff649d64700 1 --2- 172.21.15.19:0/3016736820 >> v2:172.21.15.19:3300/0 conn(0x7ff64413e6b0 0x7ff6440b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7fc03de33700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc01c060930 0x7fc01c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.995+0000 7fc03de33700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc01c060930 0x7fc01c062de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc028003a30 tx=0x7fc028007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff648d62700 1 -- 172.21.15.19:0/3016736820 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00e070 con 0x7ff644155670 2024-08-17T02:26:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7f2f6f7fe700 1 -- 172.21.15.19:0/250267775 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70026480 con 0x7f2f800ae5d0 2024-08-17T02:26:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff648d62700 1 -- 172.21.15.19:0/3016736820 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c00bb60 con 0x7ff644155670 2024-08-17T02:26:36.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff648d62700 1 -- 172.21.15.19:0/3016736820 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c012430 con 0x7ff644155670 2024-08-17T02:26:36.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 -- 172.21.15.19:0/3016736820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff644155670 msgr2=0x7ff64406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 --2- 172.21.15.19:0/3016736820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff644155670 0x7ff64406df10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff64406c9b0 tx=0x7ff63c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:36.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7f2f6f7fe700 1 -- 172.21.15.19:0/250267775 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7001f070 con 0x7f2f800ae5d0 2024-08-17T02:26:36.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f800b1070 con 0x7f2f800ae5d0 2024-08-17T02:26:36.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f80137df0 con 0x7f2f800ae5d0 2024-08-17T02:26:36.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7f2f6f7fe700 1 -- 172.21.15.19:0/250267775 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70026870 con 0x7f2f800ae5d0 2024-08-17T02:26:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 -- 172.21.15.19:0/3016736820 shutdown_connections 2024-08-17T02:26:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 --2- 172.21.15.19:0/3016736820 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff64413ea80 0x7ff64406e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 --2- 172.21.15.19:0/3016736820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff644155670 0x7ff64406df10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 --2- 172.21.15.19:0/3016736820 >> v2:172.21.15.19:3300/0 conn(0x7ff64413e6b0 0x7ff6440b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 -- 172.21.15.19:0/3016736820 >> 172.21.15.19:0/3016736820 conn(0x7ff6440678d0 msgr2=0x7ff644067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 -- 172.21.15.19:0/3016736820 shutdown_connections 2024-08-17T02:26:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 -- 172.21.15.19:0/3016736820 wait complete. 2024-08-17T02:26:36.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7f2f6f7fe700 1 -- 172.21.15.19:0/250267775 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2f70026c60 con 0x7f2f800ae5d0 2024-08-17T02:26:36.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7f2f6f7fe700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2f640608b0 0x7f2f64062d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 Processor -- start 2024-08-17T02:26:36.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7f2f6f7fe700 1 -- 172.21.15.19:0/250267775 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f70021070 con 0x7f2f800ae5d0 2024-08-17T02:26:36.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7ff64ad66700 1 -- start start 2024-08-17T02:26:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:35.999+0000 7f2f7f7fe700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2f640608b0 0x7f2f64062d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7f2f7f7fe700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2f640608b0 0x7f2f64062d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009c10 tx=0x7f2f74000f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff64ad66700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff64413e6b0 0x7ff6441548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff64ad66700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64413ea80 0x7ff644159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff64ad66700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff644159aa0 0x7ff6440c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff64ad66700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64412aff0 con 0x7ff64413e6b0 2024-08-17T02:26:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff64ad66700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64415a880 con 0x7ff64413ea80 2024-08-17T02:26:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff64ad66700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff644159fe0 con 0x7ff644159aa0 2024-08-17T02:26:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649d64700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff64413e6b0 0x7ff6441548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649d64700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff64413e6b0 0x7ff6441548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58666/0 (socket says 172.21.15.19:58666) 2024-08-17T02:26:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649d64700 1 -- 172.21.15.19:0/2786718097 learned_addr learned my addr 172.21.15.19:0/2786718097 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649563700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64413ea80 0x7ff644159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff64a565700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff644159aa0 0x7ff6440c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649d64700 1 -- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff644159aa0 msgr2=0x7ff6440c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649d64700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff644159aa0 0x7ff6440c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649d64700 1 -- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64413ea80 msgr2=0x7ff644159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649d64700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64413ea80 0x7ff644159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649d64700 1 -- 172.21.15.19:0/2786718097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640005fd0 con 0x7ff64413e6b0 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff649d64700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff64413e6b0 0x7ff6441548d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff640007290 tx=0x7ff640013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff639ffb700 1 -- 172.21.15.19:0/2786718097 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000b320 con 0x7ff64413e6b0 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff639ffb700 1 -- 172.21.15.19:0/2786718097 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff640011c20 con 0x7ff64413e6b0 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff64ad66700 1 -- 172.21.15.19:0/2786718097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c009a20 con 0x7ff64413e6b0 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff639ffb700 1 -- 172.21.15.19:0/2786718097 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640009460 con 0x7ff64413e6b0 2024-08-17T02:26:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.003+0000 7ff64ad66700 1 -- 172.21.15.19:0/2786718097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64415a5a0 con 0x7ff64413e6b0 2024-08-17T02:26:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.007+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0380aedb0 con 0x7fc03814fc20 2024-08-17T02:26:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.007+0000 7ff639ffb700 1 -- 172.21.15.19:0/2786718097 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff6400097d0 con 0x7ff64413e6b0 2024-08-17T02:26:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.007+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c0052b0 con 0x7f2f800ae5d0 2024-08-17T02:26:36.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.007+0000 7ff639ffb700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff630060a10 0x7ff630062ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.007+0000 7ff649563700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff630060a10 0x7ff630062ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.007+0000 7ff649563700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff630060a10 0x7ff630062ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0097c0 tx=0x7ff63c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.015+0000 7ff62f7fe700 1 -- 172.21.15.19:0/2786718097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6240052b0 con 0x7ff64413e6b0 2024-08-17T02:26:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.015+0000 7fc02dffb700 1 -- 172.21.15.19:0/727836796 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc0380aedb0 con 0x7fc03814fc20 2024-08-17T02:26:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.015+0000 7f2f6f7fe700 1 -- 172.21.15.19:0/250267775 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2f7004edd0 con 0x7f2f800ae5d0 2024-08-17T02:26:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.015+0000 7ff639ffb700 1 -- 172.21.15.19:0/2786718097 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff640016070 con 0x7ff64413e6b0 2024-08-17T02:26:36.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.023+0000 7ff639ffb700 1 -- 172.21.15.19:0/2786718097 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff64001f080 con 0x7ff64413e6b0 2024-08-17T02:26:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.239+0000 7fb0a5a9c700 1 -- 172.21.15.19:0/1228251926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0a0151a30 con 0x7fb0a013f9b0 2024-08-17T02:26:36.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.239+0000 7fb08f7fe700 1 -- 172.21.15.19:0/1228251926 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb098052cf0 con 0x7fb0a013f9b0 2024-08-17T02:26:36.247 INFO:teuthology.orchestra.run.smithi019.stdout:60129542149 2024-08-17T02:26:36.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 -- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb088060bc0 msgr2=0x7fb088063070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb088060bc0 0x7fb088063070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb090009db0 tx=0x7fb0900091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 -- 172.21.15.19:0/1228251926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a013f9b0 msgr2=0x7fb0a0151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a013f9b0 0x7fb0a0151c50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb0a006c320 tx=0x7fb098018000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 -- 172.21.15.19:0/1228251926 shutdown_connections 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb088060bc0 0x7fb088063070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a013f9b0 0x7fb0a0151c50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0a013f5e0 0x7fb0a00cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 --2- 172.21.15.19:0/1228251926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0a00afb90 0x7fb0a0170e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 -- 172.21.15.19:0/1228251926 >> 172.21.15.19:0/1228251926 conn(0x7fb0a0067890 msgr2=0x7fb0a013c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 -- 172.21.15.19:0/1228251926 shutdown_connections 2024-08-17T02:26:36.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.247+0000 7fb08d7fa700 1 -- 172.21.15.19:0/1228251926 wait complete. 2024-08-17T02:26:36.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.251+0000 7fb6c208c700 1 -- 172.21.15.19:0/1707138908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb6bc06f5f0 con 0x7fb6bc13ccb0 2024-08-17T02:26:36.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.251+0000 7fb6b17fa700 1 -- 172.21.15.19:0/1707138908 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6ac0510d0 con 0x7fb6bc13ccb0 2024-08-17T02:26:36.258 INFO:teuthology.orchestra.run.smithi019.stdout:60129542152 2024-08-17T02:26:36.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 -- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb6a0060960 msgr2=0x7fb6a0062e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb6a0060960 0x7fb6a0062e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009ab0 tx=0x7fb6b8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 -- 172.21.15.19:0/1707138908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6bc13ccb0 msgr2=0x7fb6bc0c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6bc13ccb0 0x7fb6bc0c49a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00db80 tx=0x7fb6ac009040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 -- 172.21.15.19:0/1707138908 shutdown_connections 2024-08-17T02:26:36.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb6a0060960 0x7fb6a0062e10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6bc0c8d40 0x7fb6bc0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6bc13ccb0 0x7fb6bc0c49a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 --2- 172.21.15.19:0/1707138908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6a80051c0 0x7fb6bc139a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 -- 172.21.15.19:0/1707138908 >> 172.21.15.19:0/1707138908 conn(0x7fb6bc0678d0 msgr2=0x7fb6bc0aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 -- 172.21.15.19:0/1707138908 shutdown_connections 2024-08-17T02:26:36.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.255+0000 7fb6a6ffd700 1 -- 172.21.15.19:0/1707138908 wait complete. 2024-08-17T02:26:36.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-08-17T02:26:36.268 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:36.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.267+0000 7f1a3bfff700 1 -- 172.21.15.19:0/2631386332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1a5c143f50 con 0x7f1a5c06e7d0 2024-08-17T02:26:36.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.267+0000 7f1a4a7fc700 1 -- 172.21.15.19:0/2631386332 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a4c04e920 con 0x7f1a5c06e7d0 2024-08-17T02:26:36.273 INFO:teuthology.orchestra.run.smithi019.stdout:60129542149 2024-08-17T02:26:36.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.6 2024-08-17T02:26:36.274 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 -- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a3c060860 msgr2=0x7f1a3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a3c060860 0x7f1a3c062d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a54005c50 tx=0x7f1a54009040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 -- 172.21.15.19:0/2631386332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a5c06e7d0 msgr2=0x7f1a5c0c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a5c06e7d0 0x7f1a5c0c7160 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c013000 tx=0x7f1a4c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 -- 172.21.15.19:0/2631386332 shutdown_connections 2024-08-17T02:26:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a3c060860 0x7f1a3c062d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a5c146bd0 0x7f1a5c15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a5c06e7d0 0x7f1a5c0c7160 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 --2- 172.21.15.19:0/2631386332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a5c06e400 0x7f1a5c15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 -- 172.21.15.19:0/2631386332 >> 172.21.15.19:0/2631386332 conn(0x7f1a5c067890 msgr2=0x7f1a5c06a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 -- 172.21.15.19:0/2631386332 shutdown_connections 2024-08-17T02:26:36.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.271+0000 7f1a3bfff700 1 -- 172.21.15.19:0/2631386332 wait complete. 2024-08-17T02:26:36.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.275+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdc1006f5f0 con 0x7fdbf80051c0 2024-08-17T02:26:36.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.275+0000 7fdc0cff9700 1 -- 172.21.15.19:0/407883983 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdc08051780 con 0x7fdbf80051c0 2024-08-17T02:26:36.281 INFO:teuthology.orchestra.run.smithi019.stdout:60129542150 2024-08-17T02:26:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbfc060910 msgr2=0x7fdbfc062dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbfc060910 0x7fdbfc062dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc04007e40 tx=0x7fdc04007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf80051c0 msgr2=0x7fdc1014a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf80051c0 0x7fdc1014a740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc080073e0 tx=0x7fdc0800a0f0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 shutdown_connections 2024-08-17T02:26:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbfc060910 0x7fdbfc062dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc10153b20 0x7fdc1014fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc101536b0 0x7fdc1014f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 --2- 172.21.15.19:0/407883983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbf80051c0 0x7fdc1014a740 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 >> 172.21.15.19:0/407883983 conn(0x7fdc100678d0 msgr2=0x7fdc100ace20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 shutdown_connections 2024-08-17T02:26:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.279+0000 7fdc16c96700 1 -- 172.21.15.19:0/407883983 wait complete. 2024-08-17T02:26:36.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-08-17T02:26:36.290 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:36.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48a006f5f0 con 0x7f48a0156d80 2024-08-17T02:26:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f4887fff700 1 -- 172.21.15.19:0/4191236854 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4894051f30 con 0x7f48a0156d80 2024-08-17T02:26:36.297 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-08-17T02:26:36.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-08-17T02:26:36.297 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f488c060930 msgr2=0x7f488c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f488c060930 0x7f488c062de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4890006fd0 tx=0x7f4890009250 comp rx=0 tx=0).stop 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a0156d80 msgr2=0x7f48a00aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a0156d80 0x7f48a00aeb80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48940093f0 tx=0x7f4894017000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 shutdown_connections 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f488c060930 0x7f488c062de0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48a0155c90 0x7f48a0154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a0156d80 0x7f48a00aeb80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 --2- 172.21.15.19:0/4191236854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48a00ad750 0x7f48a0151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 >> 172.21.15.19:0/4191236854 conn(0x7f48a00678d0 msgr2=0x7f48a0063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 shutdown_connections 2024-08-17T02:26:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.291+0000 7f48a506e700 1 -- 172.21.15.19:0/4191236854 wait complete. 2024-08-17T02:26:36.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-08-17T02:26:36.308 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:36.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.303+0000 7ff62f7fe700 1 -- 172.21.15.19:0/2786718097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff624005830 con 0x7ff64413e6b0 2024-08-17T02:26:36.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.303+0000 7ff639ffb700 1 -- 172.21.15.19:0/2786718097 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff640086060 con 0x7ff64413e6b0 2024-08-17T02:26:36.309 INFO:teuthology.orchestra.run.smithi019.stdout:60129542149 2024-08-17T02:26:36.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.303+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f5c005830 con 0x7f2f800ae5d0 2024-08-17T02:26:36.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f6f7fe700 1 -- 172.21.15.19:0/250267775 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f700523f0 con 0x7f2f800ae5d0 2024-08-17T02:26:36.310 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-08-17T02:26:36.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 -- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff630060a10 msgr2=0x7ff630062ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff630060a10 0x7ff630062ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0097c0 tx=0x7ff63c019000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 -- 172.21.15.19:0/2786718097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff64413e6b0 msgr2=0x7ff6441548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff64413e6b0 0x7ff6441548d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff640007290 tx=0x7ff640013040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 -- 172.21.15.19:0/2786718097 shutdown_connections 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff630060a10 0x7ff630062ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff644159aa0 0x7ff6440c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff64413ea80 0x7ff644159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 --2- 172.21.15.19:0/2786718097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff64413e6b0 0x7ff6441548d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 -- 172.21.15.19:0/2786718097 >> 172.21.15.19:0/2786718097 conn(0x7ff6440678d0 msgr2=0x7ff64413cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 -- 172.21.15.19:0/2786718097 shutdown_connections 2024-08-17T02:26:36.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7ff62f7fe700 1 -- 172.21.15.19:0/2786718097 wait complete. 2024-08-17T02:26:36.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2f640608b0 msgr2=0x7f2f64062d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2f640608b0 0x7f2f64062d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009c10 tx=0x7f2f74000f90 comp rx=0 tx=0).stop 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f800ae5d0 msgr2=0x7f2f800b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f800ae5d0 0x7f2f800b0160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f80158ed0 tx=0x7f2f70017000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 shutdown_connections 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2f640608b0 0x7f2f64062d60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f80156200 0x7f2f80140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f800ae5d0 0x7f2f800b0160 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 --2- 172.21.15.19:0/250267775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f8006f2b0 0x7f2f801378b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 >> 172.21.15.19:0/250267775 conn(0x7f2f80068300 msgr2=0x7f2f800cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 shutdown_connections 2024-08-17T02:26:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.307+0000 7f2f85d23700 1 -- 172.21.15.19:0/250267775 wait complete. 2024-08-17T02:26:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc0380aedb0 con 0x7fc03814fc20 2024-08-17T02:26:36.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc02dffb700 1 -- 172.21.15.19:0/727836796 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0380aedb0 con 0x7fc03814fc20 2024-08-17T02:26:36.319 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-08-17T02:26:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc01c060930 msgr2=0x7fc01c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc01c060930 0x7fc01c062de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc028003a30 tx=0x7fc028007ea0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc03814fc20 msgr2=0x7fc038151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc03814fc20 0x7fc038151970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc038068d50 tx=0x7fc03401c000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 shutdown_connections 2024-08-17T02:26:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc01c060930 0x7fc01c062de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc03814fc20 0x7fc038151970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc03814f850 0x7fc038150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 --2- 172.21.15.19:0/727836796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0380ae5d0 0x7fc0380cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 >> 172.21.15.19:0/727836796 conn(0x7fc038068300 msgr2=0x7fc03814d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 shutdown_connections 2024-08-17T02:26:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.315+0000 7fc040097700 1 -- 172.21.15.19:0/727836796 wait complete. 2024-08-17T02:26:36.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-08-17T02:26:36.323 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:36.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-08-17T02:26:36.324 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:36.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-08-17T02:26:36.330 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:36.330 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:26:36.330 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:36.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.419+0000 7f8c87fff700 1 Processor -- start 2024-08-17T02:26:36.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.419+0000 7f8c87fff700 1 -- start start 2024-08-17T02:26:36.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c88142870 0x7f8c880ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c88142c40 0x7f8c880cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c880b3730 con 0x7f8c880b1df0 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c880b2900 con 0x7f8c88142870 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c880b2b20 con 0x7f8c88142c40 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c86ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c88142870 0x7f8c880ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c86ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c88142870 0x7f8c880ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58680/0 (socket says 172.21.15.19:58680) 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c86ffd700 1 -- 172.21.15.19:0/740935773 learned_addr learned my addr 172.21.15.19:0/740935773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c867fc700 1 --2- 172.21.15.19:0/740935773 >> v2:172.21.15.119:3300/0 conn(0x7f8c88142c40 0x7f8c880cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c86ffd700 1 -- 172.21.15.19:0/740935773 >> v2:172.21.15.119:3300/0 conn(0x7f8c88142c40 msgr2=0x7f8c880cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c86ffd700 1 --2- 172.21.15.19:0/740935773 >> v2:172.21.15.119:3300/0 conn(0x7f8c88142c40 0x7f8c880cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c86ffd700 1 -- 172.21.15.19:0/740935773 >> v1:172.21.15.119:6789/0 conn(0x7f8c880b1df0 legacy=0x7f8c880b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c86ffd700 1 -- 172.21.15.19:0/740935773 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c880b2e00 con 0x7f8c88142870 2024-08-17T02:26:36.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c86ffd700 1 --2- 172.21.15.19:0/740935773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 0x7f8c880ccb10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c8815a940 tx=0x7f8c78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f61ab528d1b2de server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c85ffb700 1 -- 172.21.15.19:0/740935773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78009e70 con 0x7f8c88142870 2024-08-17T02:26:36.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c85ffb700 1 -- 172.21.15.19:0/740935773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7800b860 con 0x7f8c88142870 2024-08-17T02:26:36.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c85ffb700 1 -- 172.21.15.19:0/740935773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800bc00 con 0x7f8c88142870 2024-08-17T02:26:36.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 -- 172.21.15.19:0/740935773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 msgr2=0x7f8c880ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 --2- 172.21.15.19:0/740935773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 0x7f8c880ccb10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c8815a940 tx=0x7f8c78009250 comp rx=0 tx=0).stop 2024-08-17T02:26:36.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 -- 172.21.15.19:0/740935773 shutdown_connections 2024-08-17T02:26:36.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 --2- 172.21.15.19:0/740935773 >> v2:172.21.15.119:3300/0 conn(0x7f8c88142c40 0x7f8c880cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 --2- 172.21.15.19:0/740935773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 0x7f8c880ccb10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 -- 172.21.15.19:0/740935773 >> 172.21.15.19:0/740935773 conn(0x7f8c880ad8d0 msgr2=0x7f8c880afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 -- 172.21.15.19:0/740935773 shutdown_connections 2024-08-17T02:26:36.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.423+0000 7f8c87fff700 1 -- 172.21.15.19:0/740935773 wait complete. 2024-08-17T02:26:36.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 Processor -- start 2024-08-17T02:26:36.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 -- start start 2024-08-17T02:26:36.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c880b1df0 0x7f8c8806c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 0x7f8c881585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c88142c40 0x7f8c88158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c881697e0 con 0x7f8c88142870 2024-08-17T02:26:36.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88069aa0 con 0x7f8c88142c40 2024-08-17T02:26:36.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88069d60 con 0x7f8c880b1df0 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c867fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 0x7f8c881585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c867fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 0x7f8c881585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58688/0 (socket says 172.21.15.19:58688) 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c867fc700 1 -- 172.21.15.19:0/2039806822 learned_addr learned my addr 172.21.15.19:0/2039806822 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c86ffd700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c880b1df0 0x7f8c8806c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c877fe700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c88142c40 0x7f8c88158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c867fc700 1 -- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c880b1df0 msgr2=0x7f8c8806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c867fc700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c880b1df0 0x7f8c8806c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c867fc700 1 -- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c88142c40 msgr2=0x7f8c88158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c867fc700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c88142c40 0x7f8c88158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c867fc700 1 -- 172.21.15.19:0/2039806822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780094f0 con 0x7f8c88142870 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c86ffd700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c880b1df0 0x7f8c8806c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c877fe700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c88142c40 0x7f8c88158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c867fc700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 0x7f8c881585e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00e930 tx=0x7f8c7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c6effd700 1 -- 172.21.15.19:0/2039806822 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00eed0 con 0x7f8c88142870 2024-08-17T02:26:36.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c6effd700 1 -- 172.21.15.19:0/2039806822 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c00c850 con 0x7f8c88142870 2024-08-17T02:26:36.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8806a040 con 0x7f8c88142870 2024-08-17T02:26:36.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c6effd700 1 -- 172.21.15.19:0/2039806822 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00cbf0 con 0x7f8c88142870 2024-08-17T02:26:36.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.427+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8806a600 con 0x7f8c88142870 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.431+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c880643a0 con 0x7f8c88142870 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.431+0000 7f8c6effd700 1 -- 172.21.15.19:0/2039806822 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8c7c013470 con 0x7f8c88142870 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.431+0000 7f8c6effd700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8c74060860 0x7f8c74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.431+0000 7f8c6effd700 1 -- 172.21.15.19:0/2039806822 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c7c07cdb0 con 0x7f8c88142870 2024-08-17T02:26:36.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.431+0000 7f8c86ffd700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8c74060860 0x7f8c74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.431+0000 7f8c86ffd700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8c74060860 0x7f8c74062d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c8815a940 tx=0x7f8c78017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.439+0000 7f8c6effd700 1 -- 172.21.15.19:0/2039806822 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8c7c04d200 con 0x7f8c88142870 2024-08-17T02:26:36.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.595+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c881420c0 con 0x7f8c74060860 2024-08-17T02:26:36.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.611+0000 7f8c6effd700 1 -- 172.21.15.19:0/2039806822 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264528 (secure 0 0 0) 0x7f8c881420c0 con 0x7f8c74060860 2024-08-17T02:26:36.620 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8c74060860 msgr2=0x7f8c74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8c74060860 0x7f8c74062d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c8815a940 tx=0x7f8c78017000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 msgr2=0x7f8c881585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 0x7f8c881585e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00e930 tx=0x7f8c7c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 shutdown_connections 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8c74060860 0x7f8c74062d10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c88142c40 0x7f8c88158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c88142870 0x7f8c881585e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 --2- 172.21.15.19:0/2039806822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c880b1df0 0x7f8c8806c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 >> 172.21.15.19:0/2039806822 conn(0x7f8c880ad8d0 msgr2=0x7f8c8815b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 shutdown_connections 2024-08-17T02:26:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.615+0000 7f8c87fff700 1 -- 172.21.15.19:0/2039806822 wait complete. 2024-08-17T02:26:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:26:36.634 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:26:34.762560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381820,"kb_used_data":2952,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592900,"statfs":{"total":773094113280,"available":770655129600,"internally_reserved":0,"allocated":3022848,"data_stored":1806276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.154574"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646126+0000","last_change":"2024-08-17T02:26:29.640917+0000","last_active":"2024-08-17T02:26:29.646126+0000","last_peered":"2024-08-17T02:26:29.646126+0000","last_clean":"2024-08-17T02:26:29.646126+0000","last_became_active":"2024-08-17T02:26:29.640351+0000","last_became_peered":"2024-08-17T02:26:29.640351+0000","last_unstale":"2024-08-17T02:26:29.646126+0000","last_undegraded":"2024-08-17T02:26:29.646126+0000","last_fullsized":"2024-08-17T02:26:29.646126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:05.168789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640537+0000","last_change":"2024-08-17T02:26:29.631753+0000","last_active":"2024-08-17T02:26:29.640537+0000","last_peered":"2024-08-17T02:26:29.640537+0000","last_clean":"2024-08-17T02:26:29.640537+0000","last_became_active":"2024-08-17T02:26:29.631252+0000","last_became_peered":"2024-08-17T02:26:29.631252+0000","last_unstale":"2024-08-17T02:26:29.640537+0000","last_undegraded":"2024-08-17T02:26:29.640537+0000","last_fullsized":"2024-08-17T02:26:29.640537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:32.790776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.633641+0000","last_change":"2024-08-17T02:26:29.627763+0000","last_active":"2024-08-17T02:26:29.633641+0000","last_peered":"2024-08-17T02:26:29.633641+0000","last_clean":"2024-08-17T02:26:29.633641+0000","last_became_active":"2024-08-17T02:26:29.627138+0000","last_became_peered":"2024-08-17T02:26:29.627138+0000","last_unstale":"2024-08-17T02:26:29.633641+0000","last_undegraded":"2024-08-17T02:26:29.633641+0000","last_fullsized":"2024-08-17T02:26:29.633641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:17.721814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646429+0000","last_change":"2024-08-17T02:26:29.641271+0000","last_active":"2024-08-17T02:26:29.646429+0000","last_peered":"2024-08-17T02:26:29.646429+0000","last_clean":"2024-08-17T02:26:29.646429+0000","last_became_active":"2024-08-17T02:26:29.640880+0000","last_became_peered":"2024-08-17T02:26:29.640880+0000","last_unstale":"2024-08-17T02:26:29.646429+0000","last_undegraded":"2024-08-17T02:26:29.646429+0000","last_fullsized":"2024-08-17T02:26:29.646429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:14.890075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645654+0000","last_change":"2024-08-17T02:26:29.640518+0000","last_active":"2024-08-17T02:26:29.645654+0000","last_peered":"2024-08-17T02:26:29.645654+0000","last_clean":"2024-08-17T02:26:29.645654+0000","last_became_active":"2024-08-17T02:26:29.640227+0000","last_became_peered":"2024-08-17T02:26:29.640227+0000","last_unstale":"2024-08-17T02:26:29.645654+0000","last_undegraded":"2024-08-17T02:26:29.645654+0000","last_fullsized":"2024-08-17T02:26:29.645654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:00.664060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643595+0000","last_change":"2024-08-17T02:26:29.635633+0000","last_active":"2024-08-17T02:26:29.643595+0000","last_peered":"2024-08-17T02:26:29.643595+0000","last_clean":"2024-08-17T02:26:29.643595+0000","last_became_active":"2024-08-17T02:26:29.635105+0000","last_became_peered":"2024-08-17T02:26:29.635105+0000","last_unstale":"2024-08-17T02:26:29.643595+0000","last_undegraded":"2024-08-17T02:26:29.643595+0000","last_fullsized":"2024-08-17T02:26:29.643595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641206+0000","last_change":"2024-08-17T02:26:29.637618+0000","last_active":"2024-08-17T02:26:29.641206+0000","last_peered":"2024-08-17T02:26:29.641206+0000","last_clean":"2024-08-17T02:26:29.641206+0000","last_became_active":"2024-08-17T02:26:29.637303+0000","last_became_peered":"2024-08-17T02:26:29.637303+0000","last_unstale":"2024-08-17T02:26:29.641206+0000","last_undegraded":"2024-08-17T02:26:29.641206+0000","last_fullsized":"2024-08-17T02:26:29.641206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:52.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638340+0000","last_change":"2024-08-17T02:26:29.633298+0000","last_active":"2024-08-17T02:26:29.638340+0000","last_peered":"2024-08-17T02:26:29.638340+0000","last_clean":"2024-08-17T02:26:29.638340+0000","last_became_active":"2024-08-17T02:26:29.632930+0000","last_became_peered":"2024-08-17T02:26:29.632930+0000","last_unstale":"2024-08-17T02:26:29.638340+0000","last_undegraded":"2024-08-17T02:26:29.638340+0000","last_fullsized":"2024-08-17T02:26:29.638340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:57:32.160542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648681+0000","last_change":"2024-08-17T02:26:29.641107+0000","last_active":"2024-08-17T02:26:29.648681+0000","last_peered":"2024-08-17T02:26:29.648681+0000","last_clean":"2024-08-17T02:26:29.648681+0000","last_became_active":"2024-08-17T02:26:29.640661+0000","last_became_peered":"2024-08-17T02:26:29.640661+0000","last_unstale":"2024-08-17T02:26:29.648681+0000","last_undegraded":"2024-08-17T02:26:29.648681+0000","last_fullsized":"2024-08-17T02:26:29.648681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:15:26.950752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645082+0000","last_change":"2024-08-17T02:26:29.638311+0000","last_active":"2024-08-17T02:26:29.645082+0000","last_peered":"2024-08-17T02:26:29.645082+0000","last_clean":"2024-08-17T02:26:29.645082+0000","last_became_active":"2024-08-17T02:26:29.637822+0000","last_became_peered":"2024-08-17T02:26:29.637822+0000","last_unstale":"2024-08-17T02:26:29.645082+0000","last_undegraded":"2024-08-17T02:26:29.645082+0000","last_fullsized":"2024-08-17T02:26:29.645082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:32.532465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642561+0000","last_change":"2024-08-17T02:26:29.637841+0000","last_active":"2024-08-17T02:26:29.642561+0000","last_peered":"2024-08-17T02:26:29.642561+0000","last_clean":"2024-08-17T02:26:29.642561+0000","last_became_active":"2024-08-17T02:26:29.637507+0000","last_became_peered":"2024-08-17T02:26:29.637507+0000","last_unstale":"2024-08-17T02:26:29.642561+0000","last_undegraded":"2024-08-17T02:26:29.642561+0000","last_fullsized":"2024-08-17T02:26:29.642561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:21.305240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641630+0000","last_change":"2024-08-17T02:26:29.636441+0000","last_active":"2024-08-17T02:26:29.641630+0000","last_peered":"2024-08-17T02:26:29.641630+0000","last_clean":"2024-08-17T02:26:29.641630+0000","last_became_active":"2024-08-17T02:26:29.636162+0000","last_became_peered":"2024-08-17T02:26:29.636162+0000","last_unstale":"2024-08-17T02:26:29.641630+0000","last_undegraded":"2024-08-17T02:26:29.641630+0000","last_fullsized":"2024-08-17T02:26:29.641630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:28.026775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638420+0000","last_change":"2024-08-17T02:26:29.633625+0000","last_active":"2024-08-17T02:26:29.638420+0000","last_peered":"2024-08-17T02:26:29.638420+0000","last_clean":"2024-08-17T02:26:29.638420+0000","last_became_active":"2024-08-17T02:26:29.633239+0000","last_became_peered":"2024-08-17T02:26:29.633239+0000","last_unstale":"2024-08-17T02:26:29.638420+0000","last_undegraded":"2024-08-17T02:26:29.638420+0000","last_fullsized":"2024-08-17T02:26:29.638420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.728445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643496+0000","last_change":"2024-08-17T02:26:29.638395+0000","last_active":"2024-08-17T02:26:29.643496+0000","last_peered":"2024-08-17T02:26:29.643496+0000","last_clean":"2024-08-17T02:26:29.643496+0000","last_became_active":"2024-08-17T02:26:29.638112+0000","last_became_peered":"2024-08-17T02:26:29.638112+0000","last_unstale":"2024-08-17T02:26:29.643496+0000","last_undegraded":"2024-08-17T02:26:29.643496+0000","last_fullsized":"2024-08-17T02:26:29.643496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:34.532005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637720+0000","last_change":"2024-08-17T02:26:29.627828+0000","last_active":"2024-08-17T02:26:29.637720+0000","last_peered":"2024-08-17T02:26:29.637720+0000","last_clean":"2024-08-17T02:26:29.637720+0000","last_became_active":"2024-08-17T02:26:29.627530+0000","last_became_peered":"2024-08-17T02:26:29.627530+0000","last_unstale":"2024-08-17T02:26:29.637720+0000","last_undegraded":"2024-08-17T02:26:29.637720+0000","last_fullsized":"2024-08-17T02:26:29.637720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:18.366384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634326+0000","last_change":"2024-08-17T02:26:29.628945+0000","last_active":"2024-08-17T02:26:29.634326+0000","last_peered":"2024-08-17T02:26:29.634326+0000","last_clean":"2024-08-17T02:26:29.634326+0000","last_became_active":"2024-08-17T02:26:29.628590+0000","last_became_peered":"2024-08-17T02:26:29.628590+0000","last_unstale":"2024-08-17T02:26:29.634326+0000","last_undegraded":"2024-08-17T02:26:29.634326+0000","last_fullsized":"2024-08-17T02:26:29.634326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:17.721814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634543+0000","last_change":"2024-08-17T02:26:29.629331+0000","last_active":"2024-08-17T02:26:29.634543+0000","last_peered":"2024-08-17T02:26:29.634543+0000","last_clean":"2024-08-17T02:26:29.634543+0000","last_became_active":"2024-08-17T02:26:29.629022+0000","last_became_peered":"2024-08-17T02:26:29.629022+0000","last_unstale":"2024-08-17T02:26:29.634543+0000","last_undegraded":"2024-08-17T02:26:29.634543+0000","last_fullsized":"2024-08-17T02:26:29.634543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:15:26.950752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637651+0000","last_change":"2024-08-17T02:26:29.633865+0000","last_active":"2024-08-17T02:26:29.637651+0000","last_peered":"2024-08-17T02:26:29.637651+0000","last_clean":"2024-08-17T02:26:29.637651+0000","last_became_active":"2024-08-17T02:26:29.633518+0000","last_became_peered":"2024-08-17T02:26:29.633518+0000","last_unstale":"2024-08-17T02:26:29.637651+0000","last_undegraded":"2024-08-17T02:26:29.637651+0000","last_fullsized":"2024-08-17T02:26:29.637651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:35.893643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641241+0000","last_change":"2024-08-17T02:26:29.638651+0000","last_active":"2024-08-17T02:26:29.641241+0000","last_peered":"2024-08-17T02:26:29.641241+0000","last_clean":"2024-08-17T02:26:29.641241+0000","last_became_active":"2024-08-17T02:26:29.638400+0000","last_became_peered":"2024-08-17T02:26:29.638400+0000","last_unstale":"2024-08-17T02:26:29.641241+0000","last_undegraded":"2024-08-17T02:26:29.641241+0000","last_fullsized":"2024-08-17T02:26:29.641241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:59.413875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645990+0000","last_change":"2024-08-17T02:26:29.644401+0000","last_active":"2024-08-17T02:26:29.645990+0000","last_peered":"2024-08-17T02:26:29.645990+0000","last_clean":"2024-08-17T02:26:29.645990+0000","last_became_active":"2024-08-17T02:26:29.644100+0000","last_became_peered":"2024-08-17T02:26:29.644100+0000","last_unstale":"2024-08-17T02:26:29.645990+0000","last_undegraded":"2024-08-17T02:26:29.645990+0000","last_fullsized":"2024-08-17T02:26:29.645990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:20.713454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.635113+0000","last_change":"2024-08-17T02:26:29.632167+0000","last_active":"2024-08-17T02:26:29.635113+0000","last_peered":"2024-08-17T02:26:29.635113+0000","last_clean":"2024-08-17T02:26:29.635113+0000","last_became_active":"2024-08-17T02:26:29.631704+0000","last_became_peered":"2024-08-17T02:26:29.631704+0000","last_unstale":"2024-08-17T02:26:29.635113+0000","last_undegraded":"2024-08-17T02:26:29.635113+0000","last_fullsized":"2024-08-17T02:26:29.635113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:32.532465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.639628+0000","last_change":"2024-08-17T02:26:29.632372+0000","last_active":"2024-08-17T02:26:29.639628+0000","last_peered":"2024-08-17T02:26:29.639628+0000","last_clean":"2024-08-17T02:26:29.639628+0000","last_became_active":"2024-08-17T02:26:29.632061+0000","last_became_peered":"2024-08-17T02:26:29.632061+0000","last_unstale":"2024-08-17T02:26:29.639628+0000","last_undegraded":"2024-08-17T02:26:29.639628+0000","last_fullsized":"2024-08-17T02:26:29.639628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:59.413875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643634+0000","last_change":"2024-08-17T02:26:29.640414+0000","last_active":"2024-08-17T02:26:29.643634+0000","last_peered":"2024-08-17T02:26:29.643634+0000","last_clean":"2024-08-17T02:26:29.643634+0000","last_became_active":"2024-08-17T02:26:29.640062+0000","last_became_peered":"2024-08-17T02:26:29.640062+0000","last_unstale":"2024-08-17T02:26:29.643634+0000","last_undegraded":"2024-08-17T02:26:29.643634+0000","last_fullsized":"2024-08-17T02:26:29.643634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:18.366384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645047+0000","last_change":"2024-08-17T02:26:29.640158+0000","last_active":"2024-08-17T02:26:29.645047+0000","last_peered":"2024-08-17T02:26:29.645047+0000","last_clean":"2024-08-17T02:26:29.645047+0000","last_became_active":"2024-08-17T02:26:29.639901+0000","last_became_peered":"2024-08-17T02:26:29.639901+0000","last_unstale":"2024-08-17T02:26:29.645047+0000","last_undegraded":"2024-08-17T02:26:29.645047+0000","last_fullsized":"2024-08-17T02:26:29.645047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:25.035787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643592+0000","last_change":"2024-08-17T02:26:29.640300+0000","last_active":"2024-08-17T02:26:29.643592+0000","last_peered":"2024-08-17T02:26:29.643592+0000","last_clean":"2024-08-17T02:26:29.643592+0000","last_became_active":"2024-08-17T02:26:29.639925+0000","last_became_peered":"2024-08-17T02:26:29.639925+0000","last_unstale":"2024-08-17T02:26:29.643592+0000","last_undegraded":"2024-08-17T02:26:29.643592+0000","last_fullsized":"2024-08-17T02:26:29.643592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:12.800333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645060+0000","last_change":"2024-08-17T02:26:29.632577+0000","last_active":"2024-08-17T02:26:29.645060+0000","last_peered":"2024-08-17T02:26:29.645060+0000","last_clean":"2024-08-17T02:26:29.645060+0000","last_became_active":"2024-08-17T02:26:29.632068+0000","last_became_peered":"2024-08-17T02:26:29.632068+0000","last_unstale":"2024-08-17T02:26:29.645060+0000","last_undegraded":"2024-08-17T02:26:29.645060+0000","last_fullsized":"2024-08-17T02:26:29.645060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:25.035787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640531+0000","last_change":"2024-08-17T02:26:29.635740+0000","last_active":"2024-08-17T02:26:29.640531+0000","last_peered":"2024-08-17T02:26:29.640531+0000","last_clean":"2024-08-17T02:26:29.640531+0000","last_became_active":"2024-08-17T02:26:29.635378+0000","last_became_peered":"2024-08-17T02:26:29.635378+0000","last_unstale":"2024-08-17T02:26:29.640531+0000","last_undegraded":"2024-08-17T02:26:29.640531+0000","last_fullsized":"2024-08-17T02:26:29.640531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:46.990052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643621+0000","last_change":"2024-08-17T02:26:29.640361+0000","last_active":"2024-08-17T02:26:29.643621+0000","last_peered":"2024-08-17T02:26:29.643621+0000","last_clean":"2024-08-17T02:26:29.643621+0000","last_became_active":"2024-08-17T02:26:29.639981+0000","last_became_peered":"2024-08-17T02:26:29.639981+0000","last_unstale":"2024-08-17T02:26:29.643621+0000","last_undegraded":"2024-08-17T02:26:29.643621+0000","last_fullsized":"2024-08-17T02:26:29.643621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:16.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641228+0000","last_change":"2024-08-17T02:26:29.637240+0000","last_active":"2024-08-17T02:26:29.641228+0000","last_peered":"2024-08-17T02:26:29.641228+0000","last_clean":"2024-08-17T02:26:29.641228+0000","last_became_active":"2024-08-17T02:26:29.636928+0000","last_became_peered":"2024-08-17T02:26:29.636928+0000","last_unstale":"2024-08-17T02:26:29.641228+0000","last_undegraded":"2024-08-17T02:26:29.641228+0000","last_fullsized":"2024-08-17T02:26:29.641228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:20.713454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646410+0000","last_change":"2024-08-17T02:26:29.643173+0000","last_active":"2024-08-17T02:26:29.646410+0000","last_peered":"2024-08-17T02:26:29.646410+0000","last_clean":"2024-08-17T02:26:29.646410+0000","last_became_active":"2024-08-17T02:26:29.642920+0000","last_became_peered":"2024-08-17T02:26:29.642920+0000","last_unstale":"2024-08-17T02:26:29.646410+0000","last_undegraded":"2024-08-17T02:26:29.646410+0000","last_fullsized":"2024-08-17T02:26:29.646410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:05.168789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637660+0000","last_change":"2024-08-17T02:26:29.633051+0000","last_active":"2024-08-17T02:26:29.637660+0000","last_peered":"2024-08-17T02:26:29.637660+0000","last_clean":"2024-08-17T02:26:29.637660+0000","last_became_active":"2024-08-17T02:26:29.632692+0000","last_became_peered":"2024-08-17T02:26:29.632692+0000","last_unstale":"2024-08-17T02:26:29.637660+0000","last_undegraded":"2024-08-17T02:26:29.637660+0000","last_fullsized":"2024-08-17T02:26:29.637660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:37.287663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642677+0000","last_change":"2024-08-17T02:26:29.637059+0000","last_active":"2024-08-17T02:26:29.642677+0000","last_peered":"2024-08-17T02:26:29.642677+0000","last_clean":"2024-08-17T02:26:29.642677+0000","last_became_active":"2024-08-17T02:26:29.634568+0000","last_became_peered":"2024-08-17T02:26:29.634568+0000","last_unstale":"2024-08-17T02:26:29.642677+0000","last_undegraded":"2024-08-17T02:26:29.642677+0000","last_fullsized":"2024-08-17T02:26:29.642677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:15.601838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641098+0000","last_change":"2024-08-17T02:26:29.630504+0000","last_active":"2024-08-17T02:26:29.641098+0000","last_peered":"2024-08-17T02:26:29.641098+0000","last_clean":"2024-08-17T02:26:29.641098+0000","last_became_active":"2024-08-17T02:26:29.629516+0000","last_became_peered":"2024-08-17T02:26:29.629516+0000","last_unstale":"2024-08-17T02:26:29.641098+0000","last_undegraded":"2024-08-17T02:26:29.641098+0000","last_fullsized":"2024-08-17T02:26:29.641098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:42.357817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655894+0000","last_change":"2024-08-17T02:26:28.628658+0000","last_active":"2024-08-17T02:26:29.655894+0000","last_peered":"2024-08-17T02:26:29.655894+0000","last_clean":"2024-08-17T02:26:29.655894+0000","last_became_active":"2024-08-17T02:26:28.628341+0000","last_became_peered":"2024-08-17T02:26:28.628341+0000","last_unstale":"2024-08-17T02:26:29.655894+0000","last_undegraded":"2024-08-17T02:26:29.655894+0000","last_fullsized":"2024-08-17T02:26:29.655894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:42.099769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634929+0000","last_change":"2024-08-17T02:26:29.630922+0000","last_active":"2024-08-17T02:26:29.634929+0000","last_peered":"2024-08-17T02:26:29.634929+0000","last_clean":"2024-08-17T02:26:29.634929+0000","last_became_active":"2024-08-17T02:26:29.629133+0000","last_became_peered":"2024-08-17T02:26:29.629133+0000","last_unstale":"2024-08-17T02:26:29.634929+0000","last_undegraded":"2024-08-17T02:26:29.634929+0000","last_fullsized":"2024-08-17T02:26:29.634929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:59.413875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.654903+0000","last_change":"2024-08-17T02:26:28.636370+0000","last_active":"2024-08-17T02:26:29.654903+0000","last_peered":"2024-08-17T02:26:29.654903+0000","last_clean":"2024-08-17T02:26:29.654903+0000","last_became_active":"2024-08-17T02:26:28.636030+0000","last_became_peered":"2024-08-17T02:26:28.636030+0000","last_unstale":"2024-08-17T02:26:29.654903+0000","last_undegraded":"2024-08-17T02:26:29.654903+0000","last_fullsized":"2024-08-17T02:26:29.654903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:54.570440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.620818+0000","last_change":"2024-08-17T02:26:28.628598+0000","last_active":"2024-08-17T02:26:29.620818+0000","last_peered":"2024-08-17T02:26:29.620818+0000","last_clean":"2024-08-17T02:26:29.620818+0000","last_became_active":"2024-08-17T02:26:28.627246+0000","last_became_peered":"2024-08-17T02:26:28.627246+0000","last_unstale":"2024-08-17T02:26:29.620818+0000","last_undegraded":"2024-08-17T02:26:29.620818+0000","last_fullsized":"2024-08-17T02:26:29.620818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:39.569935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642967+0000","last_change":"2024-08-17T02:26:29.635943+0000","last_active":"2024-08-17T02:26:29.642967+0000","last_peered":"2024-08-17T02:26:29.642967+0000","last_clean":"2024-08-17T02:26:29.642967+0000","last_became_active":"2024-08-17T02:26:29.634674+0000","last_became_peered":"2024-08-17T02:26:29.634674+0000","last_unstale":"2024-08-17T02:26:29.642967+0000","last_undegraded":"2024-08-17T02:26:29.642967+0000","last_fullsized":"2024-08-17T02:26:29.642967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:46.990052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.621239+0000","last_change":"2024-08-17T02:26:28.627084+0000","last_active":"2024-08-17T02:26:29.621239+0000","last_peered":"2024-08-17T02:26:29.621239+0000","last_clean":"2024-08-17T02:26:29.621239+0000","last_became_active":"2024-08-17T02:26:28.626802+0000","last_became_peered":"2024-08-17T02:26:28.626802+0000","last_unstale":"2024-08-17T02:26:29.621239+0000","last_undegraded":"2024-08-17T02:26:29.621239+0000","last_fullsized":"2024-08-17T02:26:29.621239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:21.706815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637701+0000","last_change":"2024-08-17T02:26:29.626103+0000","last_active":"2024-08-17T02:26:29.637701+0000","last_peered":"2024-08-17T02:26:29.637701+0000","last_clean":"2024-08-17T02:26:29.637701+0000","last_became_active":"2024-08-17T02:26:29.625737+0000","last_became_peered":"2024-08-17T02:26:29.625737+0000","last_unstale":"2024-08-17T02:26:29.637701+0000","last_undegraded":"2024-08-17T02:26:29.637701+0000","last_fullsized":"2024-08-17T02:26:29.637701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:57:32.160542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.625410+0000","last_change":"2024-08-17T02:26:28.628951+0000","last_active":"2024-08-17T02:26:29.625410+0000","last_peered":"2024-08-17T02:26:29.625410+0000","last_clean":"2024-08-17T02:26:29.625410+0000","last_became_active":"2024-08-17T02:26:28.628628+0000","last_became_peered":"2024-08-17T02:26:28.628628+0000","last_unstale":"2024-08-17T02:26:29.625410+0000","last_undegraded":"2024-08-17T02:26:29.625410+0000","last_fullsized":"2024-08-17T02:26:29.625410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:52.647000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643759+0000","last_change":"2024-08-17T02:26:29.635675+0000","last_active":"2024-08-17T02:26:29.643759+0000","last_peered":"2024-08-17T02:26:29.643759+0000","last_clean":"2024-08-17T02:26:29.643759+0000","last_became_active":"2024-08-17T02:26:29.635384+0000","last_became_peered":"2024-08-17T02:26:29.635384+0000","last_unstale":"2024-08-17T02:26:29.643759+0000","last_undegraded":"2024-08-17T02:26:29.643759+0000","last_fullsized":"2024-08-17T02:26:29.643759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:32.532465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.622717+0000","last_change":"2024-08-17T02:26:28.629856+0000","last_active":"2024-08-17T02:26:29.622717+0000","last_peered":"2024-08-17T02:26:29.622717+0000","last_clean":"2024-08-17T02:26:29.622717+0000","last_became_active":"2024-08-17T02:26:28.629588+0000","last_became_peered":"2024-08-17T02:26:28.629588+0000","last_unstale":"2024-08-17T02:26:29.622717+0000","last_undegraded":"2024-08-17T02:26:29.622717+0000","last_fullsized":"2024-08-17T02:26:29.622717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:44.839971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638031+0000","last_change":"2024-08-17T02:26:29.634638+0000","last_active":"2024-08-17T02:26:29.638031+0000","last_peered":"2024-08-17T02:26:29.638031+0000","last_clean":"2024-08-17T02:26:29.638031+0000","last_became_active":"2024-08-17T02:26:29.634363+0000","last_became_peered":"2024-08-17T02:26:29.634363+0000","last_unstale":"2024-08-17T02:26:29.638031+0000","last_undegraded":"2024-08-17T02:26:29.638031+0000","last_fullsized":"2024-08-17T02:26:29.638031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:22.120795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655581+0000","last_change":"2024-08-17T02:26:28.628000+0000","last_active":"2024-08-17T02:26:29.655581+0000","last_peered":"2024-08-17T02:26:29.655581+0000","last_clean":"2024-08-17T02:26:29.655581+0000","last_became_active":"2024-08-17T02:26:28.627694+0000","last_became_peered":"2024-08-17T02:26:28.627694+0000","last_unstale":"2024-08-17T02:26:29.655581+0000","last_undegraded":"2024-08-17T02:26:29.655581+0000","last_fullsized":"2024-08-17T02:26:29.655581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:07.911227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641612+0000","last_change":"2024-08-17T02:26:29.630265+0000","last_active":"2024-08-17T02:26:29.641612+0000","last_peered":"2024-08-17T02:26:29.641612+0000","last_clean":"2024-08-17T02:26:29.641612+0000","last_became_active":"2024-08-17T02:26:29.629158+0000","last_became_peered":"2024-08-17T02:26:29.629158+0000","last_unstale":"2024-08-17T02:26:29.641612+0000","last_undegraded":"2024-08-17T02:26:29.641612+0000","last_fullsized":"2024-08-17T02:26:29.641612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:34.066122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.662983+0000","last_change":"2024-08-17T02:26:28.631995+0000","last_active":"2024-08-17T02:26:29.662983+0000","last_peered":"2024-08-17T02:26:29.662983+0000","last_clean":"2024-08-17T02:26:29.662983+0000","last_became_active":"2024-08-17T02:26:28.631346+0000","last_became_peered":"2024-08-17T02:26:28.631346+0000","last_unstale":"2024-08-17T02:26:29.662983+0000","last_undegraded":"2024-08-17T02:26:29.662983+0000","last_fullsized":"2024-08-17T02:26:29.662983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:31.850537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648822+0000","last_change":"2024-08-17T02:26:29.642029+0000","last_active":"2024-08-17T02:26:29.648822+0000","last_peered":"2024-08-17T02:26:29.648822+0000","last_clean":"2024-08-17T02:26:29.648822+0000","last_became_active":"2024-08-17T02:26:29.641516+0000","last_became_peered":"2024-08-17T02:26:29.641516+0000","last_unstale":"2024-08-17T02:26:29.648822+0000","last_undegraded":"2024-08-17T02:26:29.648822+0000","last_fullsized":"2024-08-17T02:26:29.648822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:13.166542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655408+0000","last_change":"2024-08-17T02:26:28.634455+0000","last_active":"2024-08-17T02:26:29.655408+0000","last_peered":"2024-08-17T02:26:29.655408+0000","last_clean":"2024-08-17T02:26:29.655408+0000","last_became_active":"2024-08-17T02:26:28.633926+0000","last_became_peered":"2024-08-17T02:26:28.633926+0000","last_unstale":"2024-08-17T02:26:29.655408+0000","last_undegraded":"2024-08-17T02:26:29.655408+0000","last_fullsized":"2024-08-17T02:26:29.655408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:12.949717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.635106+0000","last_change":"2024-08-17T02:26:29.631726+0000","last_active":"2024-08-17T02:26:29.635106+0000","last_peered":"2024-08-17T02:26:29.635106+0000","last_clean":"2024-08-17T02:26:29.635106+0000","last_became_active":"2024-08-17T02:26:29.631369+0000","last_became_peered":"2024-08-17T02:26:29.631369+0000","last_unstale":"2024-08-17T02:26:29.635106+0000","last_undegraded":"2024-08-17T02:26:29.635106+0000","last_fullsized":"2024-08-17T02:26:29.635106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:58.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.622746+0000","last_change":"2024-08-17T02:26:28.629917+0000","last_active":"2024-08-17T02:26:29.622746+0000","last_peered":"2024-08-17T02:26:29.622746+0000","last_clean":"2024-08-17T02:26:29.622746+0000","last_became_active":"2024-08-17T02:26:28.629619+0000","last_became_peered":"2024-08-17T02:26:28.629619+0000","last_unstale":"2024-08-17T02:26:29.622746+0000","last_undegraded":"2024-08-17T02:26:29.622746+0000","last_fullsized":"2024-08-17T02:26:29.622746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:54.570440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648863+0000","last_change":"2024-08-17T02:26:29.642329+0000","last_active":"2024-08-17T02:26:29.648863+0000","last_peered":"2024-08-17T02:26:29.648863+0000","last_clean":"2024-08-17T02:26:29.648863+0000","last_became_active":"2024-08-17T02:26:29.642040+0000","last_became_peered":"2024-08-17T02:26:29.642040+0000","last_unstale":"2024-08-17T02:26:29.648863+0000","last_undegraded":"2024-08-17T02:26:29.648863+0000","last_fullsized":"2024-08-17T02:26:29.648863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:09.010696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.625528+0000","last_change":"2024-08-17T02:26:28.636363+0000","last_active":"2024-08-17T02:26:29.625528+0000","last_peered":"2024-08-17T02:26:29.625528+0000","last_clean":"2024-08-17T02:26:29.625528+0000","last_became_active":"2024-08-17T02:26:28.636034+0000","last_became_peered":"2024-08-17T02:26:28.636034+0000","last_unstale":"2024-08-17T02:26:29.625528+0000","last_undegraded":"2024-08-17T02:26:29.625528+0000","last_fullsized":"2024-08-17T02:26:29.625528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:29.548053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642694+0000","last_change":"2024-08-17T02:26:29.637246+0000","last_active":"2024-08-17T02:26:29.642694+0000","last_peered":"2024-08-17T02:26:29.642694+0000","last_clean":"2024-08-17T02:26:29.642694+0000","last_became_active":"2024-08-17T02:26:29.636968+0000","last_became_peered":"2024-08-17T02:26:29.636968+0000","last_unstale":"2024-08-17T02:26:29.642694+0000","last_undegraded":"2024-08-17T02:26:29.642694+0000","last_fullsized":"2024-08-17T02:26:29.642694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:22.120795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.658576+0000","last_change":"2024-08-17T02:26:28.629052+0000","last_active":"2024-08-17T02:26:29.658576+0000","last_peered":"2024-08-17T02:26:29.658576+0000","last_clean":"2024-08-17T02:26:29.658576+0000","last_became_active":"2024-08-17T02:26:28.628701+0000","last_became_peered":"2024-08-17T02:26:28.628701+0000","last_unstale":"2024-08-17T02:26:29.658576+0000","last_undegraded":"2024-08-17T02:26:29.658576+0000","last_fullsized":"2024-08-17T02:26:29.658576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:32.650882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648889+0000","last_change":"2024-08-17T02:26:29.642870+0000","last_active":"2024-08-17T02:26:29.648889+0000","last_peered":"2024-08-17T02:26:29.648889+0000","last_clean":"2024-08-17T02:26:29.648889+0000","last_became_active":"2024-08-17T02:26:29.642588+0000","last_became_peered":"2024-08-17T02:26:29.642588+0000","last_unstale":"2024-08-17T02:26:29.648889+0000","last_undegraded":"2024-08-17T02:26:29.648889+0000","last_fullsized":"2024-08-17T02:26:29.648889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:08.902200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.654223+0000","last_change":"2024-08-17T02:26:28.634171+0000","last_active":"2024-08-17T02:26:29.654223+0000","last_peered":"2024-08-17T02:26:29.654223+0000","last_clean":"2024-08-17T02:26:29.654223+0000","last_became_active":"2024-08-17T02:26:28.633826+0000","last_became_peered":"2024-08-17T02:26:28.633826+0000","last_unstale":"2024-08-17T02:26:29.654223+0000","last_undegraded":"2024-08-17T02:26:29.654223+0000","last_fullsized":"2024-08-17T02:26:29.654223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:35.824314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648844+0000","last_change":"2024-08-17T02:26:29.643502+0000","last_active":"2024-08-17T02:26:29.648844+0000","last_peered":"2024-08-17T02:26:29.648844+0000","last_clean":"2024-08-17T02:26:29.648844+0000","last_became_active":"2024-08-17T02:26:29.641864+0000","last_became_peered":"2024-08-17T02:26:29.641864+0000","last_unstale":"2024-08-17T02:26:29.648844+0000","last_undegraded":"2024-08-17T02:26:29.648844+0000","last_fullsized":"2024-08-17T02:26:29.648844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:14.890075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.657852+0000","last_change":"2024-08-17T02:26:28.630436+0000","last_active":"2024-08-17T02:26:29.657852+0000","last_peered":"2024-08-17T02:26:29.657852+0000","last_clean":"2024-08-17T02:26:29.657852+0000","last_became_active":"2024-08-17T02:26:28.630171+0000","last_became_peered":"2024-08-17T02:26:28.630171+0000","last_unstale":"2024-08-17T02:26:29.657852+0000","last_undegraded":"2024-08-17T02:26:29.657852+0000","last_fullsized":"2024-08-17T02:26:29.657852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:26:55.149220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648766+0000","last_change":"2024-08-17T02:26:29.643306+0000","last_active":"2024-08-17T02:26:29.648766+0000","last_peered":"2024-08-17T02:26:29.648766+0000","last_clean":"2024-08-17T02:26:29.648766+0000","last_became_active":"2024-08-17T02:26:29.642913+0000","last_became_peered":"2024-08-17T02:26:29.642913+0000","last_unstale":"2024-08-17T02:26:29.648766+0000","last_undegraded":"2024-08-17T02:26:29.648766+0000","last_fullsized":"2024-08-17T02:26:29.648766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:33:07.414644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655429+0000","last_change":"2024-08-17T02:26:28.634383+0000","last_active":"2024-08-17T02:26:29.655429+0000","last_peered":"2024-08-17T02:26:29.655429+0000","last_clean":"2024-08-17T02:26:29.655429+0000","last_became_active":"2024-08-17T02:26:28.634016+0000","last_became_peered":"2024-08-17T02:26:28.634016+0000","last_unstale":"2024-08-17T02:26:29.655429+0000","last_undegraded":"2024-08-17T02:26:29.655429+0000","last_fullsized":"2024-08-17T02:26:29.655429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:43.175503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646736+0000","last_change":"2024-08-17T02:26:29.644720+0000","last_active":"2024-08-17T02:26:29.646736+0000","last_peered":"2024-08-17T02:26:29.646736+0000","last_clean":"2024-08-17T02:26:29.646736+0000","last_became_active":"2024-08-17T02:26:29.644375+0000","last_became_peered":"2024-08-17T02:26:29.644375+0000","last_unstale":"2024-08-17T02:26:29.646736+0000","last_undegraded":"2024-08-17T02:26:29.646736+0000","last_fullsized":"2024-08-17T02:26:29.646736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:00.664060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.624632+0000","last_change":"2024-08-17T02:26:28.623679+0000","last_active":"2024-08-17T02:26:29.624632+0000","last_peered":"2024-08-17T02:26:29.624632+0000","last_clean":"2024-08-17T02:26:29.624632+0000","last_became_active":"2024-08-17T02:26:28.623119+0000","last_became_peered":"2024-08-17T02:26:28.623119+0000","last_unstale":"2024-08-17T02:26:29.624632+0000","last_undegraded":"2024-08-17T02:26:29.624632+0000","last_fullsized":"2024-08-17T02:26:29.624632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:42.099769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648843+0000","last_change":"2024-08-17T02:26:29.642849+0000","last_active":"2024-08-17T02:26:29.648843+0000","last_peered":"2024-08-17T02:26:29.648843+0000","last_clean":"2024-08-17T02:26:29.648843+0000","last_became_active":"2024-08-17T02:26:29.642553+0000","last_became_peered":"2024-08-17T02:26:29.642553+0000","last_unstale":"2024-08-17T02:26:29.648843+0000","last_undegraded":"2024-08-17T02:26:29.648843+0000","last_fullsized":"2024-08-17T02:26:29.648843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.627785+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:26:29.627785+0000","last_peered":"2024-08-17T02:26:29.627785+0000","last_clean":"2024-08-17T02:26:29.627785+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:26:29.627785+0000","last_undegraded":"2024-08-17T02:26:29.627785+0000","last_fullsized":"2024-08-17T02:26:29.627785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.621608+0000","last_change":"2024-08-17T02:26:28.625688+0000","last_active":"2024-08-17T02:26:29.621608+0000","last_peered":"2024-08-17T02:26:29.621608+0000","last_clean":"2024-08-17T02:26:29.621608+0000","last_became_active":"2024-08-17T02:26:28.625349+0000","last_became_peered":"2024-08-17T02:26:28.625349+0000","last_unstale":"2024-08-17T02:26:29.621608+0000","last_undegraded":"2024-08-17T02:26:29.621608+0000","last_fullsized":"2024-08-17T02:26:29.621608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:29.548053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638507+0000","last_change":"2024-08-17T02:26:29.633562+0000","last_active":"2024-08-17T02:26:29.638507+0000","last_peered":"2024-08-17T02:26:29.638507+0000","last_clean":"2024-08-17T02:26:29.638507+0000","last_became_active":"2024-08-17T02:26:29.632985+0000","last_became_peered":"2024-08-17T02:26:29.632985+0000","last_unstale":"2024-08-17T02:26:29.638507+0000","last_undegraded":"2024-08-17T02:26:29.638507+0000","last_fullsized":"2024-08-17T02:26:29.638507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:51.558217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.627770+0000","last_change":"2024-08-17T02:26:28.631707+0000","last_active":"2024-08-17T02:26:29.627770+0000","last_peered":"2024-08-17T02:26:29.627770+0000","last_clean":"2024-08-17T02:26:29.627770+0000","last_became_active":"2024-08-17T02:26:28.631374+0000","last_became_peered":"2024-08-17T02:26:28.631374+0000","last_unstale":"2024-08-17T02:26:29.627770+0000","last_undegraded":"2024-08-17T02:26:29.627770+0000","last_fullsized":"2024-08-17T02:26:29.627770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:41.350163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.633745+0000","last_change":"2024-08-17T02:26:29.630167+0000","last_active":"2024-08-17T02:26:29.633745+0000","last_peered":"2024-08-17T02:26:29.633745+0000","last_clean":"2024-08-17T02:26:29.633745+0000","last_became_active":"2024-08-17T02:26:29.629312+0000","last_became_peered":"2024-08-17T02:26:29.629312+0000","last_unstale":"2024-08-17T02:26:29.633745+0000","last_undegraded":"2024-08-17T02:26:29.633745+0000","last_fullsized":"2024-08-17T02:26:29.633745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:21.305240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.625657+0000","last_change":"2024-08-17T02:26:28.628231+0000","last_active":"2024-08-17T02:26:29.625657+0000","last_peered":"2024-08-17T02:26:29.625657+0000","last_clean":"2024-08-17T02:26:29.625657+0000","last_became_active":"2024-08-17T02:26:28.627917+0000","last_became_peered":"2024-08-17T02:26:28.627917+0000","last_unstale":"2024-08-17T02:26:29.625657+0000","last_undegraded":"2024-08-17T02:26:29.625657+0000","last_fullsized":"2024-08-17T02:26:29.625657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:16:07.881276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637667+0000","last_change":"2024-08-17T02:26:29.627626+0000","last_active":"2024-08-17T02:26:29.637667+0000","last_peered":"2024-08-17T02:26:29.637667+0000","last_clean":"2024-08-17T02:26:29.637667+0000","last_became_active":"2024-08-17T02:26:29.627267+0000","last_became_peered":"2024-08-17T02:26:29.627267+0000","last_unstale":"2024-08-17T02:26:29.637667+0000","last_undegraded":"2024-08-17T02:26:29.637667+0000","last_fullsized":"2024-08-17T02:26:29.637667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:59.025392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.622874+0000","last_change":"2024-08-17T02:26:28.631076+0000","last_active":"2024-08-17T02:26:29.622874+0000","last_peered":"2024-08-17T02:26:29.622874+0000","last_clean":"2024-08-17T02:26:29.622874+0000","last_became_active":"2024-08-17T02:26:28.630766+0000","last_became_peered":"2024-08-17T02:26:28.630766+0000","last_unstale":"2024-08-17T02:26:29.622874+0000","last_undegraded":"2024-08-17T02:26:29.622874+0000","last_fullsized":"2024-08-17T02:26:29.622874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:52.647000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642846+0000","last_change":"2024-08-17T02:26:29.640421+0000","last_active":"2024-08-17T02:26:29.642846+0000","last_peered":"2024-08-17T02:26:29.642846+0000","last_clean":"2024-08-17T02:26:29.642846+0000","last_became_active":"2024-08-17T02:26:29.639492+0000","last_became_peered":"2024-08-17T02:26:29.639492+0000","last_unstale":"2024-08-17T02:26:29.642846+0000","last_undegraded":"2024-08-17T02:26:29.642846+0000","last_fullsized":"2024-08-17T02:26:29.642846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:58.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614778+0000","last_change":"2024-08-17T02:26:28.632665+0000","last_active":"2024-08-17T02:26:29.614778+0000","last_peered":"2024-08-17T02:26:29.614778+0000","last_clean":"2024-08-17T02:26:29.614778+0000","last_became_active":"2024-08-17T02:26:28.632323+0000","last_became_peered":"2024-08-17T02:26:28.632323+0000","last_unstale":"2024-08-17T02:26:29.614778+0000","last_undegraded":"2024-08-17T02:26:29.614778+0000","last_fullsized":"2024-08-17T02:26:29.614778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:26:55.149220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646510+0000","last_change":"2024-08-17T02:26:29.644054+0000","last_active":"2024-08-17T02:26:29.646510+0000","last_peered":"2024-08-17T02:26:29.646510+0000","last_clean":"2024-08-17T02:26:29.646510+0000","last_became_active":"2024-08-17T02:26:29.643787+0000","last_became_peered":"2024-08-17T02:26:29.643787+0000","last_unstale":"2024-08-17T02:26:29.646510+0000","last_undegraded":"2024-08-17T02:26:29.646510+0000","last_fullsized":"2024-08-17T02:26:29.646510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:33:07.414644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.630795+0000","last_change":"2024-08-17T02:26:28.640251+0000","last_active":"2024-08-17T02:26:29.630795+0000","last_peered":"2024-08-17T02:26:29.630795+0000","last_clean":"2024-08-17T02:26:29.630795+0000","last_became_active":"2024-08-17T02:26:28.639914+0000","last_became_peered":"2024-08-17T02:26:28.639914+0000","last_unstale":"2024-08-17T02:26:29.630795+0000","last_undegraded":"2024-08-17T02:26:29.630795+0000","last_fullsized":"2024-08-17T02:26:29.630795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:36.775419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637630+0000","last_change":"2024-08-17T02:26:29.627697+0000","last_active":"2024-08-17T02:26:29.637630+0000","last_peered":"2024-08-17T02:26:29.637630+0000","last_clean":"2024-08-17T02:26:29.637630+0000","last_became_active":"2024-08-17T02:26:29.627394+0000","last_became_peered":"2024-08-17T02:26:29.627394+0000","last_unstale":"2024-08-17T02:26:29.637630+0000","last_undegraded":"2024-08-17T02:26:29.637630+0000","last_fullsized":"2024-08-17T02:26:29.637630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:07.710268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:26:30.641883+0000","last_change":"2024-08-17T02:26:28.631203+0000","last_active":"2024-08-17T02:26:30.641883+0000","last_peered":"2024-08-17T02:26:30.641883+0000","last_clean":"2024-08-17T02:26:30.641883+0000","last_became_active":"2024-08-17T02:26:28.630811+0000","last_became_peered":"2024-08-17T02:26:28.630811+0000","last_unstale":"2024-08-17T02:26:30.641883+0000","last_undegraded":"2024-08-17T02:26:30.641883+0000","last_fullsized":"2024-08-17T02:26:30.641883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:18.735646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638361+0000","last_change":"2024-08-17T02:26:29.634101+0000","last_active":"2024-08-17T02:26:29.638361+0000","last_peered":"2024-08-17T02:26:29.638361+0000","last_clean":"2024-08-17T02:26:29.638361+0000","last_became_active":"2024-08-17T02:26:29.633815+0000","last_became_peered":"2024-08-17T02:26:29.633815+0000","last_unstale":"2024-08-17T02:26:29.638361+0000","last_undegraded":"2024-08-17T02:26:29.638361+0000","last_fullsized":"2024-08-17T02:26:29.638361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:32.790776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.658241+0000","last_change":"2024-08-17T02:26:28.632292+0000","last_active":"2024-08-17T02:26:29.658241+0000","last_peered":"2024-08-17T02:26:29.658241+0000","last_clean":"2024-08-17T02:26:29.658241+0000","last_became_active":"2024-08-17T02:26:28.631868+0000","last_became_peered":"2024-08-17T02:26:28.631868+0000","last_unstale":"2024-08-17T02:26:29.658241+0000","last_undegraded":"2024-08-17T02:26:29.658241+0000","last_fullsized":"2024-08-17T02:26:29.658241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:44.839971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.635015+0000","last_change":"2024-08-17T02:26:29.631655+0000","last_active":"2024-08-17T02:26:29.635015+0000","last_peered":"2024-08-17T02:26:29.635015+0000","last_clean":"2024-08-17T02:26:29.635015+0000","last_became_active":"2024-08-17T02:26:29.631271+0000","last_became_peered":"2024-08-17T02:26:29.631271+0000","last_unstale":"2024-08-17T02:26:29.635015+0000","last_undegraded":"2024-08-17T02:26:29.635015+0000","last_fullsized":"2024-08-17T02:26:29.635015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:15.601838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.627629+0000","last_change":"2024-08-17T02:26:28.634093+0000","last_active":"2024-08-17T02:26:29.627629+0000","last_peered":"2024-08-17T02:26:29.627629+0000","last_clean":"2024-08-17T02:26:29.627629+0000","last_became_active":"2024-08-17T02:26:28.633526+0000","last_became_peered":"2024-08-17T02:26:28.633526+0000","last_unstale":"2024-08-17T02:26:29.627629+0000","last_undegraded":"2024-08-17T02:26:29.627629+0000","last_fullsized":"2024-08-17T02:26:29.627629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:57.732706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641906+0000","last_change":"2024-08-17T02:26:29.630504+0000","last_active":"2024-08-17T02:26:29.641906+0000","last_peered":"2024-08-17T02:26:29.641906+0000","last_clean":"2024-08-17T02:26:29.641906+0000","last_became_active":"2024-08-17T02:26:29.630225+0000","last_became_peered":"2024-08-17T02:26:29.630225+0000","last_unstale":"2024-08-17T02:26:29.641906+0000","last_undegraded":"2024-08-17T02:26:29.641906+0000","last_fullsized":"2024-08-17T02:26:29.641906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:37.783072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614495+0000","last_change":"2024-08-17T02:26:28.627068+0000","last_active":"2024-08-17T02:26:29.614495+0000","last_peered":"2024-08-17T02:26:29.614495+0000","last_clean":"2024-08-17T02:26:29.614495+0000","last_became_active":"2024-08-17T02:26:28.626727+0000","last_became_peered":"2024-08-17T02:26:28.626727+0000","last_unstale":"2024-08-17T02:26:29.614495+0000","last_undegraded":"2024-08-17T02:26:29.614495+0000","last_fullsized":"2024-08-17T02:26:29.614495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:18:32.727047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638319+0000","last_change":"2024-08-17T02:26:29.630289+0000","last_active":"2024-08-17T02:26:29.638319+0000","last_peered":"2024-08-17T02:26:29.638319+0000","last_clean":"2024-08-17T02:26:29.638319+0000","last_became_active":"2024-08-17T02:26:29.629189+0000","last_became_peered":"2024-08-17T02:26:29.629189+0000","last_unstale":"2024-08-17T02:26:29.638319+0000","last_undegraded":"2024-08-17T02:26:29.638319+0000","last_fullsized":"2024-08-17T02:26:29.638319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:07.710268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614139+0000","last_change":"2024-08-17T02:26:28.630536+0000","last_active":"2024-08-17T02:26:29.614139+0000","last_peered":"2024-08-17T02:26:29.614139+0000","last_clean":"2024-08-17T02:26:29.614139+0000","last_became_active":"2024-08-17T02:26:28.630123+0000","last_became_peered":"2024-08-17T02:26:28.630123+0000","last_unstale":"2024-08-17T02:26:29.614139+0000","last_undegraded":"2024-08-17T02:26:29.614139+0000","last_fullsized":"2024-08-17T02:26:29.614139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:16:07.881276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642880+0000","last_change":"2024-08-17T02:26:29.636188+0000","last_active":"2024-08-17T02:26:29.642880+0000","last_peered":"2024-08-17T02:26:29.642880+0000","last_clean":"2024-08-17T02:26:29.642880+0000","last_became_active":"2024-08-17T02:26:29.634865+0000","last_became_peered":"2024-08-17T02:26:29.634865+0000","last_unstale":"2024-08-17T02:26:29.642880+0000","last_undegraded":"2024-08-17T02:26:29.642880+0000","last_fullsized":"2024-08-17T02:26:29.642880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:59.025392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.657802+0000","last_change":"2024-08-17T02:26:28.639322+0000","last_active":"2024-08-17T02:26:29.657802+0000","last_peered":"2024-08-17T02:26:29.657802+0000","last_clean":"2024-08-17T02:26:29.657802+0000","last_became_active":"2024-08-17T02:26:28.638980+0000","last_became_peered":"2024-08-17T02:26:28.638980+0000","last_unstale":"2024-08-17T02:26:29.657802+0000","last_undegraded":"2024-08-17T02:26:29.657802+0000","last_fullsized":"2024-08-17T02:26:29.657802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:44.839971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645942+0000","last_change":"2024-08-17T02:26:29.643786+0000","last_active":"2024-08-17T02:26:29.645942+0000","last_peered":"2024-08-17T02:26:29.645942+0000","last_clean":"2024-08-17T02:26:29.645942+0000","last_became_active":"2024-08-17T02:26:29.643526+0000","last_became_peered":"2024-08-17T02:26:29.643526+0000","last_unstale":"2024-08-17T02:26:29.645942+0000","last_undegraded":"2024-08-17T02:26:29.645942+0000","last_fullsized":"2024-08-17T02:26:29.645942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:34.532005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.644988+0000","last_change":"2024-08-17T02:26:29.639581+0000","last_active":"2024-08-17T02:26:29.644988+0000","last_peered":"2024-08-17T02:26:29.644988+0000","last_clean":"2024-08-17T02:26:29.644988+0000","last_became_active":"2024-08-17T02:26:29.639288+0000","last_became_peered":"2024-08-17T02:26:29.639288+0000","last_unstale":"2024-08-17T02:26:29.644988+0000","last_undegraded":"2024-08-17T02:26:29.644988+0000","last_fullsized":"2024-08-17T02:26:29.644988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:08.902200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.653463+0000","last_change":"2024-08-17T02:26:28.631767+0000","last_active":"2024-08-17T02:26:29.653463+0000","last_peered":"2024-08-17T02:26:29.653463+0000","last_clean":"2024-08-17T02:26:29.653463+0000","last_became_active":"2024-08-17T02:26:28.631510+0000","last_became_peered":"2024-08-17T02:26:28.631510+0000","last_unstale":"2024-08-17T02:26:29.653463+0000","last_undegraded":"2024-08-17T02:26:29.653463+0000","last_fullsized":"2024-08-17T02:26:29.653463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:52.647000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.644827+0000","last_change":"2024-08-17T02:26:29.639249+0000","last_active":"2024-08-17T02:26:29.644827+0000","last_peered":"2024-08-17T02:26:29.644827+0000","last_clean":"2024-08-17T02:26:29.644827+0000","last_became_active":"2024-08-17T02:26:29.638931+0000","last_became_peered":"2024-08-17T02:26:29.638931+0000","last_unstale":"2024-08-17T02:26:29.644827+0000","last_undegraded":"2024-08-17T02:26:29.644827+0000","last_fullsized":"2024-08-17T02:26:29.644827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:52.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.657981+0000","last_change":"2024-08-17T02:26:28.633038+0000","last_active":"2024-08-17T02:26:29.657981+0000","last_peered":"2024-08-17T02:26:29.657981+0000","last_clean":"2024-08-17T02:26:29.657981+0000","last_became_active":"2024-08-17T02:26:28.632663+0000","last_became_peered":"2024-08-17T02:26:28.632663+0000","last_unstale":"2024-08-17T02:26:29.657981+0000","last_undegraded":"2024-08-17T02:26:29.657981+0000","last_fullsized":"2024-08-17T02:26:29.657981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:33.058469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640555+0000","last_change":"2024-08-17T02:26:29.634810+0000","last_active":"2024-08-17T02:26:29.640555+0000","last_peered":"2024-08-17T02:26:29.640555+0000","last_clean":"2024-08-17T02:26:29.640555+0000","last_became_active":"2024-08-17T02:26:29.634539+0000","last_became_peered":"2024-08-17T02:26:29.634539+0000","last_unstale":"2024-08-17T02:26:29.640555+0000","last_undegraded":"2024-08-17T02:26:29.640555+0000","last_fullsized":"2024-08-17T02:26:29.640555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:25.035787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.652170+0000","last_change":"2024-08-17T02:26:28.632880+0000","last_active":"2024-08-17T02:26:29.652170+0000","last_peered":"2024-08-17T02:26:29.652170+0000","last_clean":"2024-08-17T02:26:29.652170+0000","last_became_active":"2024-08-17T02:26:28.632517+0000","last_became_peered":"2024-08-17T02:26:28.632517+0000","last_unstale":"2024-08-17T02:26:29.652170+0000","last_undegraded":"2024-08-17T02:26:29.652170+0000","last_fullsized":"2024-08-17T02:26:29.652170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:53.080183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642944+0000","last_change":"2024-08-17T02:26:29.636544+0000","last_active":"2024-08-17T02:26:29.642944+0000","last_peered":"2024-08-17T02:26:29.642944+0000","last_clean":"2024-08-17T02:26:29.642944+0000","last_became_active":"2024-08-17T02:26:29.636210+0000","last_became_peered":"2024-08-17T02:26:29.636210+0000","last_unstale":"2024-08-17T02:26:29.642944+0000","last_undegraded":"2024-08-17T02:26:29.642944+0000","last_fullsized":"2024-08-17T02:26:29.642944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:29:04.485592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.656084+0000","last_change":"2024-08-17T02:26:28.631963+0000","last_active":"2024-08-17T02:26:29.656084+0000","last_peered":"2024-08-17T02:26:29.656084+0000","last_clean":"2024-08-17T02:26:29.656084+0000","last_became_active":"2024-08-17T02:26:28.631315+0000","last_became_peered":"2024-08-17T02:26:28.631315+0000","last_unstale":"2024-08-17T02:26:29.656084+0000","last_undegraded":"2024-08-17T02:26:29.656084+0000","last_fullsized":"2024-08-17T02:26:29.656084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:21.706815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":79160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":77608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":77768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":819200,"data_stored":668546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":79160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":77698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":233472,"data_stored":77734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":827392,"data_stored":668602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:36.639 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:36.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 Processor -- start 2024-08-17T02:26:36.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 -- start start 2024-08-17T02:26:36.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ed00b0b50 0x7f1ed00aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed006e1b0 con 0x7f1ed015b050 2024-08-17T02:26:36.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed00af450 con 0x7f1ed00af050 2024-08-17T02:26:36.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed00b10e0 con 0x7f1ed00b0b50 2024-08-17T02:26:36.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed5874700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ed00b0b50 0x7f1ed00aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed6075700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1ed015b050 0x7f1ed015e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34004/0 (socket says 172.21.15.19:34004) 2024-08-17T02:26:36.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed6075700 1 -- 172.21.15.19:0/2291165901 learned_addr learned my addr 172.21.15.19:0/2291165901 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:36.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed5874700 1 -- 172.21.15.19:0/2291165901 >> v1:172.21.15.119:6789/0 conn(0x7f1ed00af050 legacy=0x7f1ed015f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed5874700 1 -- 172.21.15.19:0/2291165901 >> v1:172.21.15.19:6789/0 conn(0x7f1ed015b050 legacy=0x7f1ed015e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed5874700 1 -- 172.21.15.19:0/2291165901 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00b13c0 con 0x7f1ed00b0b50 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed5874700 1 --2- 172.21.15.19:0/2291165901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed00b0b50 0x7f1ed00aeb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80098e0 tx=0x7f1eb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452163d091bbd947 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed5073700 1 -- 172.21.15.19:0/2291165901 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8009e80 con 0x7f1ed00b0b50 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed5073700 1 -- 172.21.15.19:0/2291165901 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb800b820 con 0x7f1ed00b0b50 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed5073700 1 -- 172.21.15.19:0/2291165901 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb800bba0 con 0x7f1ed00b0b50 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 -- 172.21.15.19:0/2291165901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed00b0b50 msgr2=0x7f1ed00aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 --2- 172.21.15.19:0/2291165901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed00b0b50 0x7f1ed00aeb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80098e0 tx=0x7f1eb80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 -- 172.21.15.19:0/2291165901 shutdown_connections 2024-08-17T02:26:36.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 --2- 172.21.15.19:0/2291165901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed00b0b50 0x7f1ed00aeb10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 -- 172.21.15.19:0/2291165901 >> 172.21.15.19:0/2291165901 conn(0x7f1ed0067860 msgr2=0x7f1ed0067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 -- 172.21.15.19:0/2291165901 shutdown_connections 2024-08-17T02:26:36.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.735+0000 7f1ed7077700 1 -- 172.21.15.19:0/2291165901 wait complete. 2024-08-17T02:26:36.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 Processor -- start 2024-08-17T02:26:36.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 -- start start 2024-08-17T02:26:36.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00af050 0x7f1ed0142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00b0b50 0x7f1ed01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed015b050 0x7f1ed0155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0150bc0 con 0x7f1ed015b050 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0150690 con 0x7f1ed00b0b50 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed014f830 con 0x7f1ed00af050 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6876700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed015b050 0x7f1ed0155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6876700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed015b050 0x7f1ed0155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58710/0 (socket says 172.21.15.19:58710) 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6876700 1 -- 172.21.15.19:0/2778299821 learned_addr learned my addr 172.21.15.19:0/2778299821 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6075700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00af050 0x7f1ed0142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed5874700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00b0b50 0x7f1ed01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6876700 1 -- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00af050 msgr2=0x7f1ed0142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6876700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00af050 0x7f1ed0142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6876700 1 -- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00b0b50 msgr2=0x7f1ed01557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6876700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00b0b50 0x7f1ed01557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6876700 1 -- 172.21.15.19:0/2778299821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb8009420 con 0x7f1ed015b050 2024-08-17T02:26:36.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed6876700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed015b050 0x7f1ed0155d30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000c930 tx=0x7f1ec00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ece7fc700 1 -- 172.21.15.19:0/2778299821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0012630 con 0x7f1ed015b050 2024-08-17T02:26:36.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed014fa80 con 0x7f1ed015b050 2024-08-17T02:26:36.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ece7fc700 1 -- 172.21.15.19:0/2778299821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00127d0 con 0x7f1ed015b050 2024-08-17T02:26:36.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed0150040 con 0x7f1ed015b050 2024-08-17T02:26:36.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.739+0000 7f1ece7fc700 1 -- 172.21.15.19:0/2778299821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0012b70 con 0x7f1ed015b050 2024-08-17T02:26:36.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.743+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed00643a0 con 0x7f1ed015b050 2024-08-17T02:26:36.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.743+0000 7f1ece7fc700 1 -- 172.21.15.19:0/2778299821 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1ec001a3b0 con 0x7f1ed015b050 2024-08-17T02:26:36.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.743+0000 7f1ece7fc700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1eb0060860 0x7f1eb0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.743+0000 7f1ece7fc700 1 -- 172.21.15.19:0/2778299821 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ec007c970 con 0x7f1ed015b050 2024-08-17T02:26:36.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.743+0000 7f1ed6075700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1eb0060860 0x7f1eb0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.743+0000 7f1ed6075700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1eb0060860 0x7f1eb0062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8001950 tx=0x7f1ec8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.751+0000 7f1ece7fc700 1 -- 172.21.15.19:0/2778299821 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1ec004cd20 con 0x7f1ed015b050 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.903+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ed00afe20 con 0x7f1eb0060860 2024-08-17T02:26:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.923+0000 7f1ece7fc700 1 -- 172.21.15.19:0/2778299821 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264475 (secure 0 0 0) 0x7f1ed00afe20 con 0x7f1eb0060860 2024-08-17T02:26:36.931 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1eb0060860 msgr2=0x7f1eb0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1eb0060860 0x7f1eb0062d10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8001950 tx=0x7f1ec8009040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed015b050 msgr2=0x7f1ed0155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed015b050 0x7f1ed0155d30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000c930 tx=0x7f1ec00026e0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 shutdown_connections 2024-08-17T02:26:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1eb0060860 0x7f1eb0062d10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed015b050 0x7f1ed0155d30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00b0b50 0x7f1ed01557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 --2- 172.21.15.19:0/2778299821 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00af050 0x7f1ed0142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 >> 172.21.15.19:0/2778299821 conn(0x7f1ed0067860 msgr2=0x7f1ed0063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 shutdown_connections 2024-08-17T02:26:36.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:36.927+0000 7f1ed7077700 1 -- 172.21.15.19:0/2778299821 wait complete. 2024-08-17T02:26:36.934 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:26:36.944 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-08-17T02:26:36.763474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381820,"kb_used_data":2952,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592900,"statfs":{"total":773094113280,"available":770655129600,"internally_reserved":0,"allocated":3022848,"data_stored":1806276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002944"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646126+0000","last_change":"2024-08-17T02:26:29.640917+0000","last_active":"2024-08-17T02:26:29.646126+0000","last_peered":"2024-08-17T02:26:29.646126+0000","last_clean":"2024-08-17T02:26:29.646126+0000","last_became_active":"2024-08-17T02:26:29.640351+0000","last_became_peered":"2024-08-17T02:26:29.640351+0000","last_unstale":"2024-08-17T02:26:29.646126+0000","last_undegraded":"2024-08-17T02:26:29.646126+0000","last_fullsized":"2024-08-17T02:26:29.646126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:05.168789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640537+0000","last_change":"2024-08-17T02:26:29.631753+0000","last_active":"2024-08-17T02:26:29.640537+0000","last_peered":"2024-08-17T02:26:29.640537+0000","last_clean":"2024-08-17T02:26:29.640537+0000","last_became_active":"2024-08-17T02:26:29.631252+0000","last_became_peered":"2024-08-17T02:26:29.631252+0000","last_unstale":"2024-08-17T02:26:29.640537+0000","last_undegraded":"2024-08-17T02:26:29.640537+0000","last_fullsized":"2024-08-17T02:26:29.640537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:32.790776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.633641+0000","last_change":"2024-08-17T02:26:29.627763+0000","last_active":"2024-08-17T02:26:29.633641+0000","last_peered":"2024-08-17T02:26:29.633641+0000","last_clean":"2024-08-17T02:26:29.633641+0000","last_became_active":"2024-08-17T02:26:29.627138+0000","last_became_peered":"2024-08-17T02:26:29.627138+0000","last_unstale":"2024-08-17T02:26:29.633641+0000","last_undegraded":"2024-08-17T02:26:29.633641+0000","last_fullsized":"2024-08-17T02:26:29.633641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:17.721814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646429+0000","last_change":"2024-08-17T02:26:29.641271+0000","last_active":"2024-08-17T02:26:29.646429+0000","last_peered":"2024-08-17T02:26:29.646429+0000","last_clean":"2024-08-17T02:26:29.646429+0000","last_became_active":"2024-08-17T02:26:29.640880+0000","last_became_peered":"2024-08-17T02:26:29.640880+0000","last_unstale":"2024-08-17T02:26:29.646429+0000","last_undegraded":"2024-08-17T02:26:29.646429+0000","last_fullsized":"2024-08-17T02:26:29.646429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:14.890075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645654+0000","last_change":"2024-08-17T02:26:29.640518+0000","last_active":"2024-08-17T02:26:29.645654+0000","last_peered":"2024-08-17T02:26:29.645654+0000","last_clean":"2024-08-17T02:26:29.645654+0000","last_became_active":"2024-08-17T02:26:29.640227+0000","last_became_peered":"2024-08-17T02:26:29.640227+0000","last_unstale":"2024-08-17T02:26:29.645654+0000","last_undegraded":"2024-08-17T02:26:29.645654+0000","last_fullsized":"2024-08-17T02:26:29.645654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:00.664060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643595+0000","last_change":"2024-08-17T02:26:29.635633+0000","last_active":"2024-08-17T02:26:29.643595+0000","last_peered":"2024-08-17T02:26:29.643595+0000","last_clean":"2024-08-17T02:26:29.643595+0000","last_became_active":"2024-08-17T02:26:29.635105+0000","last_became_peered":"2024-08-17T02:26:29.635105+0000","last_unstale":"2024-08-17T02:26:29.643595+0000","last_undegraded":"2024-08-17T02:26:29.643595+0000","last_fullsized":"2024-08-17T02:26:29.643595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641206+0000","last_change":"2024-08-17T02:26:29.637618+0000","last_active":"2024-08-17T02:26:29.641206+0000","last_peered":"2024-08-17T02:26:29.641206+0000","last_clean":"2024-08-17T02:26:29.641206+0000","last_became_active":"2024-08-17T02:26:29.637303+0000","last_became_peered":"2024-08-17T02:26:29.637303+0000","last_unstale":"2024-08-17T02:26:29.641206+0000","last_undegraded":"2024-08-17T02:26:29.641206+0000","last_fullsized":"2024-08-17T02:26:29.641206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:52.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638340+0000","last_change":"2024-08-17T02:26:29.633298+0000","last_active":"2024-08-17T02:26:29.638340+0000","last_peered":"2024-08-17T02:26:29.638340+0000","last_clean":"2024-08-17T02:26:29.638340+0000","last_became_active":"2024-08-17T02:26:29.632930+0000","last_became_peered":"2024-08-17T02:26:29.632930+0000","last_unstale":"2024-08-17T02:26:29.638340+0000","last_undegraded":"2024-08-17T02:26:29.638340+0000","last_fullsized":"2024-08-17T02:26:29.638340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:57:32.160542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648681+0000","last_change":"2024-08-17T02:26:29.641107+0000","last_active":"2024-08-17T02:26:29.648681+0000","last_peered":"2024-08-17T02:26:29.648681+0000","last_clean":"2024-08-17T02:26:29.648681+0000","last_became_active":"2024-08-17T02:26:29.640661+0000","last_became_peered":"2024-08-17T02:26:29.640661+0000","last_unstale":"2024-08-17T02:26:29.648681+0000","last_undegraded":"2024-08-17T02:26:29.648681+0000","last_fullsized":"2024-08-17T02:26:29.648681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:15:26.950752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645082+0000","last_change":"2024-08-17T02:26:29.638311+0000","last_active":"2024-08-17T02:26:29.645082+0000","last_peered":"2024-08-17T02:26:29.645082+0000","last_clean":"2024-08-17T02:26:29.645082+0000","last_became_active":"2024-08-17T02:26:29.637822+0000","last_became_peered":"2024-08-17T02:26:29.637822+0000","last_unstale":"2024-08-17T02:26:29.645082+0000","last_undegraded":"2024-08-17T02:26:29.645082+0000","last_fullsized":"2024-08-17T02:26:29.645082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:32.532465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642561+0000","last_change":"2024-08-17T02:26:29.637841+0000","last_active":"2024-08-17T02:26:29.642561+0000","last_peered":"2024-08-17T02:26:29.642561+0000","last_clean":"2024-08-17T02:26:29.642561+0000","last_became_active":"2024-08-17T02:26:29.637507+0000","last_became_peered":"2024-08-17T02:26:29.637507+0000","last_unstale":"2024-08-17T02:26:29.642561+0000","last_undegraded":"2024-08-17T02:26:29.642561+0000","last_fullsized":"2024-08-17T02:26:29.642561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:21.305240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641630+0000","last_change":"2024-08-17T02:26:29.636441+0000","last_active":"2024-08-17T02:26:29.641630+0000","last_peered":"2024-08-17T02:26:29.641630+0000","last_clean":"2024-08-17T02:26:29.641630+0000","last_became_active":"2024-08-17T02:26:29.636162+0000","last_became_peered":"2024-08-17T02:26:29.636162+0000","last_unstale":"2024-08-17T02:26:29.641630+0000","last_undegraded":"2024-08-17T02:26:29.641630+0000","last_fullsized":"2024-08-17T02:26:29.641630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:16:28.026775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638420+0000","last_change":"2024-08-17T02:26:29.633625+0000","last_active":"2024-08-17T02:26:29.638420+0000","last_peered":"2024-08-17T02:26:29.638420+0000","last_clean":"2024-08-17T02:26:29.638420+0000","last_became_active":"2024-08-17T02:26:29.633239+0000","last_became_peered":"2024-08-17T02:26:29.633239+0000","last_unstale":"2024-08-17T02:26:29.638420+0000","last_undegraded":"2024-08-17T02:26:29.638420+0000","last_fullsized":"2024-08-17T02:26:29.638420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.728445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643496+0000","last_change":"2024-08-17T02:26:29.638395+0000","last_active":"2024-08-17T02:26:29.643496+0000","last_peered":"2024-08-17T02:26:29.643496+0000","last_clean":"2024-08-17T02:26:29.643496+0000","last_became_active":"2024-08-17T02:26:29.638112+0000","last_became_peered":"2024-08-17T02:26:29.638112+0000","last_unstale":"2024-08-17T02:26:29.643496+0000","last_undegraded":"2024-08-17T02:26:29.643496+0000","last_fullsized":"2024-08-17T02:26:29.643496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:34.532005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637720+0000","last_change":"2024-08-17T02:26:29.627828+0000","last_active":"2024-08-17T02:26:29.637720+0000","last_peered":"2024-08-17T02:26:29.637720+0000","last_clean":"2024-08-17T02:26:29.637720+0000","last_became_active":"2024-08-17T02:26:29.627530+0000","last_became_peered":"2024-08-17T02:26:29.627530+0000","last_unstale":"2024-08-17T02:26:29.637720+0000","last_undegraded":"2024-08-17T02:26:29.637720+0000","last_fullsized":"2024-08-17T02:26:29.637720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:18.366384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634326+0000","last_change":"2024-08-17T02:26:29.628945+0000","last_active":"2024-08-17T02:26:29.634326+0000","last_peered":"2024-08-17T02:26:29.634326+0000","last_clean":"2024-08-17T02:26:29.634326+0000","last_became_active":"2024-08-17T02:26:29.628590+0000","last_became_peered":"2024-08-17T02:26:29.628590+0000","last_unstale":"2024-08-17T02:26:29.634326+0000","last_undegraded":"2024-08-17T02:26:29.634326+0000","last_fullsized":"2024-08-17T02:26:29.634326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:08:17.721814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634543+0000","last_change":"2024-08-17T02:26:29.629331+0000","last_active":"2024-08-17T02:26:29.634543+0000","last_peered":"2024-08-17T02:26:29.634543+0000","last_clean":"2024-08-17T02:26:29.634543+0000","last_became_active":"2024-08-17T02:26:29.629022+0000","last_became_peered":"2024-08-17T02:26:29.629022+0000","last_unstale":"2024-08-17T02:26:29.634543+0000","last_undegraded":"2024-08-17T02:26:29.634543+0000","last_fullsized":"2024-08-17T02:26:29.634543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:15:26.950752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637651+0000","last_change":"2024-08-17T02:26:29.633865+0000","last_active":"2024-08-17T02:26:29.637651+0000","last_peered":"2024-08-17T02:26:29.637651+0000","last_clean":"2024-08-17T02:26:29.637651+0000","last_became_active":"2024-08-17T02:26:29.633518+0000","last_became_peered":"2024-08-17T02:26:29.633518+0000","last_unstale":"2024-08-17T02:26:29.637651+0000","last_undegraded":"2024-08-17T02:26:29.637651+0000","last_fullsized":"2024-08-17T02:26:29.637651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:35.893643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641241+0000","last_change":"2024-08-17T02:26:29.638651+0000","last_active":"2024-08-17T02:26:29.641241+0000","last_peered":"2024-08-17T02:26:29.641241+0000","last_clean":"2024-08-17T02:26:29.641241+0000","last_became_active":"2024-08-17T02:26:29.638400+0000","last_became_peered":"2024-08-17T02:26:29.638400+0000","last_unstale":"2024-08-17T02:26:29.641241+0000","last_undegraded":"2024-08-17T02:26:29.641241+0000","last_fullsized":"2024-08-17T02:26:29.641241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:59.413875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645990+0000","last_change":"2024-08-17T02:26:29.644401+0000","last_active":"2024-08-17T02:26:29.645990+0000","last_peered":"2024-08-17T02:26:29.645990+0000","last_clean":"2024-08-17T02:26:29.645990+0000","last_became_active":"2024-08-17T02:26:29.644100+0000","last_became_peered":"2024-08-17T02:26:29.644100+0000","last_unstale":"2024-08-17T02:26:29.645990+0000","last_undegraded":"2024-08-17T02:26:29.645990+0000","last_fullsized":"2024-08-17T02:26:29.645990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:20.713454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.635113+0000","last_change":"2024-08-17T02:26:29.632167+0000","last_active":"2024-08-17T02:26:29.635113+0000","last_peered":"2024-08-17T02:26:29.635113+0000","last_clean":"2024-08-17T02:26:29.635113+0000","last_became_active":"2024-08-17T02:26:29.631704+0000","last_became_peered":"2024-08-17T02:26:29.631704+0000","last_unstale":"2024-08-17T02:26:29.635113+0000","last_undegraded":"2024-08-17T02:26:29.635113+0000","last_fullsized":"2024-08-17T02:26:29.635113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:32.532465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.639628+0000","last_change":"2024-08-17T02:26:29.632372+0000","last_active":"2024-08-17T02:26:29.639628+0000","last_peered":"2024-08-17T02:26:29.639628+0000","last_clean":"2024-08-17T02:26:29.639628+0000","last_became_active":"2024-08-17T02:26:29.632061+0000","last_became_peered":"2024-08-17T02:26:29.632061+0000","last_unstale":"2024-08-17T02:26:29.639628+0000","last_undegraded":"2024-08-17T02:26:29.639628+0000","last_fullsized":"2024-08-17T02:26:29.639628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:59.413875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643634+0000","last_change":"2024-08-17T02:26:29.640414+0000","last_active":"2024-08-17T02:26:29.643634+0000","last_peered":"2024-08-17T02:26:29.643634+0000","last_clean":"2024-08-17T02:26:29.643634+0000","last_became_active":"2024-08-17T02:26:29.640062+0000","last_became_peered":"2024-08-17T02:26:29.640062+0000","last_unstale":"2024-08-17T02:26:29.643634+0000","last_undegraded":"2024-08-17T02:26:29.643634+0000","last_fullsized":"2024-08-17T02:26:29.643634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:18.366384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645047+0000","last_change":"2024-08-17T02:26:29.640158+0000","last_active":"2024-08-17T02:26:29.645047+0000","last_peered":"2024-08-17T02:26:29.645047+0000","last_clean":"2024-08-17T02:26:29.645047+0000","last_became_active":"2024-08-17T02:26:29.639901+0000","last_became_peered":"2024-08-17T02:26:29.639901+0000","last_unstale":"2024-08-17T02:26:29.645047+0000","last_undegraded":"2024-08-17T02:26:29.645047+0000","last_fullsized":"2024-08-17T02:26:29.645047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:25.035787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643592+0000","last_change":"2024-08-17T02:26:29.640300+0000","last_active":"2024-08-17T02:26:29.643592+0000","last_peered":"2024-08-17T02:26:29.643592+0000","last_clean":"2024-08-17T02:26:29.643592+0000","last_became_active":"2024-08-17T02:26:29.639925+0000","last_became_peered":"2024-08-17T02:26:29.639925+0000","last_unstale":"2024-08-17T02:26:29.643592+0000","last_undegraded":"2024-08-17T02:26:29.643592+0000","last_fullsized":"2024-08-17T02:26:29.643592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:12.800333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645060+0000","last_change":"2024-08-17T02:26:29.632577+0000","last_active":"2024-08-17T02:26:29.645060+0000","last_peered":"2024-08-17T02:26:29.645060+0000","last_clean":"2024-08-17T02:26:29.645060+0000","last_became_active":"2024-08-17T02:26:29.632068+0000","last_became_peered":"2024-08-17T02:26:29.632068+0000","last_unstale":"2024-08-17T02:26:29.645060+0000","last_undegraded":"2024-08-17T02:26:29.645060+0000","last_fullsized":"2024-08-17T02:26:29.645060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:25.035787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640531+0000","last_change":"2024-08-17T02:26:29.635740+0000","last_active":"2024-08-17T02:26:29.640531+0000","last_peered":"2024-08-17T02:26:29.640531+0000","last_clean":"2024-08-17T02:26:29.640531+0000","last_became_active":"2024-08-17T02:26:29.635378+0000","last_became_peered":"2024-08-17T02:26:29.635378+0000","last_unstale":"2024-08-17T02:26:29.640531+0000","last_undegraded":"2024-08-17T02:26:29.640531+0000","last_fullsized":"2024-08-17T02:26:29.640531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:46.990052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643621+0000","last_change":"2024-08-17T02:26:29.640361+0000","last_active":"2024-08-17T02:26:29.643621+0000","last_peered":"2024-08-17T02:26:29.643621+0000","last_clean":"2024-08-17T02:26:29.643621+0000","last_became_active":"2024-08-17T02:26:29.639981+0000","last_became_peered":"2024-08-17T02:26:29.639981+0000","last_unstale":"2024-08-17T02:26:29.643621+0000","last_undegraded":"2024-08-17T02:26:29.643621+0000","last_fullsized":"2024-08-17T02:26:29.643621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:16.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641228+0000","last_change":"2024-08-17T02:26:29.637240+0000","last_active":"2024-08-17T02:26:29.641228+0000","last_peered":"2024-08-17T02:26:29.641228+0000","last_clean":"2024-08-17T02:26:29.641228+0000","last_became_active":"2024-08-17T02:26:29.636928+0000","last_became_peered":"2024-08-17T02:26:29.636928+0000","last_unstale":"2024-08-17T02:26:29.641228+0000","last_undegraded":"2024-08-17T02:26:29.641228+0000","last_fullsized":"2024-08-17T02:26:29.641228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:20.713454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646410+0000","last_change":"2024-08-17T02:26:29.643173+0000","last_active":"2024-08-17T02:26:29.646410+0000","last_peered":"2024-08-17T02:26:29.646410+0000","last_clean":"2024-08-17T02:26:29.646410+0000","last_became_active":"2024-08-17T02:26:29.642920+0000","last_became_peered":"2024-08-17T02:26:29.642920+0000","last_unstale":"2024-08-17T02:26:29.646410+0000","last_undegraded":"2024-08-17T02:26:29.646410+0000","last_fullsized":"2024-08-17T02:26:29.646410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:06:05.168789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637660+0000","last_change":"2024-08-17T02:26:29.633051+0000","last_active":"2024-08-17T02:26:29.637660+0000","last_peered":"2024-08-17T02:26:29.637660+0000","last_clean":"2024-08-17T02:26:29.637660+0000","last_became_active":"2024-08-17T02:26:29.632692+0000","last_became_peered":"2024-08-17T02:26:29.632692+0000","last_unstale":"2024-08-17T02:26:29.637660+0000","last_undegraded":"2024-08-17T02:26:29.637660+0000","last_fullsized":"2024-08-17T02:26:29.637660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:26:37.287663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642677+0000","last_change":"2024-08-17T02:26:29.637059+0000","last_active":"2024-08-17T02:26:29.642677+0000","last_peered":"2024-08-17T02:26:29.642677+0000","last_clean":"2024-08-17T02:26:29.642677+0000","last_became_active":"2024-08-17T02:26:29.634568+0000","last_became_peered":"2024-08-17T02:26:29.634568+0000","last_unstale":"2024-08-17T02:26:29.642677+0000","last_undegraded":"2024-08-17T02:26:29.642677+0000","last_fullsized":"2024-08-17T02:26:29.642677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:15.601838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641098+0000","last_change":"2024-08-17T02:26:29.630504+0000","last_active":"2024-08-17T02:26:29.641098+0000","last_peered":"2024-08-17T02:26:29.641098+0000","last_clean":"2024-08-17T02:26:29.641098+0000","last_became_active":"2024-08-17T02:26:29.629516+0000","last_became_peered":"2024-08-17T02:26:29.629516+0000","last_unstale":"2024-08-17T02:26:29.641098+0000","last_undegraded":"2024-08-17T02:26:29.641098+0000","last_fullsized":"2024-08-17T02:26:29.641098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:42.357817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655894+0000","last_change":"2024-08-17T02:26:28.628658+0000","last_active":"2024-08-17T02:26:29.655894+0000","last_peered":"2024-08-17T02:26:29.655894+0000","last_clean":"2024-08-17T02:26:29.655894+0000","last_became_active":"2024-08-17T02:26:28.628341+0000","last_became_peered":"2024-08-17T02:26:28.628341+0000","last_unstale":"2024-08-17T02:26:29.655894+0000","last_undegraded":"2024-08-17T02:26:29.655894+0000","last_fullsized":"2024-08-17T02:26:29.655894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:42.099769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.634929+0000","last_change":"2024-08-17T02:26:29.630922+0000","last_active":"2024-08-17T02:26:29.634929+0000","last_peered":"2024-08-17T02:26:29.634929+0000","last_clean":"2024-08-17T02:26:29.634929+0000","last_became_active":"2024-08-17T02:26:29.629133+0000","last_became_peered":"2024-08-17T02:26:29.629133+0000","last_unstale":"2024-08-17T02:26:29.634929+0000","last_undegraded":"2024-08-17T02:26:29.634929+0000","last_fullsized":"2024-08-17T02:26:29.634929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:59.413875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.654903+0000","last_change":"2024-08-17T02:26:28.636370+0000","last_active":"2024-08-17T02:26:29.654903+0000","last_peered":"2024-08-17T02:26:29.654903+0000","last_clean":"2024-08-17T02:26:29.654903+0000","last_became_active":"2024-08-17T02:26:28.636030+0000","last_became_peered":"2024-08-17T02:26:28.636030+0000","last_unstale":"2024-08-17T02:26:29.654903+0000","last_undegraded":"2024-08-17T02:26:29.654903+0000","last_fullsized":"2024-08-17T02:26:29.654903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:54.570440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.620818+0000","last_change":"2024-08-17T02:26:28.628598+0000","last_active":"2024-08-17T02:26:29.620818+0000","last_peered":"2024-08-17T02:26:29.620818+0000","last_clean":"2024-08-17T02:26:29.620818+0000","last_became_active":"2024-08-17T02:26:28.627246+0000","last_became_peered":"2024-08-17T02:26:28.627246+0000","last_unstale":"2024-08-17T02:26:29.620818+0000","last_undegraded":"2024-08-17T02:26:29.620818+0000","last_fullsized":"2024-08-17T02:26:29.620818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:39.569935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642967+0000","last_change":"2024-08-17T02:26:29.635943+0000","last_active":"2024-08-17T02:26:29.642967+0000","last_peered":"2024-08-17T02:26:29.642967+0000","last_clean":"2024-08-17T02:26:29.642967+0000","last_became_active":"2024-08-17T02:26:29.634674+0000","last_became_peered":"2024-08-17T02:26:29.634674+0000","last_unstale":"2024-08-17T02:26:29.642967+0000","last_undegraded":"2024-08-17T02:26:29.642967+0000","last_fullsized":"2024-08-17T02:26:29.642967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:46.990052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.621239+0000","last_change":"2024-08-17T02:26:28.627084+0000","last_active":"2024-08-17T02:26:29.621239+0000","last_peered":"2024-08-17T02:26:29.621239+0000","last_clean":"2024-08-17T02:26:29.621239+0000","last_became_active":"2024-08-17T02:26:28.626802+0000","last_became_peered":"2024-08-17T02:26:28.626802+0000","last_unstale":"2024-08-17T02:26:29.621239+0000","last_undegraded":"2024-08-17T02:26:29.621239+0000","last_fullsized":"2024-08-17T02:26:29.621239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:21.706815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637701+0000","last_change":"2024-08-17T02:26:29.626103+0000","last_active":"2024-08-17T02:26:29.637701+0000","last_peered":"2024-08-17T02:26:29.637701+0000","last_clean":"2024-08-17T02:26:29.637701+0000","last_became_active":"2024-08-17T02:26:29.625737+0000","last_became_peered":"2024-08-17T02:26:29.625737+0000","last_unstale":"2024-08-17T02:26:29.637701+0000","last_undegraded":"2024-08-17T02:26:29.637701+0000","last_fullsized":"2024-08-17T02:26:29.637701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:57:32.160542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.625410+0000","last_change":"2024-08-17T02:26:28.628951+0000","last_active":"2024-08-17T02:26:29.625410+0000","last_peered":"2024-08-17T02:26:29.625410+0000","last_clean":"2024-08-17T02:26:29.625410+0000","last_became_active":"2024-08-17T02:26:28.628628+0000","last_became_peered":"2024-08-17T02:26:28.628628+0000","last_unstale":"2024-08-17T02:26:29.625410+0000","last_undegraded":"2024-08-17T02:26:29.625410+0000","last_fullsized":"2024-08-17T02:26:29.625410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:52.647000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.643759+0000","last_change":"2024-08-17T02:26:29.635675+0000","last_active":"2024-08-17T02:26:29.643759+0000","last_peered":"2024-08-17T02:26:29.643759+0000","last_clean":"2024-08-17T02:26:29.643759+0000","last_became_active":"2024-08-17T02:26:29.635384+0000","last_became_peered":"2024-08-17T02:26:29.635384+0000","last_unstale":"2024-08-17T02:26:29.643759+0000","last_undegraded":"2024-08-17T02:26:29.643759+0000","last_fullsized":"2024-08-17T02:26:29.643759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:32.532465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.622717+0000","last_change":"2024-08-17T02:26:28.629856+0000","last_active":"2024-08-17T02:26:29.622717+0000","last_peered":"2024-08-17T02:26:29.622717+0000","last_clean":"2024-08-17T02:26:29.622717+0000","last_became_active":"2024-08-17T02:26:28.629588+0000","last_became_peered":"2024-08-17T02:26:28.629588+0000","last_unstale":"2024-08-17T02:26:29.622717+0000","last_undegraded":"2024-08-17T02:26:29.622717+0000","last_fullsized":"2024-08-17T02:26:29.622717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:44.839971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638031+0000","last_change":"2024-08-17T02:26:29.634638+0000","last_active":"2024-08-17T02:26:29.638031+0000","last_peered":"2024-08-17T02:26:29.638031+0000","last_clean":"2024-08-17T02:26:29.638031+0000","last_became_active":"2024-08-17T02:26:29.634363+0000","last_became_peered":"2024-08-17T02:26:29.634363+0000","last_unstale":"2024-08-17T02:26:29.638031+0000","last_undegraded":"2024-08-17T02:26:29.638031+0000","last_fullsized":"2024-08-17T02:26:29.638031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:22.120795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655581+0000","last_change":"2024-08-17T02:26:28.628000+0000","last_active":"2024-08-17T02:26:29.655581+0000","last_peered":"2024-08-17T02:26:29.655581+0000","last_clean":"2024-08-17T02:26:29.655581+0000","last_became_active":"2024-08-17T02:26:28.627694+0000","last_became_peered":"2024-08-17T02:26:28.627694+0000","last_unstale":"2024-08-17T02:26:29.655581+0000","last_undegraded":"2024-08-17T02:26:29.655581+0000","last_fullsized":"2024-08-17T02:26:29.655581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:26:07.911227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641612+0000","last_change":"2024-08-17T02:26:29.630265+0000","last_active":"2024-08-17T02:26:29.641612+0000","last_peered":"2024-08-17T02:26:29.641612+0000","last_clean":"2024-08-17T02:26:29.641612+0000","last_became_active":"2024-08-17T02:26:29.629158+0000","last_became_peered":"2024-08-17T02:26:29.629158+0000","last_unstale":"2024-08-17T02:26:29.641612+0000","last_undegraded":"2024-08-17T02:26:29.641612+0000","last_fullsized":"2024-08-17T02:26:29.641612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:34.066122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.662983+0000","last_change":"2024-08-17T02:26:28.631995+0000","last_active":"2024-08-17T02:26:29.662983+0000","last_peered":"2024-08-17T02:26:29.662983+0000","last_clean":"2024-08-17T02:26:29.662983+0000","last_became_active":"2024-08-17T02:26:28.631346+0000","last_became_peered":"2024-08-17T02:26:28.631346+0000","last_unstale":"2024-08-17T02:26:29.662983+0000","last_undegraded":"2024-08-17T02:26:29.662983+0000","last_fullsized":"2024-08-17T02:26:29.662983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:31.850537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648822+0000","last_change":"2024-08-17T02:26:29.642029+0000","last_active":"2024-08-17T02:26:29.648822+0000","last_peered":"2024-08-17T02:26:29.648822+0000","last_clean":"2024-08-17T02:26:29.648822+0000","last_became_active":"2024-08-17T02:26:29.641516+0000","last_became_peered":"2024-08-17T02:26:29.641516+0000","last_unstale":"2024-08-17T02:26:29.648822+0000","last_undegraded":"2024-08-17T02:26:29.648822+0000","last_fullsized":"2024-08-17T02:26:29.648822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:13.166542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655408+0000","last_change":"2024-08-17T02:26:28.634455+0000","last_active":"2024-08-17T02:26:29.655408+0000","last_peered":"2024-08-17T02:26:29.655408+0000","last_clean":"2024-08-17T02:26:29.655408+0000","last_became_active":"2024-08-17T02:26:28.633926+0000","last_became_peered":"2024-08-17T02:26:28.633926+0000","last_unstale":"2024-08-17T02:26:29.655408+0000","last_undegraded":"2024-08-17T02:26:29.655408+0000","last_fullsized":"2024-08-17T02:26:29.655408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:12.949717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.635106+0000","last_change":"2024-08-17T02:26:29.631726+0000","last_active":"2024-08-17T02:26:29.635106+0000","last_peered":"2024-08-17T02:26:29.635106+0000","last_clean":"2024-08-17T02:26:29.635106+0000","last_became_active":"2024-08-17T02:26:29.631369+0000","last_became_peered":"2024-08-17T02:26:29.631369+0000","last_unstale":"2024-08-17T02:26:29.635106+0000","last_undegraded":"2024-08-17T02:26:29.635106+0000","last_fullsized":"2024-08-17T02:26:29.635106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:58.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.622746+0000","last_change":"2024-08-17T02:26:28.629917+0000","last_active":"2024-08-17T02:26:29.622746+0000","last_peered":"2024-08-17T02:26:29.622746+0000","last_clean":"2024-08-17T02:26:29.622746+0000","last_became_active":"2024-08-17T02:26:28.629619+0000","last_became_peered":"2024-08-17T02:26:28.629619+0000","last_unstale":"2024-08-17T02:26:29.622746+0000","last_undegraded":"2024-08-17T02:26:29.622746+0000","last_fullsized":"2024-08-17T02:26:29.622746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:23:54.570440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648863+0000","last_change":"2024-08-17T02:26:29.642329+0000","last_active":"2024-08-17T02:26:29.648863+0000","last_peered":"2024-08-17T02:26:29.648863+0000","last_clean":"2024-08-17T02:26:29.648863+0000","last_became_active":"2024-08-17T02:26:29.642040+0000","last_became_peered":"2024-08-17T02:26:29.642040+0000","last_unstale":"2024-08-17T02:26:29.648863+0000","last_undegraded":"2024-08-17T02:26:29.648863+0000","last_fullsized":"2024-08-17T02:26:29.648863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:09.010696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.625528+0000","last_change":"2024-08-17T02:26:28.636363+0000","last_active":"2024-08-17T02:26:29.625528+0000","last_peered":"2024-08-17T02:26:29.625528+0000","last_clean":"2024-08-17T02:26:29.625528+0000","last_became_active":"2024-08-17T02:26:28.636034+0000","last_became_peered":"2024-08-17T02:26:28.636034+0000","last_unstale":"2024-08-17T02:26:29.625528+0000","last_undegraded":"2024-08-17T02:26:29.625528+0000","last_fullsized":"2024-08-17T02:26:29.625528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:29.548053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642694+0000","last_change":"2024-08-17T02:26:29.637246+0000","last_active":"2024-08-17T02:26:29.642694+0000","last_peered":"2024-08-17T02:26:29.642694+0000","last_clean":"2024-08-17T02:26:29.642694+0000","last_became_active":"2024-08-17T02:26:29.636968+0000","last_became_peered":"2024-08-17T02:26:29.636968+0000","last_unstale":"2024-08-17T02:26:29.642694+0000","last_undegraded":"2024-08-17T02:26:29.642694+0000","last_fullsized":"2024-08-17T02:26:29.642694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:17:22.120795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.658576+0000","last_change":"2024-08-17T02:26:28.629052+0000","last_active":"2024-08-17T02:26:29.658576+0000","last_peered":"2024-08-17T02:26:29.658576+0000","last_clean":"2024-08-17T02:26:29.658576+0000","last_became_active":"2024-08-17T02:26:28.628701+0000","last_became_peered":"2024-08-17T02:26:28.628701+0000","last_unstale":"2024-08-17T02:26:29.658576+0000","last_undegraded":"2024-08-17T02:26:29.658576+0000","last_fullsized":"2024-08-17T02:26:29.658576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:32.650882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648889+0000","last_change":"2024-08-17T02:26:29.642870+0000","last_active":"2024-08-17T02:26:29.648889+0000","last_peered":"2024-08-17T02:26:29.648889+0000","last_clean":"2024-08-17T02:26:29.648889+0000","last_became_active":"2024-08-17T02:26:29.642588+0000","last_became_peered":"2024-08-17T02:26:29.642588+0000","last_unstale":"2024-08-17T02:26:29.648889+0000","last_undegraded":"2024-08-17T02:26:29.648889+0000","last_fullsized":"2024-08-17T02:26:29.648889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:08.902200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.654223+0000","last_change":"2024-08-17T02:26:28.634171+0000","last_active":"2024-08-17T02:26:29.654223+0000","last_peered":"2024-08-17T02:26:29.654223+0000","last_clean":"2024-08-17T02:26:29.654223+0000","last_became_active":"2024-08-17T02:26:28.633826+0000","last_became_peered":"2024-08-17T02:26:28.633826+0000","last_unstale":"2024-08-17T02:26:29.654223+0000","last_undegraded":"2024-08-17T02:26:29.654223+0000","last_fullsized":"2024-08-17T02:26:29.654223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:35.824314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648844+0000","last_change":"2024-08-17T02:26:29.643502+0000","last_active":"2024-08-17T02:26:29.648844+0000","last_peered":"2024-08-17T02:26:29.648844+0000","last_clean":"2024-08-17T02:26:29.648844+0000","last_became_active":"2024-08-17T02:26:29.641864+0000","last_became_peered":"2024-08-17T02:26:29.641864+0000","last_unstale":"2024-08-17T02:26:29.648844+0000","last_undegraded":"2024-08-17T02:26:29.648844+0000","last_fullsized":"2024-08-17T02:26:29.648844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:14.890075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.657852+0000","last_change":"2024-08-17T02:26:28.630436+0000","last_active":"2024-08-17T02:26:29.657852+0000","last_peered":"2024-08-17T02:26:29.657852+0000","last_clean":"2024-08-17T02:26:29.657852+0000","last_became_active":"2024-08-17T02:26:28.630171+0000","last_became_peered":"2024-08-17T02:26:28.630171+0000","last_unstale":"2024-08-17T02:26:29.657852+0000","last_undegraded":"2024-08-17T02:26:29.657852+0000","last_fullsized":"2024-08-17T02:26:29.657852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:26:55.149220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648766+0000","last_change":"2024-08-17T02:26:29.643306+0000","last_active":"2024-08-17T02:26:29.648766+0000","last_peered":"2024-08-17T02:26:29.648766+0000","last_clean":"2024-08-17T02:26:29.648766+0000","last_became_active":"2024-08-17T02:26:29.642913+0000","last_became_peered":"2024-08-17T02:26:29.642913+0000","last_unstale":"2024-08-17T02:26:29.648766+0000","last_undegraded":"2024-08-17T02:26:29.648766+0000","last_fullsized":"2024-08-17T02:26:29.648766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:33:07.414644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.655429+0000","last_change":"2024-08-17T02:26:28.634383+0000","last_active":"2024-08-17T02:26:29.655429+0000","last_peered":"2024-08-17T02:26:29.655429+0000","last_clean":"2024-08-17T02:26:29.655429+0000","last_became_active":"2024-08-17T02:26:28.634016+0000","last_became_peered":"2024-08-17T02:26:28.634016+0000","last_unstale":"2024-08-17T02:26:29.655429+0000","last_undegraded":"2024-08-17T02:26:29.655429+0000","last_fullsized":"2024-08-17T02:26:29.655429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:43.175503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646736+0000","last_change":"2024-08-17T02:26:29.644720+0000","last_active":"2024-08-17T02:26:29.646736+0000","last_peered":"2024-08-17T02:26:29.646736+0000","last_clean":"2024-08-17T02:26:29.646736+0000","last_became_active":"2024-08-17T02:26:29.644375+0000","last_became_peered":"2024-08-17T02:26:29.644375+0000","last_unstale":"2024-08-17T02:26:29.646736+0000","last_undegraded":"2024-08-17T02:26:29.646736+0000","last_fullsized":"2024-08-17T02:26:29.646736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:00.664060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.624632+0000","last_change":"2024-08-17T02:26:28.623679+0000","last_active":"2024-08-17T02:26:29.624632+0000","last_peered":"2024-08-17T02:26:29.624632+0000","last_clean":"2024-08-17T02:26:29.624632+0000","last_became_active":"2024-08-17T02:26:28.623119+0000","last_became_peered":"2024-08-17T02:26:28.623119+0000","last_unstale":"2024-08-17T02:26:29.624632+0000","last_undegraded":"2024-08-17T02:26:29.624632+0000","last_fullsized":"2024-08-17T02:26:29.624632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:42.099769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.648843+0000","last_change":"2024-08-17T02:26:29.642849+0000","last_active":"2024-08-17T02:26:29.648843+0000","last_peered":"2024-08-17T02:26:29.648843+0000","last_clean":"2024-08-17T02:26:29.648843+0000","last_became_active":"2024-08-17T02:26:29.642553+0000","last_became_peered":"2024-08-17T02:26:29.642553+0000","last_unstale":"2024-08-17T02:26:29.648843+0000","last_undegraded":"2024-08-17T02:26:29.648843+0000","last_fullsized":"2024-08-17T02:26:29.648843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:35.881039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.627785+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:26:29.627785+0000","last_peered":"2024-08-17T02:26:29.627785+0000","last_clean":"2024-08-17T02:26:29.627785+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:26:29.627785+0000","last_undegraded":"2024-08-17T02:26:29.627785+0000","last_fullsized":"2024-08-17T02:26:29.627785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.621608+0000","last_change":"2024-08-17T02:26:28.625688+0000","last_active":"2024-08-17T02:26:29.621608+0000","last_peered":"2024-08-17T02:26:29.621608+0000","last_clean":"2024-08-17T02:26:29.621608+0000","last_became_active":"2024-08-17T02:26:28.625349+0000","last_became_peered":"2024-08-17T02:26:28.625349+0000","last_unstale":"2024-08-17T02:26:29.621608+0000","last_undegraded":"2024-08-17T02:26:29.621608+0000","last_fullsized":"2024-08-17T02:26:29.621608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:29.548053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638507+0000","last_change":"2024-08-17T02:26:29.633562+0000","last_active":"2024-08-17T02:26:29.638507+0000","last_peered":"2024-08-17T02:26:29.638507+0000","last_clean":"2024-08-17T02:26:29.638507+0000","last_became_active":"2024-08-17T02:26:29.632985+0000","last_became_peered":"2024-08-17T02:26:29.632985+0000","last_unstale":"2024-08-17T02:26:29.638507+0000","last_undegraded":"2024-08-17T02:26:29.638507+0000","last_fullsized":"2024-08-17T02:26:29.638507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:34:51.558217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.627770+0000","last_change":"2024-08-17T02:26:28.631707+0000","last_active":"2024-08-17T02:26:29.627770+0000","last_peered":"2024-08-17T02:26:29.627770+0000","last_clean":"2024-08-17T02:26:29.627770+0000","last_became_active":"2024-08-17T02:26:28.631374+0000","last_became_peered":"2024-08-17T02:26:28.631374+0000","last_unstale":"2024-08-17T02:26:29.627770+0000","last_undegraded":"2024-08-17T02:26:29.627770+0000","last_fullsized":"2024-08-17T02:26:29.627770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:41.350163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.633745+0000","last_change":"2024-08-17T02:26:29.630167+0000","last_active":"2024-08-17T02:26:29.633745+0000","last_peered":"2024-08-17T02:26:29.633745+0000","last_clean":"2024-08-17T02:26:29.633745+0000","last_became_active":"2024-08-17T02:26:29.629312+0000","last_became_peered":"2024-08-17T02:26:29.629312+0000","last_unstale":"2024-08-17T02:26:29.633745+0000","last_undegraded":"2024-08-17T02:26:29.633745+0000","last_fullsized":"2024-08-17T02:26:29.633745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:21.305240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.625657+0000","last_change":"2024-08-17T02:26:28.628231+0000","last_active":"2024-08-17T02:26:29.625657+0000","last_peered":"2024-08-17T02:26:29.625657+0000","last_clean":"2024-08-17T02:26:29.625657+0000","last_became_active":"2024-08-17T02:26:28.627917+0000","last_became_peered":"2024-08-17T02:26:28.627917+0000","last_unstale":"2024-08-17T02:26:29.625657+0000","last_undegraded":"2024-08-17T02:26:29.625657+0000","last_fullsized":"2024-08-17T02:26:29.625657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:16:07.881276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637667+0000","last_change":"2024-08-17T02:26:29.627626+0000","last_active":"2024-08-17T02:26:29.637667+0000","last_peered":"2024-08-17T02:26:29.637667+0000","last_clean":"2024-08-17T02:26:29.637667+0000","last_became_active":"2024-08-17T02:26:29.627267+0000","last_became_peered":"2024-08-17T02:26:29.627267+0000","last_unstale":"2024-08-17T02:26:29.637667+0000","last_undegraded":"2024-08-17T02:26:29.637667+0000","last_fullsized":"2024-08-17T02:26:29.637667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:59.025392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.622874+0000","last_change":"2024-08-17T02:26:28.631076+0000","last_active":"2024-08-17T02:26:29.622874+0000","last_peered":"2024-08-17T02:26:29.622874+0000","last_clean":"2024-08-17T02:26:29.622874+0000","last_became_active":"2024-08-17T02:26:28.630766+0000","last_became_peered":"2024-08-17T02:26:28.630766+0000","last_unstale":"2024-08-17T02:26:29.622874+0000","last_undegraded":"2024-08-17T02:26:29.622874+0000","last_fullsized":"2024-08-17T02:26:29.622874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:52.647000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642846+0000","last_change":"2024-08-17T02:26:29.640421+0000","last_active":"2024-08-17T02:26:29.642846+0000","last_peered":"2024-08-17T02:26:29.642846+0000","last_clean":"2024-08-17T02:26:29.642846+0000","last_became_active":"2024-08-17T02:26:29.639492+0000","last_became_peered":"2024-08-17T02:26:29.639492+0000","last_unstale":"2024-08-17T02:26:29.642846+0000","last_undegraded":"2024-08-17T02:26:29.642846+0000","last_fullsized":"2024-08-17T02:26:29.642846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:58.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614778+0000","last_change":"2024-08-17T02:26:28.632665+0000","last_active":"2024-08-17T02:26:29.614778+0000","last_peered":"2024-08-17T02:26:29.614778+0000","last_clean":"2024-08-17T02:26:29.614778+0000","last_became_active":"2024-08-17T02:26:28.632323+0000","last_became_peered":"2024-08-17T02:26:28.632323+0000","last_unstale":"2024-08-17T02:26:29.614778+0000","last_undegraded":"2024-08-17T02:26:29.614778+0000","last_fullsized":"2024-08-17T02:26:29.614778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:26:55.149220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.646510+0000","last_change":"2024-08-17T02:26:29.644054+0000","last_active":"2024-08-17T02:26:29.646510+0000","last_peered":"2024-08-17T02:26:29.646510+0000","last_clean":"2024-08-17T02:26:29.646510+0000","last_became_active":"2024-08-17T02:26:29.643787+0000","last_became_peered":"2024-08-17T02:26:29.643787+0000","last_unstale":"2024-08-17T02:26:29.646510+0000","last_undegraded":"2024-08-17T02:26:29.646510+0000","last_fullsized":"2024-08-17T02:26:29.646510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:33:07.414644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.630795+0000","last_change":"2024-08-17T02:26:28.640251+0000","last_active":"2024-08-17T02:26:29.630795+0000","last_peered":"2024-08-17T02:26:29.630795+0000","last_clean":"2024-08-17T02:26:29.630795+0000","last_became_active":"2024-08-17T02:26:28.639914+0000","last_became_peered":"2024-08-17T02:26:28.639914+0000","last_unstale":"2024-08-17T02:26:29.630795+0000","last_undegraded":"2024-08-17T02:26:29.630795+0000","last_fullsized":"2024-08-17T02:26:29.630795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:36.775419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.637630+0000","last_change":"2024-08-17T02:26:29.627697+0000","last_active":"2024-08-17T02:26:29.637630+0000","last_peered":"2024-08-17T02:26:29.637630+0000","last_clean":"2024-08-17T02:26:29.637630+0000","last_became_active":"2024-08-17T02:26:29.627394+0000","last_became_peered":"2024-08-17T02:26:29.627394+0000","last_unstale":"2024-08-17T02:26:29.637630+0000","last_undegraded":"2024-08-17T02:26:29.637630+0000","last_fullsized":"2024-08-17T02:26:29.637630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:07.710268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:26:30.641883+0000","last_change":"2024-08-17T02:26:28.631203+0000","last_active":"2024-08-17T02:26:30.641883+0000","last_peered":"2024-08-17T02:26:30.641883+0000","last_clean":"2024-08-17T02:26:30.641883+0000","last_became_active":"2024-08-17T02:26:28.630811+0000","last_became_peered":"2024-08-17T02:26:28.630811+0000","last_unstale":"2024-08-17T02:26:30.641883+0000","last_undegraded":"2024-08-17T02:26:30.641883+0000","last_fullsized":"2024-08-17T02:26:30.641883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:18.735646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638361+0000","last_change":"2024-08-17T02:26:29.634101+0000","last_active":"2024-08-17T02:26:29.638361+0000","last_peered":"2024-08-17T02:26:29.638361+0000","last_clean":"2024-08-17T02:26:29.638361+0000","last_became_active":"2024-08-17T02:26:29.633815+0000","last_became_peered":"2024-08-17T02:26:29.633815+0000","last_unstale":"2024-08-17T02:26:29.638361+0000","last_undegraded":"2024-08-17T02:26:29.638361+0000","last_fullsized":"2024-08-17T02:26:29.638361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:24:32.790776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.658241+0000","last_change":"2024-08-17T02:26:28.632292+0000","last_active":"2024-08-17T02:26:29.658241+0000","last_peered":"2024-08-17T02:26:29.658241+0000","last_clean":"2024-08-17T02:26:29.658241+0000","last_became_active":"2024-08-17T02:26:28.631868+0000","last_became_peered":"2024-08-17T02:26:28.631868+0000","last_unstale":"2024-08-17T02:26:29.658241+0000","last_undegraded":"2024-08-17T02:26:29.658241+0000","last_fullsized":"2024-08-17T02:26:29.658241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:44.839971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.635015+0000","last_change":"2024-08-17T02:26:29.631655+0000","last_active":"2024-08-17T02:26:29.635015+0000","last_peered":"2024-08-17T02:26:29.635015+0000","last_clean":"2024-08-17T02:26:29.635015+0000","last_became_active":"2024-08-17T02:26:29.631271+0000","last_became_peered":"2024-08-17T02:26:29.631271+0000","last_unstale":"2024-08-17T02:26:29.635015+0000","last_undegraded":"2024-08-17T02:26:29.635015+0000","last_fullsized":"2024-08-17T02:26:29.635015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:57:15.601838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.627629+0000","last_change":"2024-08-17T02:26:28.634093+0000","last_active":"2024-08-17T02:26:29.627629+0000","last_peered":"2024-08-17T02:26:29.627629+0000","last_clean":"2024-08-17T02:26:29.627629+0000","last_became_active":"2024-08-17T02:26:28.633526+0000","last_became_peered":"2024-08-17T02:26:28.633526+0000","last_unstale":"2024-08-17T02:26:29.627629+0000","last_undegraded":"2024-08-17T02:26:29.627629+0000","last_fullsized":"2024-08-17T02:26:29.627629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:57.732706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.641906+0000","last_change":"2024-08-17T02:26:29.630504+0000","last_active":"2024-08-17T02:26:29.641906+0000","last_peered":"2024-08-17T02:26:29.641906+0000","last_clean":"2024-08-17T02:26:29.641906+0000","last_became_active":"2024-08-17T02:26:29.630225+0000","last_became_peered":"2024-08-17T02:26:29.630225+0000","last_unstale":"2024-08-17T02:26:29.641906+0000","last_undegraded":"2024-08-17T02:26:29.641906+0000","last_fullsized":"2024-08-17T02:26:29.641906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:37.783072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614495+0000","last_change":"2024-08-17T02:26:28.627068+0000","last_active":"2024-08-17T02:26:29.614495+0000","last_peered":"2024-08-17T02:26:29.614495+0000","last_clean":"2024-08-17T02:26:29.614495+0000","last_became_active":"2024-08-17T02:26:28.626727+0000","last_became_peered":"2024-08-17T02:26:28.626727+0000","last_unstale":"2024-08-17T02:26:29.614495+0000","last_undegraded":"2024-08-17T02:26:29.614495+0000","last_fullsized":"2024-08-17T02:26:29.614495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:18:32.727047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.638319+0000","last_change":"2024-08-17T02:26:29.630289+0000","last_active":"2024-08-17T02:26:29.638319+0000","last_peered":"2024-08-17T02:26:29.638319+0000","last_clean":"2024-08-17T02:26:29.638319+0000","last_became_active":"2024-08-17T02:26:29.629189+0000","last_became_peered":"2024-08-17T02:26:29.629189+0000","last_unstale":"2024-08-17T02:26:29.638319+0000","last_undegraded":"2024-08-17T02:26:29.638319+0000","last_fullsized":"2024-08-17T02:26:29.638319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:07.710268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.614139+0000","last_change":"2024-08-17T02:26:28.630536+0000","last_active":"2024-08-17T02:26:29.614139+0000","last_peered":"2024-08-17T02:26:29.614139+0000","last_clean":"2024-08-17T02:26:29.614139+0000","last_became_active":"2024-08-17T02:26:28.630123+0000","last_became_peered":"2024-08-17T02:26:28.630123+0000","last_unstale":"2024-08-17T02:26:29.614139+0000","last_undegraded":"2024-08-17T02:26:29.614139+0000","last_fullsized":"2024-08-17T02:26:29.614139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:16:07.881276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642880+0000","last_change":"2024-08-17T02:26:29.636188+0000","last_active":"2024-08-17T02:26:29.642880+0000","last_peered":"2024-08-17T02:26:29.642880+0000","last_clean":"2024-08-17T02:26:29.642880+0000","last_became_active":"2024-08-17T02:26:29.634865+0000","last_became_peered":"2024-08-17T02:26:29.634865+0000","last_unstale":"2024-08-17T02:26:29.642880+0000","last_undegraded":"2024-08-17T02:26:29.642880+0000","last_fullsized":"2024-08-17T02:26:29.642880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:59.025392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.657802+0000","last_change":"2024-08-17T02:26:28.639322+0000","last_active":"2024-08-17T02:26:29.657802+0000","last_peered":"2024-08-17T02:26:29.657802+0000","last_clean":"2024-08-17T02:26:29.657802+0000","last_became_active":"2024-08-17T02:26:28.638980+0000","last_became_peered":"2024-08-17T02:26:28.638980+0000","last_unstale":"2024-08-17T02:26:29.657802+0000","last_undegraded":"2024-08-17T02:26:29.657802+0000","last_fullsized":"2024-08-17T02:26:29.657802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:55:44.839971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.645942+0000","last_change":"2024-08-17T02:26:29.643786+0000","last_active":"2024-08-17T02:26:29.645942+0000","last_peered":"2024-08-17T02:26:29.645942+0000","last_clean":"2024-08-17T02:26:29.645942+0000","last_became_active":"2024-08-17T02:26:29.643526+0000","last_became_peered":"2024-08-17T02:26:29.643526+0000","last_unstale":"2024-08-17T02:26:29.645942+0000","last_undegraded":"2024-08-17T02:26:29.645942+0000","last_fullsized":"2024-08-17T02:26:29.645942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:25:34.532005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.644988+0000","last_change":"2024-08-17T02:26:29.639581+0000","last_active":"2024-08-17T02:26:29.644988+0000","last_peered":"2024-08-17T02:26:29.644988+0000","last_clean":"2024-08-17T02:26:29.644988+0000","last_became_active":"2024-08-17T02:26:29.639288+0000","last_became_peered":"2024-08-17T02:26:29.639288+0000","last_unstale":"2024-08-17T02:26:29.644988+0000","last_undegraded":"2024-08-17T02:26:29.644988+0000","last_fullsized":"2024-08-17T02:26:29.644988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:48:08.902200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.653463+0000","last_change":"2024-08-17T02:26:28.631767+0000","last_active":"2024-08-17T02:26:29.653463+0000","last_peered":"2024-08-17T02:26:29.653463+0000","last_clean":"2024-08-17T02:26:29.653463+0000","last_became_active":"2024-08-17T02:26:28.631510+0000","last_became_peered":"2024-08-17T02:26:28.631510+0000","last_unstale":"2024-08-17T02:26:29.653463+0000","last_undegraded":"2024-08-17T02:26:29.653463+0000","last_fullsized":"2024-08-17T02:26:29.653463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:01:52.647000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.644827+0000","last_change":"2024-08-17T02:26:29.639249+0000","last_active":"2024-08-17T02:26:29.644827+0000","last_peered":"2024-08-17T02:26:29.644827+0000","last_clean":"2024-08-17T02:26:29.644827+0000","last_became_active":"2024-08-17T02:26:29.638931+0000","last_became_peered":"2024-08-17T02:26:29.638931+0000","last_unstale":"2024-08-17T02:26:29.644827+0000","last_undegraded":"2024-08-17T02:26:29.644827+0000","last_fullsized":"2024-08-17T02:26:29.644827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:52.778187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.657981+0000","last_change":"2024-08-17T02:26:28.633038+0000","last_active":"2024-08-17T02:26:29.657981+0000","last_peered":"2024-08-17T02:26:29.657981+0000","last_clean":"2024-08-17T02:26:29.657981+0000","last_became_active":"2024-08-17T02:26:28.632663+0000","last_became_peered":"2024-08-17T02:26:28.632663+0000","last_unstale":"2024-08-17T02:26:29.657981+0000","last_undegraded":"2024-08-17T02:26:29.657981+0000","last_fullsized":"2024-08-17T02:26:29.657981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:33.058469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.640555+0000","last_change":"2024-08-17T02:26:29.634810+0000","last_active":"2024-08-17T02:26:29.640555+0000","last_peered":"2024-08-17T02:26:29.640555+0000","last_clean":"2024-08-17T02:26:29.640555+0000","last_became_active":"2024-08-17T02:26:29.634539+0000","last_became_peered":"2024-08-17T02:26:29.634539+0000","last_unstale":"2024-08-17T02:26:29.640555+0000","last_undegraded":"2024-08-17T02:26:29.640555+0000","last_fullsized":"2024-08-17T02:26:29.640555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:13:25.035787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.652170+0000","last_change":"2024-08-17T02:26:28.632880+0000","last_active":"2024-08-17T02:26:29.652170+0000","last_peered":"2024-08-17T02:26:29.652170+0000","last_clean":"2024-08-17T02:26:29.652170+0000","last_became_active":"2024-08-17T02:26:28.632517+0000","last_became_peered":"2024-08-17T02:26:28.632517+0000","last_unstale":"2024-08-17T02:26:29.652170+0000","last_undegraded":"2024-08-17T02:26:29.652170+0000","last_fullsized":"2024-08-17T02:26:29.652170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:53.080183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.642944+0000","last_change":"2024-08-17T02:26:29.636544+0000","last_active":"2024-08-17T02:26:29.642944+0000","last_peered":"2024-08-17T02:26:29.642944+0000","last_clean":"2024-08-17T02:26:29.642944+0000","last_became_active":"2024-08-17T02:26:29.636210+0000","last_became_peered":"2024-08-17T02:26:29.636210+0000","last_unstale":"2024-08-17T02:26:29.642944+0000","last_undegraded":"2024-08-17T02:26:29.642944+0000","last_fullsized":"2024-08-17T02:26:29.642944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:28.593827+0000","last_clean_scrub_stamp":"2024-08-17T02:26:28.593827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:29:04.485592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:26:29.656084+0000","last_change":"2024-08-17T02:26:28.631963+0000","last_active":"2024-08-17T02:26:29.656084+0000","last_peered":"2024-08-17T02:26:29.656084+0000","last_clean":"2024-08-17T02:26:29.656084+0000","last_became_active":"2024-08-17T02:26:28.631315+0000","last_became_peered":"2024-08-17T02:26:28.631315+0000","last_unstale":"2024-08-17T02:26:29.656084+0000","last_undegraded":"2024-08-17T02:26:29.656084+0000","last_fullsized":"2024-08-17T02:26:29.656084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:27.586174+0000","last_clean_scrub_stamp":"2024-08-17T02:26:27.586174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:21.706815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":79160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":221184,"data_stored":77608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":77768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":819200,"data_stored":668546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":79160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":225280,"data_stored":77698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":233472,"data_stored":77734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":827392,"data_stored":668602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:36.948 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:26:36.948 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:26:36.948 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:26:36.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:26:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.035+0000 7fa173d45700 1 Processor -- start 2024-08-17T02:26:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.035+0000 7fa173d45700 1 -- start start 2024-08-17T02:26:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa173d45700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c06e130 0x7fa16c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa173d45700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa16c068be0 0x7fa16c160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa173d45700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16c0c36f0 con 0x7fa16c157060 2024-08-17T02:26:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa173d45700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16c0caec0 con 0x7fa16c068be0 2024-08-17T02:26:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa173d45700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c069020 con 0x7fa16c06e130 2024-08-17T02:26:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa171ae1700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa16c157060 0x7fa16c06a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34014/0 (socket says 172.21.15.19:34014) 2024-08-17T02:26:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa171ae1700 1 -- 172.21.15.19:0/3035052486 learned_addr learned my addr 172.21.15.19:0/3035052486 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1722e2700 1 --2- 172.21.15.19:0/3035052486 >> v2:172.21.15.119:3300/0 conn(0x7fa16c068be0 0x7fa16c160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1712e0700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c06e130 0x7fa16c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892280038 0 0) 0x7fa16c0c36f0 con 0x7fa16c157060 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa158003570 con 0x7fa16c157060 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2194056008 0 0) 0x7fa158003570 con 0x7fa16c157060 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c06e130 msgr2=0x7fa16c0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c06e130 0x7fa16c0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 >> v2:172.21.15.119:3300/0 conn(0x7fa16c068be0 msgr2=0x7fa16c160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 --2- 172.21.15.19:0/3035052486 >> v2:172.21.15.119:3300/0 conn(0x7fa16c068be0 0x7fa16c160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c06e560 con 0x7fa16c157060 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7fa168001470 con 0x7fa16c157060 2024-08-17T02:26:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1712e0700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c06e130 0x7fa16c0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 >> v1:172.21.15.19:6789/0 conn(0x7fa16c157060 legacy=0x7fa16c06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa158003a60 0x7fa158003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa158004810 0x7fa158004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c06e130 0x7fa1580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0caec0 con 0x7fa158004810 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c069020 con 0x7fa158003a60 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15800bae0 con 0x7fa16c06e130 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1712e0700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa158004810 0x7fa158004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1722e2700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c06e130 0x7fa1580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa171ae1700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa158003a60 0x7fa158003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1712e0700 1 -- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c06e130 msgr2=0x7fa1580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1712e0700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c06e130 0x7fa1580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1712e0700 1 -- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa158003a60 msgr2=0x7fa158003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1712e0700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa158003a60 0x7fa158003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1712e0700 1 -- 172.21.15.19:0/3035052486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa158003570 con 0x7fa158004810 2024-08-17T02:26:37.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa171ae1700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa158003a60 0x7fa158003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:37.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa1712e0700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa158004810 0x7fa158004c80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009ba0 tx=0x7fa15c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abb5537f6c39d71 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c00c070 con 0x7fa158004810 2024-08-17T02:26:37.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c00e5e0 con 0x7fa158004810 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.039+0000 7fa170adf700 1 -- 172.21.15.19:0/3035052486 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c009510 con 0x7fa158004810 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 -- 172.21.15.19:0/3035052486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa158004810 msgr2=0x7fa158004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 --2- 172.21.15.19:0/3035052486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa158004810 0x7fa158004c80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009ba0 tx=0x7fa15c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa1722e2700 1 -- 172.21.15.19:0/3035052486 reap_dead start 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 -- 172.21.15.19:0/3035052486 shutdown_connections 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 -- 172.21.15.19:0/3035052486 >> 172.21.15.19:0/3035052486 conn(0x7fa16c0c9c20 msgr2=0x7fa16c06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 -- 172.21.15.19:0/3035052486 shutdown_connections 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 -- 172.21.15.19:0/3035052486 wait complete. 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 Processor -- start 2024-08-17T02:26:37.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 -- start start 2024-08-17T02:26:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa16c154e80 0x7fa16c155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa16c159d30 0x7fa16c143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c143cb0 0x7fa16c0a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c158440 con 0x7fa16c159d30 2024-08-17T02:26:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c158f70 con 0x7fa16c154e80 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa173d45700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c159250 con 0x7fa16c143cb0 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa1712e0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa16c159d30 0x7fa16c143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa1712e0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa16c159d30 0x7fa16c143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58732/0 (socket says 172.21.15.19:58732) 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.043+0000 7fa1712e0700 1 -- 172.21.15.19:0/2783247486 learned_addr learned my addr 172.21.15.19:0/2783247486 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa1722e2700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c143cb0 0x7fa16c0a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa171ae1700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa16c154e80 0x7fa16c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa1712e0700 1 -- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c143cb0 msgr2=0x7fa16c0a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa1712e0700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c143cb0 0x7fa16c0a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa1712e0700 1 -- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa16c154e80 msgr2=0x7fa16c155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa1712e0700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa16c154e80 0x7fa16c155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa1712e0700 1 -- 172.21.15.19:0/2783247486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c159530 con 0x7fa16c159d30 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa171ae1700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa16c154e80 0x7fa16c155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:37.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa1712e0700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa16c159d30 0x7fa16c143770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa158004770 tx=0x7fa15c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa161ffb700 1 -- 172.21.15.19:0/2783247486 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c00ee80 con 0x7fa16c159d30 2024-08-17T02:26:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa161ffb700 1 -- 172.21.15.19:0/2783247486 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c013bf0 con 0x7fa16c159d30 2024-08-17T02:26:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16c159810 con 0x7fa16c159d30 2024-08-17T02:26:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa161ffb700 1 -- 172.21.15.19:0/2783247486 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c01c440 con 0x7fa16c159d30 2024-08-17T02:26:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16c15a1a0 con 0x7fa16c159d30 2024-08-17T02:26:37.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16c1599d0 con 0x7fa16c159d30 2024-08-17T02:26:37.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.047+0000 7fa161ffb700 1 -- 172.21.15.19:0/2783247486 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa15c01c870 con 0x7fa16c159d30 2024-08-17T02:26:37.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.051+0000 7fa161ffb700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa150060860 0x7fa150062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.051+0000 7fa161ffb700 1 -- 172.21.15.19:0/2783247486 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa15c07e680 con 0x7fa16c159d30 2024-08-17T02:26:37.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.051+0000 7fa171ae1700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa150060860 0x7fa150062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.051+0000 7fa171ae1700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa150060860 0x7fa150062d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa1680015e0 tx=0x7fa168009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.055+0000 7fa161ffb700 1 -- 172.21.15.19:0/2783247486 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa15c04ead0 con 0x7fa16c159d30 2024-08-17T02:26:37.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.247+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa16c158440 con 0x7fa16c159d30 2024-08-17T02:26:37.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.247+0000 7fa161ffb700 1 -- 172.21.15.19:0/2783247486 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa15c0520f0 con 0x7fa16c159d30 2024-08-17T02:26:37.252 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:37.252 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:26:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.247+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa150060860 msgr2=0x7fa150062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.247+0000 7fa173d45700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa150060860 0x7fa150062d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa1680015e0 tx=0x7fa168009040 comp rx=0 tx=0).stop 2024-08-17T02:26:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.247+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa16c159d30 msgr2=0x7fa16c143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.251+0000 7fa173d45700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa16c159d30 0x7fa16c143770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa158004770 tx=0x7fa15c01a000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.251+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 shutdown_connections 2024-08-17T02:26:37.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.251+0000 7fa173d45700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa150060860 0x7fa150062d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.251+0000 7fa173d45700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa16c143cb0 0x7fa16c0a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.251+0000 7fa173d45700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa16c159d30 0x7fa16c143770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.251+0000 7fa173d45700 1 --2- 172.21.15.19:0/2783247486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa16c154e80 0x7fa16c155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.251+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 >> 172.21.15.19:0/2783247486 conn(0x7fa16c0c9c20 msgr2=0x7fa16c1560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.251+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 shutdown_connections 2024-08-17T02:26:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.251+0000 7fa173d45700 1 -- 172.21.15.19:0/2783247486 wait complete. 2024-08-17T02:26:37.265 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:26:37.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:37.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 Processor -- start 2024-08-17T02:26:37.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 -- start start 2024-08-17T02:26:37.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b10068ca0 0x7f5b100aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100aa020 con 0x7f5b10158ac0 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100aa300 con 0x7f5b100688d0 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b100aa5e0 con 0x7f5b10068ca0 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b15080700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b10068ca0 0x7f5b100aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b15080700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b10068ca0 0x7f5b100aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58740/0 (socket says 172.21.15.19:58740) 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b15080700 1 -- 172.21.15.19:0/3272227586 learned_addr learned my addr 172.21.15.19:0/3272227586 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b15080700 1 -- 172.21.15.19:0/3272227586 >> v1:172.21.15.119:6789/0 conn(0x7f5b100688d0 legacy=0x7f5b100a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b15080700 1 -- 172.21.15.19:0/3272227586 >> v1:172.21.15.19:6789/0 conn(0x7f5b10158ac0 legacy=0x7f5b10158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b15080700 1 -- 172.21.15.19:0/3272227586 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100aa8c0 con 0x7f5b10068ca0 2024-08-17T02:26:37.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b15080700 1 --2- 172.21.15.19:0/3272227586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 0x7f5b100aee00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009f20 tx=0x7f5b08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa48c92a7809af2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b1487f700 1 -- 172.21.15.19:0/3272227586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800e070 con 0x7f5b10068ca0 2024-08-17T02:26:37.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b1487f700 1 -- 172.21.15.19:0/3272227586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0800ba40 con 0x7f5b10068ca0 2024-08-17T02:26:37.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b1487f700 1 -- 172.21.15.19:0/3272227586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b080092e0 con 0x7f5b10068ca0 2024-08-17T02:26:37.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 -- 172.21.15.19:0/3272227586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 msgr2=0x7f5b100aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 --2- 172.21.15.19:0/3272227586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 0x7f5b100aee00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009f20 tx=0x7f5b08009840 comp rx=0 tx=0).stop 2024-08-17T02:26:37.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 -- 172.21.15.19:0/3272227586 shutdown_connections 2024-08-17T02:26:37.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 --2- 172.21.15.19:0/3272227586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 0x7f5b100aee00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 -- 172.21.15.19:0/3272227586 >> 172.21.15.19:0/3272227586 conn(0x7f5b1006d8f0 msgr2=0x7f5b1006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 -- 172.21.15.19:0/3272227586 shutdown_connections 2024-08-17T02:26:37.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.367+0000 7f5b16883700 1 -- 172.21.15.19:0/3272227586 wait complete. 2024-08-17T02:26:37.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.371+0000 7f5b16883700 1 Processor -- start 2024-08-17T02:26:37.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.371+0000 7f5b16883700 1 -- start start 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.371+0000 7f5b16883700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b100688d0 0x7f5b1015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.371+0000 7f5b16883700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 0x7f5b10155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.371+0000 7f5b16883700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b10158ac0 0x7f5b1006af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b16883700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1016dba0 con 0x7f5b10068ca0 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b16883700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10155fc0 con 0x7f5b100688d0 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b16883700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1016cf90 con 0x7f5b10158ac0 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15080700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 0x7f5b10155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15080700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 0x7f5b10155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58756/0 (socket says 172.21.15.19:58756) 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15080700 1 -- 172.21.15.19:0/3971640028 learned_addr learned my addr 172.21.15.19:0/3971640028 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15881700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b100688d0 0x7f5b1015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b16082700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b10158ac0 0x7f5b1006af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15080700 1 -- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b10158ac0 msgr2=0x7f5b1006af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15080700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b10158ac0 0x7f5b1006af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15080700 1 -- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b100688d0 msgr2=0x7f5b1015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15080700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b100688d0 0x7f5b1015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15080700 1 -- 172.21.15.19:0/3971640028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08009ae0 con 0x7f5b10068ca0 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b15080700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 0x7f5b10155a80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800b6c0 tx=0x7f5b08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b05ffb700 1 -- 172.21.15.19:0/3971640028 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08012aa0 con 0x7f5b10068ca0 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b05ffb700 1 -- 172.21.15.19:0/3971640028 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b08012c00 con 0x7f5b10068ca0 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1016d270 con 0x7f5b10068ca0 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b05ffb700 1 -- 172.21.15.19:0/3971640028 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0801d420 con 0x7f5b10068ca0 2024-08-17T02:26:37.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1016d830 con 0x7f5b10068ca0 2024-08-17T02:26:37.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1016dd50 con 0x7f5b10068ca0 2024-08-17T02:26:37.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.375+0000 7f5b05ffb700 1 -- 172.21.15.19:0/3971640028 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5b0801d810 con 0x7f5b10068ca0 2024-08-17T02:26:37.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.379+0000 7f5b05ffb700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5afc060860 0x7f5afc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.379+0000 7f5b05ffb700 1 -- 172.21.15.19:0/3971640028 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b0807e3b0 con 0x7f5b10068ca0 2024-08-17T02:26:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.379+0000 7f5b15881700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5afc060860 0x7f5afc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.379+0000 7f5b15881700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5afc060860 0x7f5afc062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c006fd0 tx=0x7f5b0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.383+0000 7f5b05ffb700 1 -- 172.21.15.19:0/3971640028 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5b1016dd50 con 0x7f5b10068ca0 2024-08-17T02:26:37.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.547+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b1016dd50 con 0x7f5b10068ca0 2024-08-17T02:26:37.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.547+0000 7f5b05ffb700 1 -- 172.21.15.19:0/3971640028 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5b1016dd50 con 0x7f5b10068ca0 2024-08-17T02:26:37.553 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:37.554 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:37.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5afc060860 msgr2=0x7f5afc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5afc060860 0x7f5afc062d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c006fd0 tx=0x7f5b0c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 msgr2=0x7f5b10155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 0x7f5b10155a80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800b6c0 tx=0x7f5b08017000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 shutdown_connections 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5afc060860 0x7f5afc062d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b10158ac0 0x7f5b1006af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b10068ca0 0x7f5b10155a80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 --2- 172.21.15.19:0/3971640028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b100688d0 0x7f5b1015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 >> 172.21.15.19:0/3971640028 conn(0x7f5b1006d8f0 msgr2=0x7f5b1014f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 shutdown_connections 2024-08-17T02:26:37.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.551+0000 7f5b16883700 1 -- 172.21.15.19:0/3971640028 wait complete. 2024-08-17T02:26:37.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:27.555224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:27.958499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:37.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:37.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f9560f97700 1 Processor -- start 2024-08-17T02:26:37.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f9560f97700 1 -- start start 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f9560f97700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c1590b0 0x7f955c066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f9560f97700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f955c0cd2b0 0x7f955c067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f9560f97700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955c0ce210 con 0x7f955c159480 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f9560f97700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955c0cba00 con 0x7f955c0cd2b0 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f9560f97700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955c0cdc90 con 0x7f955c1590b0 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f955bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f955c0cd2b0 0x7f955c067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f955bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f955c0cd2b0 0x7f955c067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58772/0 (socket says 172.21.15.19:58772) 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.667+0000 7f955bfff700 1 -- 172.21.15.19:0/4048669829 learned_addr learned my addr 172.21.15.19:0/4048669829 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f955b7fe700 1 --2- 172.21.15.19:0/4048669829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c1590b0 0x7f955c066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f955bfff700 1 -- 172.21.15.19:0/4048669829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c1590b0 msgr2=0x7f955c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f955bfff700 1 --2- 172.21.15.19:0/4048669829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c1590b0 0x7f955c066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f955bfff700 1 -- 172.21.15.19:0/4048669829 >> v1:172.21.15.119:6789/0 conn(0x7f955c159480 legacy=0x7f955c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f955bfff700 1 -- 172.21.15.19:0/4048669829 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c0cb440 con 0x7f955c0cd2b0 2024-08-17T02:26:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f955bfff700 1 --2- 172.21.15.19:0/4048669829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c0cd2b0 0x7f955c067340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9554009f20 tx=0x7f9554009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f59e6f3b12d1759 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f955a7fc700 1 -- 172.21.15.19:0/4048669829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400e070 con 0x7f955c0cd2b0 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f955a7fc700 1 -- 172.21.15.19:0/4048669829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955400ba80 con 0x7f955c0cd2b0 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f955a7fc700 1 -- 172.21.15.19:0/4048669829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540092e0 con 0x7f955c0cd2b0 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f9560f97700 1 -- 172.21.15.19:0/4048669829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c0cd2b0 msgr2=0x7f955c067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f9560f97700 1 --2- 172.21.15.19:0/4048669829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c0cd2b0 0x7f955c067340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9554009f20 tx=0x7f9554009840 comp rx=0 tx=0).stop 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f9560f97700 1 -- 172.21.15.19:0/4048669829 shutdown_connections 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f9560f97700 1 --2- 172.21.15.19:0/4048669829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c0cd2b0 0x7f955c067340 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f9560f97700 1 --2- 172.21.15.19:0/4048669829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c1590b0 0x7f955c066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f9560f97700 1 -- 172.21.15.19:0/4048669829 >> 172.21.15.19:0/4048669829 conn(0x7f955c0d0b90 msgr2=0x7f955c0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f9560f97700 1 -- 172.21.15.19:0/4048669829 shutdown_connections 2024-08-17T02:26:37.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.671+0000 7f9560f97700 1 -- 172.21.15.19:0/4048669829 wait complete. 2024-08-17T02:26:37.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 Processor -- start 2024-08-17T02:26:37.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 -- start start 2024-08-17T02:26:37.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c0cd2b0 0x7f955c0c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f955c1590b0 0x7f955c16a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c159480 0x7f955c143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c15d950 con 0x7f955c159480 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c0ca3b0 con 0x7f955c1590b0 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955c16ab80 con 0x7f955c0cd2b0 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c159480 0x7f955c143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c159480 0x7f955c143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58776/0 (socket says 172.21.15.19:58776) 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955bfff700 1 -- 172.21.15.19:0/3393955737 learned_addr learned my addr 172.21.15.19:0/3393955737 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955affd700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f955c1590b0 0x7f955c16a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955b7fe700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c0cd2b0 0x7f955c0c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955bfff700 1 -- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c0cd2b0 msgr2=0x7f955c0c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955bfff700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c0cd2b0 0x7f955c0c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955bfff700 1 -- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f955c1590b0 msgr2=0x7f955c16a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955bfff700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f955c1590b0 0x7f955c16a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955bfff700 1 -- 172.21.15.19:0/3393955737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9554009ae0 con 0x7f955c159480 2024-08-17T02:26:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f955bfff700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c159480 0x7f955c143840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f955400b6c0 tx=0x7f9554018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f95437fe700 1 -- 172.21.15.19:0/3393955737 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540032f0 con 0x7f955c159480 2024-08-17T02:26:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f95437fe700 1 -- 172.21.15.19:0/3393955737 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9554008ce0 con 0x7f955c159480 2024-08-17T02:26:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f95437fe700 1 -- 172.21.15.19:0/3393955737 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554026670 con 0x7f955c159480 2024-08-17T02:26:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955c143d80 con 0x7f955c159480 2024-08-17T02:26:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.675+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955c0c9a80 con 0x7f955c159480 2024-08-17T02:26:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.679+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955c064330 con 0x7f955c159480 2024-08-17T02:26:37.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.679+0000 7f95437fe700 1 -- 172.21.15.19:0/3393955737 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9554003040 con 0x7f955c159480 2024-08-17T02:26:37.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.679+0000 7f95437fe700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9548060860 0x7f9548062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.679+0000 7f95437fe700 1 -- 172.21.15.19:0/3393955737 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f955407e7f0 con 0x7f955c159480 2024-08-17T02:26:37.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.679+0000 7f955b7fe700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9548060860 0x7f9548062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.679+0000 7f955b7fe700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9548060860 0x7f9548062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.687+0000 7f95437fe700 1 -- 172.21.15.19:0/3393955737 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f955404ec40 con 0x7f955c159480 2024-08-17T02:26:37.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.839+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f955c0c4e60 con 0x7f955c159480 2024-08-17T02:26:37.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.839+0000 7f95437fe700 1 -- 172.21.15.19:0/3393955737 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9554052260 con 0x7f955c159480 2024-08-17T02:26:37.844 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.839+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9548060860 msgr2=0x7f9548062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.839+0000 7f9560f97700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9548060860 0x7f9548062d10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.839+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c159480 msgr2=0x7f955c143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.839+0000 7f9560f97700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c159480 0x7f955c143840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f955400b6c0 tx=0x7f9554018000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.843+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 shutdown_connections 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.843+0000 7f9560f97700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9548060860 0x7f9548062d10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.843+0000 7f9560f97700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f955c159480 0x7f955c143840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.843+0000 7f9560f97700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f955c1590b0 0x7f955c16a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.843+0000 7f9560f97700 1 --2- 172.21.15.19:0/3393955737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f955c0cd2b0 0x7f955c0c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.843+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 >> 172.21.15.19:0/3393955737 conn(0x7f955c0d0b90 msgr2=0x7f955c0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.843+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 shutdown_connections 2024-08-17T02:26:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.843+0000 7f9560f97700 1 -- 172.21.15.19:0/3393955737 wait complete. 2024-08-17T02:26:37.857 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:37.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.959+0000 7fec47376700 1 Processor -- start 2024-08-17T02:26:37.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.959+0000 7fec47376700 1 -- start start 2024-08-17T02:26:37.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec40156d70 0x7fec400678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fec40157140 0x7fec400b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec400cba90 con 0x7fec40067e00 2024-08-17T02:26:37.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec400cae80 con 0x7fec40156d70 2024-08-17T02:26:37.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec400cb160 con 0x7fec40157140 2024-08-17T02:26:37.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec46374700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec40156d70 0x7fec400678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec46374700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec40156d70 0x7fec400678c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50094/0 (socket says 172.21.15.19:50094) 2024-08-17T02:26:37.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec46374700 1 -- 172.21.15.19:0/828047267 learned_addr learned my addr 172.21.15.19:0/828047267 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:37.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec45b73700 1 --2- 172.21.15.19:0/828047267 >> v2:172.21.15.119:3300/0 conn(0x7fec40157140 0x7fec400b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec46374700 1 -- 172.21.15.19:0/828047267 >> v2:172.21.15.119:3300/0 conn(0x7fec40157140 msgr2=0x7fec400b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:37.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec46374700 1 --2- 172.21.15.19:0/828047267 >> v2:172.21.15.119:3300/0 conn(0x7fec40157140 0x7fec400b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec46374700 1 -- 172.21.15.19:0/828047267 >> v1:172.21.15.119:6789/0 conn(0x7fec40067e00 legacy=0x7fec400c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec46374700 1 -- 172.21.15.19:0/828047267 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec400cb440 con 0x7fec40156d70 2024-08-17T02:26:37.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec46374700 1 --2- 172.21.15.19:0/828047267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40156d70 0x7fec400678c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec40064df0 tx=0x7fec30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8d076ad5919e8c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec45372700 1 -- 172.21.15.19:0/828047267 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec30009e70 con 0x7fec40156d70 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec45372700 1 -- 172.21.15.19:0/828047267 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3000b860 con 0x7fec40156d70 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec45372700 1 -- 172.21.15.19:0/828047267 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3000bc00 con 0x7fec40156d70 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 -- 172.21.15.19:0/828047267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40156d70 msgr2=0x7fec400678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 --2- 172.21.15.19:0/828047267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40156d70 0x7fec400678c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec40064df0 tx=0x7fec30009250 comp rx=0 tx=0).stop 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 -- 172.21.15.19:0/828047267 shutdown_connections 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 --2- 172.21.15.19:0/828047267 >> v2:172.21.15.119:3300/0 conn(0x7fec40157140 0x7fec400b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 --2- 172.21.15.19:0/828047267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40156d70 0x7fec400678c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 -- 172.21.15.19:0/828047267 >> 172.21.15.19:0/828047267 conn(0x7fec4006e170 msgr2=0x7fec4006e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 -- 172.21.15.19:0/828047267 shutdown_connections 2024-08-17T02:26:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 -- 172.21.15.19:0/828047267 wait complete. 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 Processor -- start 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.963+0000 7fec47376700 1 -- start start 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec47376700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec40067e00 0x7fec4014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec47376700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec40156d70 0x7fec40141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec47376700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40157140 0x7fec4014f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec47376700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec400c4cd0 con 0x7fec40157140 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec47376700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40141da0 con 0x7fec40067e00 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec47376700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec400c1d60 con 0x7fec40156d70 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46b75700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40157140 0x7fec4014f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46b75700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40157140 0x7fec4014f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50100/0 (socket says 172.21.15.19:50100) 2024-08-17T02:26:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46b75700 1 -- 172.21.15.19:0/3570391628 learned_addr learned my addr 172.21.15.19:0/3570391628 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec45b73700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec40156d70 0x7fec40141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46374700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec40067e00 0x7fec4014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46b75700 1 -- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec40156d70 msgr2=0x7fec40141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46b75700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec40156d70 0x7fec40141860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46b75700 1 -- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec40067e00 msgr2=0x7fec4014de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46b75700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec40067e00 0x7fec4014de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46b75700 1 -- 172.21.15.19:0/3570391628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec300094f0 con 0x7fec40157140 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec46b75700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40157140 0x7fec4014f520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fec3800c910 tx=0x7fec38001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec3e7fc700 1 -- 172.21.15.19:0/3570391628 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38012630 con 0x7fec40157140 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec3e7fc700 1 -- 172.21.15.19:0/3570391628 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec38012790 con 0x7fec40157140 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec3e7fc700 1 -- 172.21.15.19:0/3570391628 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38012b50 con 0x7fec40157140 2024-08-17T02:26:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4014fa60 con 0x7fec40157140 2024-08-17T02:26:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4014ea00 con 0x7fec40157140 2024-08-17T02:26:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.967+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec400638f0 con 0x7fec40157140 2024-08-17T02:26:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.971+0000 7fec3e7fc700 1 -- 172.21.15.19:0/3570391628 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fec3801a3a0 con 0x7fec40157140 2024-08-17T02:26:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.971+0000 7fec3e7fc700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec2c060860 0x7fec2c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.971+0000 7fec3e7fc700 1 -- 172.21.15.19:0/3570391628 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec3807ce10 con 0x7fec40157140 2024-08-17T02:26:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.971+0000 7fec46374700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec2c060860 0x7fec2c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.971+0000 7fec46374700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec2c060860 0x7fec2c062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec40064df0 tx=0x7fec30017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:37.979+0000 7fec3e7fc700 1 -- 172.21.15.19:0/3570391628 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fec38081070 con 0x7fec40157140 2024-08-17T02:26:38.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec400c1ea0 con 0x7fec40157140 2024-08-17T02:26:38.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec3e7fc700 1 -- 172.21.15.19:0/3570391628 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec38050c50 con 0x7fec40157140 2024-08-17T02:26:38.148 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:26:38.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec2c060860 msgr2=0x7fec2c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec2c060860 0x7fec2c062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fec40064df0 tx=0x7fec30017000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40157140 msgr2=0x7fec4014f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40157140 0x7fec4014f520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fec3800c910 tx=0x7fec38001710 comp rx=0 tx=0).stop 2024-08-17T02:26:38.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 shutdown_connections 2024-08-17T02:26:38.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec2c060860 0x7fec2c062d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec40157140 0x7fec4014f520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec40156d70 0x7fec40141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 --2- 172.21.15.19:0/3570391628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec40067e00 0x7fec4014de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 >> 172.21.15.19:0/3570391628 conn(0x7fec4006e170 msgr2=0x7fec40154d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.143+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 shutdown_connections 2024-08-17T02:26:38.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.147+0000 7fec47376700 1 -- 172.21.15.19:0/3570391628 wait complete. 2024-08-17T02:26:38.162 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:38.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b359e700 1 Processor -- start 2024-08-17T02:26:38.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b359e700 1 -- start start 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b40aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b359e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd5b4068ca0 0x7fd5b4066ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b359e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b4067420 con 0x7fd5b4158b70 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b359e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40ab0f0 con 0x7fd5b4068ca0 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b40ab3d0 con 0x7fd5b40688d0 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b2d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd5b4158b70 0x7fd5b4158ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53834/0 (socket says 172.21.15.19:53834) 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b2d9d700 1 -- 172.21.15.19:0/4167534437 learned_addr learned my addr 172.21.15.19:0/4167534437 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b259c700 1 --2- 172.21.15.19:0/4167534437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b40aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b1d9b700 1 --2- 172.21.15.19:0/4167534437 >> v2:172.21.15.119:3300/0 conn(0x7fd5b4068ca0 0x7fd5b4066ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b159a700 1 -- 172.21.15.19:0/4167534437 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976379452 0 0) 0x7fd5b4067420 con 0x7fd5b4158b70 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b159a700 1 -- 172.21.15.19:0/4167534437 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd59c003570 con 0x7fd5b4158b70 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b259c700 1 -- 172.21.15.19:0/4167534437 >> v2:172.21.15.119:3300/0 conn(0x7fd5b4068ca0 msgr2=0x7fd5b4066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b259c700 1 --2- 172.21.15.19:0/4167534437 >> v2:172.21.15.119:3300/0 conn(0x7fd5b4068ca0 0x7fd5b4066ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b259c700 1 -- 172.21.15.19:0/4167534437 >> v1:172.21.15.19:6789/0 conn(0x7fd5b4158b70 legacy=0x7fd5b4158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b259c700 1 -- 172.21.15.19:0/4167534437 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b40ab6b0 con 0x7fd5b40688d0 2024-08-17T02:26:38.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b1d9b700 1 --2- 172.21.15.19:0/4167534437 >> v2:172.21.15.119:3300/0 conn(0x7fd5b4068ca0 0x7fd5b4066ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.275+0000 7fd5b259c700 1 --2- 172.21.15.19:0/4167534437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b40aab10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40098e0 tx=0x7fd5a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cad408eda1df7db1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b159a700 1 -- 172.21.15.19:0/4167534437 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4011630 con 0x7fd5b40688d0 2024-08-17T02:26:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b159a700 1 -- 172.21.15.19:0/4167534437 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4011790 con 0x7fd5b40688d0 2024-08-17T02:26:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b159a700 1 -- 172.21.15.19:0/4167534437 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4011b30 con 0x7fd5b40688d0 2024-08-17T02:26:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b359e700 1 -- 172.21.15.19:0/4167534437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 msgr2=0x7fd5b40aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b359e700 1 --2- 172.21.15.19:0/4167534437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b40aab10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40098e0 tx=0x7fd5a40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b359e700 1 -- 172.21.15.19:0/4167534437 shutdown_connections 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b359e700 1 --2- 172.21.15.19:0/4167534437 >> v2:172.21.15.119:3300/0 conn(0x7fd5b4068ca0 0x7fd5b4066ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b359e700 1 --2- 172.21.15.19:0/4167534437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b40aab10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b359e700 1 -- 172.21.15.19:0/4167534437 >> 172.21.15.19:0/4167534437 conn(0x7fd5b406e310 msgr2=0x7fd5b406b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b359e700 1 -- 172.21.15.19:0/4167534437 shutdown_connections 2024-08-17T02:26:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.279+0000 7fd5b359e700 1 -- 172.21.15.19:0/4167534437 wait complete. 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 Processor -- start 2024-08-17T02:26:38.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 -- start start 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b4150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4068ca0 0x7fd5b4159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5b4158b70 0x7fd5b415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4159210 con 0x7fd5b4068ca0 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b415aa00 con 0x7fd5b4158b70 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b415ace0 con 0x7fd5b40688d0 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b1d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4068ca0 0x7fd5b4159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b1d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4068ca0 0x7fd5b4159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50110/0 (socket says 172.21.15.19:50110) 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b1d9b700 1 -- 172.21.15.19:0/12584508 learned_addr learned my addr 172.21.15.19:0/12584508 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b2d9d700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5b4158b70 0x7fd5b415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b259c700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b4150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b1d9b700 1 -- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 msgr2=0x7fd5b4150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b1d9b700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b4150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b1d9b700 1 -- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5b4158b70 msgr2=0x7fd5b415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b1d9b700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5b4158b70 0x7fd5b415a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b1d9b700 1 -- 172.21.15.19:0/12584508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8009420 con 0x7fd5b4068ca0 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b259c700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b4150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b1d9b700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4068ca0 0x7fd5b4159e90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800ec80 tx=0x7fd5a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5a27fc700 1 -- 172.21.15.19:0/12584508 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800c9d0 con 0x7fd5b4068ca0 2024-08-17T02:26:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5a27fc700 1 -- 172.21.15.19:0/12584508 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800cb30 con 0x7fd5b4068ca0 2024-08-17T02:26:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a4009420 con 0x7fd5b4068ca0 2024-08-17T02:26:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5a27fc700 1 -- 172.21.15.19:0/12584508 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800ceb0 con 0x7fd5b4068ca0 2024-08-17T02:26:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.283+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b4152070 con 0x7fd5b4068ca0 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.287+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b40638f0 con 0x7fd5b4068ca0 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.287+0000 7fd5a27fc700 1 -- 172.21.15.19:0/12584508 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd5a8013680 con 0x7fd5b4068ca0 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.287+0000 7fd5a27fc700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd594060860 0x7fd594062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.287+0000 7fd5a27fc700 1 -- 172.21.15.19:0/12584508 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5a807d0a0 con 0x7fd5b4068ca0 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.287+0000 7fd5b259c700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd594060860 0x7fd594062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.287+0000 7fd5b259c700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd594060860 0x7fd594062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4003080 tx=0x7fd5a4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.295+0000 7fd5a27fc700 1 -- 172.21.15.19:0/12584508 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd5a804d4f0 con 0x7fd5b4068ca0 2024-08-17T02:26:38.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.459+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5b4157f10 con 0x7fd5b4068ca0 2024-08-17T02:26:38.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.459+0000 7fd5a27fc700 1 -- 172.21.15.19:0/12584508 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5a8050b10 con 0x7fd5b4068ca0 2024-08-17T02:26:38.466 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-08-17T02:26:38.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd594060860 msgr2=0x7fd594062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd594060860 0x7fd594062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4003080 tx=0x7fd5a4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:38.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4068ca0 msgr2=0x7fd5b4159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4068ca0 0x7fd5b4159e90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800ec80 tx=0x7fd5a80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 shutdown_connections 2024-08-17T02:26:38.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd594060860 0x7fd594062d10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5b4158b70 0x7fd5b415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b4068ca0 0x7fd5b4159e90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 --2- 172.21.15.19:0/12584508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5b40688d0 0x7fd5b4150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 >> 172.21.15.19:0/12584508 conn(0x7fd5b406e310 msgr2=0x7fd5b40af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 shutdown_connections 2024-08-17T02:26:38.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.463+0000 7fd5b359e700 1 -- 172.21.15.19:0/12584508 wait complete. 2024-08-17T02:26:38.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:38.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 Processor -- start 2024-08-17T02:26:38.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 -- start start 2024-08-17T02:26:38.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 0x7f4418052920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f441804bc10 0x7f441804a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4418052e60 con 0x7f44180e2320 2024-08-17T02:26:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441804c1d0 con 0x7f441804bc10 2024-08-17T02:26:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441804fe30 con 0x7f44180e26f0 2024-08-17T02:26:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f4426aa3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f441804bc10 0x7f441804a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44262a2700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f44180e2320 0x7f441804a240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:50232/0 (socket says 172.21.15.19:50232) 2024-08-17T02:26:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44262a2700 1 -- 172.21.15.19:0/1484631194 learned_addr learned my addr 172.21.15.19:0/1484631194 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f4426aa3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f441804bc10 0x7f441804a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:54286/0 (socket says 172.21.15.19:54286) 2024-08-17T02:26:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f4425aa1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 0x7f4418052920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f4426aa3700 1 -- 172.21.15.19:0/1484631194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 msgr2=0x7f4418052920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f4426aa3700 1 --2- 172.21.15.19:0/1484631194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 0x7f4418052920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f4426aa3700 1 -- 172.21.15.19:0/1484631194 >> v1:172.21.15.119:6789/0 conn(0x7f44180e2320 legacy=0x7f441804a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44252a0700 1 -- 172.21.15.19:0/1484631194 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630835740 0 0) 0x7f4418052e60 con 0x7f44180e2320 2024-08-17T02:26:38.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f4426aa3700 1 -- 172.21.15.19:0/1484631194 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4418050110 con 0x7f441804bc10 2024-08-17T02:26:38.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f4426aa3700 1 --2- 172.21.15.19:0/1484631194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441804bc10 0x7f441804a950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4420065b20 tx=0x7f4420064ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cad4a90cf3fde54d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44252a0700 1 -- 172.21.15.19:0/1484631194 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442008c070 con 0x7f441804bc10 2024-08-17T02:26:38.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44252a0700 1 -- 172.21.15.19:0/1484631194 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442002b0f0 con 0x7f441804bc10 2024-08-17T02:26:38.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44252a0700 1 -- 172.21.15.19:0/1484631194 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4420071530 con 0x7f441804bc10 2024-08-17T02:26:38.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 -- 172.21.15.19:0/1484631194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441804bc10 msgr2=0x7f441804a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 --2- 172.21.15.19:0/1484631194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441804bc10 0x7f441804a950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4420065b20 tx=0x7f4420064ee0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 -- 172.21.15.19:0/1484631194 shutdown_connections 2024-08-17T02:26:38.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 --2- 172.21.15.19:0/1484631194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441804bc10 0x7f441804a950 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 --2- 172.21.15.19:0/1484631194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 0x7f4418052920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 -- 172.21.15.19:0/1484631194 >> 172.21.15.19:0/1484631194 conn(0x7f4418038360 msgr2=0x7f4418038760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 -- 172.21.15.19:0/1484631194 shutdown_connections 2024-08-17T02:26:38.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.583+0000 7f44272a4700 1 -- 172.21.15.19:0/1484631194 wait complete. 2024-08-17T02:26:38.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44272a4700 1 Processor -- start 2024-08-17T02:26:38.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44272a4700 1 -- start start 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44272a4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441804bc10 0x7f44180dd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44272a4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44180e2320 0x7f44180dbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44272a4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 0x7f44180dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44272a4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418036d90 con 0x7f441804bc10 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44272a4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180062d0 con 0x7f44180e2320 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44272a4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44180dc770 con 0x7f44180e26f0 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44262a2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441804bc10 0x7f44180dd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44262a2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441804bc10 0x7f44180dd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50112/0 (socket says 172.21.15.19:50112) 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44262a2700 1 -- 172.21.15.19:0/894106786 learned_addr learned my addr 172.21.15.19:0/894106786 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f4426aa3700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 0x7f44180dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f4425aa1700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44180e2320 0x7f44180dbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44262a2700 1 -- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 msgr2=0x7f44180dc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44262a2700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 0x7f44180dc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44262a2700 1 -- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44180e2320 msgr2=0x7f44180dbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44262a2700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44180e2320 0x7f44180dbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44262a2700 1 -- 172.21.15.19:0/894106786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180064e0 con 0x7f441804bc10 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f4426aa3700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 0x7f44180dc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f4425aa1700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44180e2320 0x7f44180dbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44262a2700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441804bc10 0x7f44180dd060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c5d0 tx=0x7f441c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44167fc700 1 -- 172.21.15.19:0/894106786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c005c50 con 0x7f441804bc10 2024-08-17T02:26:38.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44167fc700 1 -- 172.21.15.19:0/894106786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c005db0 con 0x7f441804bc10 2024-08-17T02:26:38.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44180067c0 con 0x7f441804bc10 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.587+0000 7f44167fc700 1 -- 172.21.15.19:0/894106786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c007320 con 0x7f441804bc10 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.591+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441804c550 con 0x7f441804bc10 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.591+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4418006cc0 con 0x7f441804bc10 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.591+0000 7f44167fc700 1 -- 172.21.15.19:0/894106786 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f441c0076d0 con 0x7f441804bc10 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.591+0000 7f44167fc700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4404060860 0x7f4404062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.591+0000 7f44167fc700 1 -- 172.21.15.19:0/894106786 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f441c07c1f0 con 0x7f441804bc10 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.591+0000 7f4425aa1700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4404060860 0x7f4404062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.591+0000 7f4425aa1700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4404060860 0x7f4404062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44180f52e0 tx=0x7f4410008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.603+0000 7f44167fc700 1 -- 172.21.15.19:0/894106786 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f441c04c640 con 0x7f441804bc10 2024-08-17T02:26:38.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.791+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4418005800 con 0x7f441804bc10 2024-08-17T02:26:38.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.791+0000 7f44167fc700 1 -- 172.21.15.19:0/894106786 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f441c04fc60 con 0x7f441804bc10 2024-08-17T02:26:38.799 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:38.799 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/903872793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":903872793},{"type":"v1","addr":"172.21.15.19:6833","nonce":903872793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3217936958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3217936958},{"type":"v1","addr":"172.21.15.19:6835","nonce":3217936958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/183789327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":183789327},{"type":"v1","addr":"172.21.15.119:6837","nonce":183789327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:28.987569+0000","modified":"2024-08-17T02:26:31.636583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4404060860 msgr2=0x7f4404062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4404060860 0x7f4404062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44180f52e0 tx=0x7f4410008040 comp rx=0 tx=0).stop 2024-08-17T02:26:38.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441804bc10 msgr2=0x7f44180dd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441804bc10 0x7f44180dd060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c5d0 tx=0x7f441c007d80 comp rx=0 tx=0).stop 2024-08-17T02:26:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 shutdown_connections 2024-08-17T02:26:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4404060860 0x7f4404062d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44180e26f0 0x7f44180dc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44180e2320 0x7f44180dbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 --2- 172.21.15.19:0/894106786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441804bc10 0x7f44180dd060 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 >> 172.21.15.19:0/894106786 conn(0x7f4418038360 msgr2=0x7f44180e1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 shutdown_connections 2024-08-17T02:26:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.795+0000 7f44272a4700 1 -- 172.21.15.19:0/894106786 wait complete. 2024-08-17T02:26:38.804 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-08-17T02:26:38.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:38.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.907+0000 7f08509fa700 1 Processor -- start 2024-08-17T02:26:38.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.907+0000 7f08509fa700 1 -- start start 2024-08-17T02:26:38.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.907+0000 7f08509fa700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c0688d0 0x7f084c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.907+0000 7f08509fa700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f084c159200 0x7f084c0a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.907+0000 7f08509fa700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084c0aa300 con 0x7f084c0a9860 2024-08-17T02:26:38.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.907+0000 7f08509fa700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084c0ac3b0 con 0x7f084c159200 2024-08-17T02:26:38.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.907+0000 7f08509fa700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0aa5e0 con 0x7f084c0688d0 2024-08-17T02:26:38.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.907+0000 7f084ad9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c0688d0 0x7f084c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f084b59e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f084c159200 0x7f084c0a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.907+0000 7f084a59c700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f084c0a9860 0x7f084c158af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:50248/0 (socket says 172.21.15.19:50248) 2024-08-17T02:26:38.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f084a59c700 1 -- 172.21.15.19:0/2333080466 learned_addr learned my addr 172.21.15.19:0/2333080466 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:38.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f084b59e700 1 -- 172.21.15.19:0/2333080466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c0688d0 msgr2=0x7f084c068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f084b59e700 1 --2- 172.21.15.19:0/2333080466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c0688d0 0x7f084c068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f084b59e700 1 -- 172.21.15.19:0/2333080466 >> v1:172.21.15.119:6789/0 conn(0x7f084c0a9860 legacy=0x7f084c158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f084b59e700 1 -- 172.21.15.19:0/2333080466 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c0aa8c0 con 0x7f084c159200 2024-08-17T02:26:38.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f084b59e700 1 --2- 172.21.15.19:0/2333080466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c159200 0x7f084c0a9c90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0844009e60 tx=0x7f0844009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba7feee7605210e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f0849d9b700 1 -- 172.21.15.19:0/2333080466 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084400e070 con 0x7f084c159200 2024-08-17T02:26:38.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f0849d9b700 1 -- 172.21.15.19:0/2333080466 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084400bb60 con 0x7f084c159200 2024-08-17T02:26:38.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f0849d9b700 1 -- 172.21.15.19:0/2333080466 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844012430 con 0x7f084c159200 2024-08-17T02:26:38.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f08509fa700 1 -- 172.21.15.19:0/2333080466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c159200 msgr2=0x7f084c0a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f08509fa700 1 --2- 172.21.15.19:0/2333080466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c159200 0x7f084c0a9c90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0844009e60 tx=0x7f0844009780 comp rx=0 tx=0).stop 2024-08-17T02:26:38.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f08509fa700 1 -- 172.21.15.19:0/2333080466 shutdown_connections 2024-08-17T02:26:38.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f08509fa700 1 --2- 172.21.15.19:0/2333080466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c159200 0x7f084c0a9c90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f08509fa700 1 --2- 172.21.15.19:0/2333080466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c0688d0 0x7f084c068ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f08509fa700 1 -- 172.21.15.19:0/2333080466 >> 172.21.15.19:0/2333080466 conn(0x7f084c06d790 msgr2=0x7f084c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f08509fa700 1 -- 172.21.15.19:0/2333080466 shutdown_connections 2024-08-17T02:26:38.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.911+0000 7f08509fa700 1 -- 172.21.15.19:0/2333080466 wait complete. 2024-08-17T02:26:38.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f08509fa700 1 Processor -- start 2024-08-17T02:26:38.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f08509fa700 1 -- start start 2024-08-17T02:26:38.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f08509fa700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c0688d0 0x7f084c16a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f08509fa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f084c0a9860 0x7f084c151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f08509fa700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c159200 0x7f084c0b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f08509fa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c154dd0 con 0x7f084c0a9860 2024-08-17T02:26:38.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f08509fa700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c16a6f0 con 0x7f084c0688d0 2024-08-17T02:26:38.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f08509fa700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c14f4a0 con 0x7f084c159200 2024-08-17T02:26:38.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f084a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f084c0a9860 0x7f084c151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f084ad9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c0688d0 0x7f084c16a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f084b59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c159200 0x7f084c0b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f084a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f084c0a9860 0x7f084c151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50118/0 (socket says 172.21.15.19:50118) 2024-08-17T02:26:38.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.915+0000 7f084a59c700 1 -- 172.21.15.19:0/1948218042 learned_addr learned my addr 172.21.15.19:0/1948218042 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:38.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f084a59c700 1 -- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c159200 msgr2=0x7f084c0b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f084a59c700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c159200 0x7f084c0b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f084a59c700 1 -- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c0688d0 msgr2=0x7f084c16a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f084a59c700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c0688d0 0x7f084c16a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f084a59c700 1 -- 172.21.15.19:0/1948218042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844009a20 con 0x7f084c0a9860 2024-08-17T02:26:38.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f084ad9d700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c0688d0 0x7f084c16a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:38.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f084a59c700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f084c0a9860 0x7f084c151260 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f084000c7c0 tx=0x7f0840007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f0832ffd700 1 -- 172.21.15.19:0/1948218042 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840005b30 con 0x7f084c0a9860 2024-08-17T02:26:38.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f0832ffd700 1 -- 172.21.15.19:0/1948218042 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840005c90 con 0x7f084c0a9860 2024-08-17T02:26:38.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f0832ffd700 1 -- 172.21.15.19:0/1948218042 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840007320 con 0x7f084c0a9860 2024-08-17T02:26:38.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084c14f780 con 0x7f084c0a9860 2024-08-17T02:26:38.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084c14fd40 con 0x7f084c0a9860 2024-08-17T02:26:38.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084c0643a0 con 0x7f084c0a9860 2024-08-17T02:26:38.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.919+0000 7f0832ffd700 1 -- 172.21.15.19:0/1948218042 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0840007690 con 0x7f084c0a9860 2024-08-17T02:26:38.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.923+0000 7f0832ffd700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0838060890 0x7f0838062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.923+0000 7f0832ffd700 1 -- 172.21.15.19:0/1948218042 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f084007bf90 con 0x7f084c0a9860 2024-08-17T02:26:38.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.923+0000 7f084ad9d700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0838060890 0x7f0838062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.923+0000 7f084ad9d700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0838060890 0x7f0838062d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f084c06b500 tx=0x7f083c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:38.927+0000 7f0832ffd700 1 -- 172.21.15.19:0/1948218042 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f084004c3e0 con 0x7f084c0a9860 2024-08-17T02:26:39.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.091+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f084c06a160 con 0x7f084c0a9860 2024-08-17T02:26:39.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f0832ffd700 1 -- 172.21.15.19:0/1948218042 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f0840017090 con 0x7f084c0a9860 2024-08-17T02:26:39.100 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:39.100 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0838060890 msgr2=0x7f0838062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0838060890 0x7f0838062d40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f084c06b500 tx=0x7f083c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f084c0a9860 msgr2=0x7f084c151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f084c0a9860 0x7f084c151260 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f084000c7c0 tx=0x7f0840007f30 comp rx=0 tx=0).stop 2024-08-17T02:26:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 shutdown_connections 2024-08-17T02:26:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0838060890 0x7f0838062d40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f084c159200 0x7f084c0b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f084c0a9860 0x7f084c151260 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 --2- 172.21.15.19:0/1948218042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f084c0688d0 0x7f084c16a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 >> 172.21.15.19:0/1948218042 conn(0x7f084c06d790 msgr2=0x7f084c159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 shutdown_connections 2024-08-17T02:26:39.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.095+0000 7f08509fa700 1 -- 172.21.15.19:0/1948218042 wait complete. 2024-08-17T02:26:39.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:27.555224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:27.958499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:39.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7fa93700 1 Processor -- start 2024-08-17T02:26:39.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7fa93700 1 -- start start 2024-08-17T02:26:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7fa93700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e78159400 0x7f7e780b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7fa93700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e781597d0 0x7f7e780ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7fa93700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e780ac630 con 0x7f7e780686a0 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7fa93700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780ac910 con 0x7f7e78159400 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7fa93700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780acbf0 con 0x7f7e781597d0 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d82f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e78159400 0x7f7e780b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d82f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e78159400 0x7f7e780b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50122/0 (socket says 172.21.15.19:50122) 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d82f700 1 -- 172.21.15.19:0/3651851284 learned_addr learned my addr 172.21.15.19:0/3651851284 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d02e700 1 --2- 172.21.15.19:0/3651851284 >> v2:172.21.15.119:3300/0 conn(0x7f7e781597d0 0x7f7e780ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d82f700 1 -- 172.21.15.19:0/3651851284 >> v2:172.21.15.119:3300/0 conn(0x7f7e781597d0 msgr2=0x7f7e780ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d82f700 1 --2- 172.21.15.19:0/3651851284 >> v2:172.21.15.119:3300/0 conn(0x7f7e781597d0 0x7f7e780ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d82f700 1 -- 172.21.15.19:0/3651851284 >> v1:172.21.15.119:6789/0 conn(0x7f7e780686a0 legacy=0x7f7e780af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d82f700 1 -- 172.21.15.19:0/3651851284 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780aced0 con 0x7f7e78159400 2024-08-17T02:26:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d02e700 1 --2- 172.21.15.19:0/3651851284 >> v2:172.21.15.119:3300/0 conn(0x7f7e781597d0 0x7f7e780ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7d82f700 1 --2- 172.21.15.19:0/3651851284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78159400 0x7f7e780b1c00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e7806d6e0 tx=0x7f7e74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562e033cf4f685a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7c82d700 1 -- 172.21.15.19:0/3651851284 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400e070 con 0x7f7e78159400 2024-08-17T02:26:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7c82d700 1 -- 172.21.15.19:0/3651851284 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7400ba50 con 0x7f7e78159400 2024-08-17T02:26:39.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.227+0000 7f7e7c82d700 1 -- 172.21.15.19:0/3651851284 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e740092e0 con 0x7f7e78159400 2024-08-17T02:26:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 -- 172.21.15.19:0/3651851284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78159400 msgr2=0x7f7e780b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 --2- 172.21.15.19:0/3651851284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78159400 0x7f7e780b1c00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e7806d6e0 tx=0x7f7e74009840 comp rx=0 tx=0).stop 2024-08-17T02:26:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 -- 172.21.15.19:0/3651851284 shutdown_connections 2024-08-17T02:26:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 --2- 172.21.15.19:0/3651851284 >> v2:172.21.15.119:3300/0 conn(0x7f7e781597d0 0x7f7e780ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 --2- 172.21.15.19:0/3651851284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78159400 0x7f7e780b1c00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 -- 172.21.15.19:0/3651851284 >> 172.21.15.19:0/3651851284 conn(0x7f7e780c9bf0 msgr2=0x7f7e7806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 -- 172.21.15.19:0/3651851284 shutdown_connections 2024-08-17T02:26:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 -- 172.21.15.19:0/3651851284 wait complete. 2024-08-17T02:26:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 Processor -- start 2024-08-17T02:26:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 -- start start 2024-08-17T02:26:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e780686a0 0x7f7e781438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e78159400 0x7f7e780a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e781597d0 0x7f7e7806adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780a7980 con 0x7f7e781597d0 2024-08-17T02:26:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780a6d50 con 0x7f7e780686a0 2024-08-17T02:26:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7fa93700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780a7030 con 0x7f7e78159400 2024-08-17T02:26:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7e030700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e781597d0 0x7f7e7806adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7d02e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e78159400 0x7f7e780a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7e030700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e781597d0 0x7f7e7806adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50130/0 (socket says 172.21.15.19:50130) 2024-08-17T02:26:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7e030700 1 -- 172.21.15.19:0/1596669665 learned_addr learned my addr 172.21.15.19:0/1596669665 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.231+0000 7f7e7d82f700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e780686a0 0x7f7e781438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e7e030700 1 -- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e78159400 msgr2=0x7f7e780a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e7e030700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e78159400 0x7f7e780a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e7e030700 1 -- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e780686a0 msgr2=0x7f7e781438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e7e030700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e780686a0 0x7f7e781438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e7e030700 1 -- 172.21.15.19:0/1596669665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74009ae0 con 0x7f7e781597d0 2024-08-17T02:26:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e7e030700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e781597d0 0x7f7e7806adc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c560 tx=0x7f7e70007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e6dffb700 1 -- 172.21.15.19:0/1596669665 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011590 con 0x7f7e781597d0 2024-08-17T02:26:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e6dffb700 1 -- 172.21.15.19:0/1596669665 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e700116f0 con 0x7f7e781597d0 2024-08-17T02:26:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e6dffb700 1 -- 172.21.15.19:0/1596669665 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011ab0 con 0x7f7e781597d0 2024-08-17T02:26:39.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e780a7310 con 0x7f7e781597d0 2024-08-17T02:26:39.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e78143e00 con 0x7f7e781597d0 2024-08-17T02:26:39.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e780a7af0 con 0x7f7e781597d0 2024-08-17T02:26:39.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e6dffb700 1 -- 172.21.15.19:0/1596669665 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7e7001b3b0 con 0x7f7e781597d0 2024-08-17T02:26:39.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.235+0000 7f7e6dffb700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7e5c060860 0x7f7e5c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.239+0000 7f7e6dffb700 1 -- 172.21.15.19:0/1596669665 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e7007bff0 con 0x7f7e781597d0 2024-08-17T02:26:39.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.239+0000 7f7e7d82f700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7e5c060860 0x7f7e5c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.239+0000 7f7e7d82f700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7e5c060860 0x7f7e5c062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009880 tx=0x7f7e74018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.243+0000 7f7e6dffb700 1 -- 172.21.15.19:0/1596669665 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7e7004c440 con 0x7f7e781597d0 2024-08-17T02:26:39.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e780645c0 con 0x7f7e781597d0 2024-08-17T02:26:39.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e6dffb700 1 -- 172.21.15.19:0/1596669665 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e70017020 con 0x7f7e781597d0 2024-08-17T02:26:39.411 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:26:39.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7e5c060860 msgr2=0x7f7e5c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7e5c060860 0x7f7e5c062d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009880 tx=0x7f7e74018000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e781597d0 msgr2=0x7f7e7806adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e781597d0 0x7f7e7806adc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c560 tx=0x7f7e70007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 shutdown_connections 2024-08-17T02:26:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7e5c060860 0x7f7e5c062d10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e781597d0 0x7f7e7806adc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e78159400 0x7f7e780a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 --2- 172.21.15.19:0/1596669665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e780686a0 0x7f7e781438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 >> 172.21.15.19:0/1596669665 conn(0x7f7e780c9bf0 msgr2=0x7f7e780cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 shutdown_connections 2024-08-17T02:26:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.407+0000 7f7e7fa93700 1 -- 172.21.15.19:0/1596669665 wait complete. 2024-08-17T02:26:39.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:39.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdd67e3700 1 Processor -- start 2024-08-17T02:26:39.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdd67e3700 1 -- start start 2024-08-17T02:26:39.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdd67e3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdd0159300 0x7fbdd00b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdd67e3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbdd0067510 0x7fbdd00cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdd67e3700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00cba90 con 0x7fbdd01596d0 2024-08-17T02:26:39.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdd67e3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd00b2b60 con 0x7fbdd0159300 2024-08-17T02:26:39.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdd67e3700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd00cb160 con 0x7fbdd0067510 2024-08-17T02:26:39.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdcffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdd0159300 0x7fbdd00b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdcffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdd0159300 0x7fbdd00b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50134/0 (socket says 172.21.15.19:50134) 2024-08-17T02:26:39.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdcffff700 1 -- 172.21.15.19:0/4233336849 learned_addr learned my addr 172.21.15.19:0/4233336849 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:39.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.539+0000 7fbdd4d80700 1 --2- 172.21.15.19:0/4233336849 >> v2:172.21.15.119:3300/0 conn(0x7fbdd0067510 0x7fbdd00cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdcffff700 1 -- 172.21.15.19:0/4233336849 >> v2:172.21.15.119:3300/0 conn(0x7fbdd0067510 msgr2=0x7fbdd00cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdcffff700 1 --2- 172.21.15.19:0/4233336849 >> v2:172.21.15.119:3300/0 conn(0x7fbdd0067510 0x7fbdd00cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdcffff700 1 -- 172.21.15.19:0/4233336849 >> v1:172.21.15.119:6789/0 conn(0x7fbdd01596d0 legacy=0x7fbdd0066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdcffff700 1 -- 172.21.15.19:0/4233336849 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00cb440 con 0x7fbdd0159300 2024-08-17T02:26:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdcffff700 1 --2- 172.21.15.19:0/4233336849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd0159300 0x7fbdd00b2230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00cd7b0 tx=0x7fbdb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d488df5f79e1da9a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdceffd700 1 -- 172.21.15.19:0/4233336849 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8009e70 con 0x7fbdd0159300 2024-08-17T02:26:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdceffd700 1 -- 172.21.15.19:0/4233336849 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800b860 con 0x7fbdd0159300 2024-08-17T02:26:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdceffd700 1 -- 172.21.15.19:0/4233336849 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800bc00 con 0x7fbdd0159300 2024-08-17T02:26:39.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdd67e3700 1 -- 172.21.15.19:0/4233336849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd0159300 msgr2=0x7fbdd00b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdd67e3700 1 --2- 172.21.15.19:0/4233336849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd0159300 0x7fbdd00b2230 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00cd7b0 tx=0x7fbdb8009250 comp rx=0 tx=0).stop 2024-08-17T02:26:39.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdd67e3700 1 -- 172.21.15.19:0/4233336849 shutdown_connections 2024-08-17T02:26:39.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdd67e3700 1 --2- 172.21.15.19:0/4233336849 >> v2:172.21.15.119:3300/0 conn(0x7fbdd0067510 0x7fbdd00cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdd67e3700 1 --2- 172.21.15.19:0/4233336849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd0159300 0x7fbdd00b2230 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdd67e3700 1 -- 172.21.15.19:0/4233336849 >> 172.21.15.19:0/4233336849 conn(0x7fbdd00682c0 msgr2=0x7fbdd00686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdd67e3700 1 -- 172.21.15.19:0/4233336849 shutdown_connections 2024-08-17T02:26:39.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.543+0000 7fbdd67e3700 1 -- 172.21.15.19:0/4233336849 wait complete. 2024-08-17T02:26:39.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 Processor -- start 2024-08-17T02:26:39.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 -- start start 2024-08-17T02:26:39.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdd0067510 0x7fbdd00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd01596d0 0x7fbdd00c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdd0156300 0x7fbdd00c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd016a1e0 con 0x7fbdd01596d0 2024-08-17T02:26:39.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd01695e0 con 0x7fbdd0067510 2024-08-17T02:26:39.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd01698b0 con 0x7fbdd0156300 2024-08-17T02:26:39.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd01596d0 0x7fbdd00c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd01596d0 0x7fbdd00c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50140/0 (socket says 172.21.15.19:50140) 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcf7fe700 1 -- 172.21.15.19:0/2657599249 learned_addr learned my addr 172.21.15.19:0/2657599249 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcffff700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdd0067510 0x7fbdd00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd4d80700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdd0156300 0x7fbdd00c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcf7fe700 1 -- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdd0156300 msgr2=0x7fbdd00c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcf7fe700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdd0156300 0x7fbdd00c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcf7fe700 1 -- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdd0067510 msgr2=0x7fbdd00b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcf7fe700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdd0067510 0x7fbdd00b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcf7fe700 1 -- 172.21.15.19:0/2657599249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb80094f0 con 0x7fbdd01596d0 2024-08-17T02:26:39.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdcf7fe700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd01596d0 0x7fbdd00c43f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000c4e0 tx=0x7fbdc000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdc7fff700 1 -- 172.21.15.19:0/2657599249 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0011590 con 0x7fbdd01596d0 2024-08-17T02:26:39.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdc7fff700 1 -- 172.21.15.19:0/2657599249 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc0011710 con 0x7fbdd01596d0 2024-08-17T02:26:39.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd0169b90 con 0x7fbdd01596d0 2024-08-17T02:26:39.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdc7fff700 1 -- 172.21.15.19:0/2657599249 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0011ad0 con 0x7fbdd01596d0 2024-08-17T02:26:39.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.547+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd00b51b0 con 0x7fbdd01596d0 2024-08-17T02:26:39.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.551+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd016a390 con 0x7fbdd01596d0 2024-08-17T02:26:39.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.551+0000 7fbdc7fff700 1 -- 172.21.15.19:0/2657599249 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbdc001b3b0 con 0x7fbdd01596d0 2024-08-17T02:26:39.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.551+0000 7fbdc7fff700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdb0060860 0x7fbdb0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.551+0000 7fbdc7fff700 1 -- 172.21.15.19:0/2657599249 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdc007c020 con 0x7fbdd01596d0 2024-08-17T02:26:39.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.551+0000 7fbdcffff700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdb0060860 0x7fbdb0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.551+0000 7fbdcffff700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdb0060860 0x7fbdb0062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00cd7b0 tx=0x7fbdb8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.559+0000 7fbdc7fff700 1 -- 172.21.15.19:0/2657599249 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbdd016a390 con 0x7fbdd01596d0 2024-08-17T02:26:39.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.715+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbdd00645c0 con 0x7fbdd01596d0 2024-08-17T02:26:39.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdc7fff700 1 -- 172.21.15.19:0/2657599249 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbdc00170a0 con 0x7fbdd01596d0 2024-08-17T02:26:39.723 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdb0060860 msgr2=0x7fbdb0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdb0060860 0x7fbdb0062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00cd7b0 tx=0x7fbdb8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd01596d0 msgr2=0x7fbdd00c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd01596d0 0x7fbdd00c43f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000c4e0 tx=0x7fbdc000c7f0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 shutdown_connections 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdb0060860 0x7fbdb0062d10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdd0156300 0x7fbdd00c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd01596d0 0x7fbdd00c43f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 --2- 172.21.15.19:0/2657599249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdd0067510 0x7fbdd00b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 >> 172.21.15.19:0/2657599249 conn(0x7fbdd00682c0 msgr2=0x7fbdd015cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 shutdown_connections 2024-08-17T02:26:39.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.719+0000 7fbdd67e3700 1 -- 172.21.15.19:0/2657599249 wait complete. 2024-08-17T02:26:39.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:39.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 Processor -- start 2024-08-17T02:26:39.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 -- start start 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9b4406e470 0x7f9b440aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9b4406e840 0x7f9b440aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b440b0ef0 0x7f9b440b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b44140f70 con 0x7f9b4406e840 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b44141250 con 0x7f9b4406e470 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44141530 con 0x7f9b440b0ef0 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b41d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9b4406e840 0x7f9b440aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b41d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9b4406e840 0x7f9b440aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50150/0 (socket says 172.21.15.19:50150) 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b41d9b700 1 -- 172.21.15.19:0/2447278525 learned_addr learned my addr 172.21.15.19:0/2447278525 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b42d9d700 1 --2- 172.21.15.19:0/2447278525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b440b0ef0 0x7f9b440b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4259c700 1 --2- 172.21.15.19:0/2447278525 >> v2:172.21.15.119:3300/0 conn(0x7f9b4406e470 0x7f9b440aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b41d9b700 1 -- 172.21.15.19:0/2447278525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b440b0ef0 msgr2=0x7f9b440b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b41d9b700 1 --2- 172.21.15.19:0/2447278525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b440b0ef0 0x7f9b440b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b41d9b700 1 -- 172.21.15.19:0/2447278525 >> v2:172.21.15.119:3300/0 conn(0x7f9b4406e470 msgr2=0x7f9b440aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b41d9b700 1 --2- 172.21.15.19:0/2447278525 >> v2:172.21.15.119:3300/0 conn(0x7f9b4406e470 0x7f9b440aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b41d9b700 1 -- 172.21.15.19:0/2447278525 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44141810 con 0x7f9b4406e840 2024-08-17T02:26:39.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b41d9b700 1 --2- 172.21.15.19:0/2447278525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b4406e840 0x7f9b440aefc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b340099b0 tx=0x7f9b34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91cd280821009d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4159a700 1 -- 172.21.15.19:0/2447278525 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400b820 con 0x7f9b4406e840 2024-08-17T02:26:39.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4159a700 1 -- 172.21.15.19:0/2447278525 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3400b980 con 0x7f9b4406e840 2024-08-17T02:26:39.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4159a700 1 -- 172.21.15.19:0/2447278525 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400bd20 con 0x7f9b4406e840 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 -- 172.21.15.19:0/2447278525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b4406e840 msgr2=0x7f9b440aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2447278525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b4406e840 0x7f9b440aefc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9b340099b0 tx=0x7f9b34009250 comp rx=0 tx=0).stop 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 -- 172.21.15.19:0/2447278525 shutdown_connections 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2447278525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b4406e840 0x7f9b440aefc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2447278525 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b440b0ef0 0x7f9b440b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2447278525 >> v2:172.21.15.119:3300/0 conn(0x7f9b4406e470 0x7f9b440aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 -- 172.21.15.19:0/2447278525 >> 172.21.15.19:0/2447278525 conn(0x7f9b440678a0 msgr2=0x7f9b44067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 -- 172.21.15.19:0/2447278525 shutdown_connections 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.843+0000 7f9b4359e700 1 -- 172.21.15.19:0/2447278525 wait complete. 2024-08-17T02:26:39.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b4359e700 1 Processor -- start 2024-08-17T02:26:39.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b4359e700 1 -- start start 2024-08-17T02:26:39.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b4359e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4406e470 0x7f9b4413fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b4359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b4406e840 0x7f9b44154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b4359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b0ef0 0x7f9b44170cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b4359e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44155dd0 con 0x7f9b440b0ef0 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b4359e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44140320 con 0x7f9b4406e470 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b4359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441551c0 con 0x7f9b4406e840 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b42d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b0ef0 0x7f9b44170cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b42d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b0ef0 0x7f9b44170cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50164/0 (socket says 172.21.15.19:50164) 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b42d9d700 1 -- 172.21.15.19:0/2350149037 learned_addr learned my addr 172.21.15.19:0/2350149037 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b4259c700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4406e470 0x7f9b4413fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b41d9b700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b4406e840 0x7f9b44154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b42d9d700 1 -- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b4406e840 msgr2=0x7f9b44154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b42d9d700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b4406e840 0x7f9b44154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b42d9d700 1 -- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4406e470 msgr2=0x7f9b4413fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b42d9d700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4406e470 0x7f9b4413fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b42d9d700 1 -- 172.21.15.19:0/2350149037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b340094f0 con 0x7f9b440b0ef0 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b41d9b700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b4406e840 0x7f9b44154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.847+0000 7f9b42d9d700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b0ef0 0x7f9b44170cd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009fa0 tx=0x7f9b3c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b327fc700 1 -- 172.21.15.19:0/2350149037 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00ec70 con 0x7f9b440b0ef0 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b327fc700 1 -- 172.21.15.19:0/2350149037 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c00edd0 con 0x7f9b440b0ef0 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b441554a0 con 0x7f9b440b0ef0 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b44155a60 con 0x7f9b440b0ef0 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b327fc700 1 -- 172.21.15.19:0/2350149037 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c014670 con 0x7f9b440b0ef0 2024-08-17T02:26:39.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b44064330 con 0x7f9b440b0ef0 2024-08-17T02:26:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b327fc700 1 -- 172.21.15.19:0/2350149037 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9b3c0149e0 con 0x7f9b440b0ef0 2024-08-17T02:26:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b327fc700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9b24060890 0x7f9b24062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b327fc700 1 -- 172.21.15.19:0/2350149037 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b3c07d320 con 0x7f9b440b0ef0 2024-08-17T02:26:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.851+0000 7f9b4259c700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9b24060890 0x7f9b24062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.855+0000 7f9b4259c700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9b24060890 0x7f9b24062d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9b38006fd0 tx=0x7f9b38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:39.863+0000 7f9b327fc700 1 -- 172.21.15.19:0/2350149037 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9b3c04d770 con 0x7f9b440b0ef0 2024-08-17T02:26:40.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.027+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b4406ed70 con 0x7f9b440b0ef0 2024-08-17T02:26:40.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.027+0000 7f9b327fc700 1 -- 172.21.15.19:0/2350149037 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b3c050d90 con 0x7f9b440b0ef0 2024-08-17T02:26:40.032 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-08-17T02:26:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.027+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9b24060890 msgr2=0x7f9b24062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.027+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9b24060890 0x7f9b24062d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9b38006fd0 tx=0x7f9b38008040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.027+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b0ef0 msgr2=0x7f9b44170cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.027+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b0ef0 0x7f9b44170cd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009fa0 tx=0x7f9b3c009900 comp rx=0 tx=0).stop 2024-08-17T02:26:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.027+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 shutdown_connections 2024-08-17T02:26:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.031+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9b24060890 0x7f9b24062d40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.031+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b440b0ef0 0x7f9b44170cd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.031+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9b4406e840 0x7f9b44154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.031+0000 7f9b4359e700 1 --2- 172.21.15.19:0/2350149037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b4406e470 0x7f9b4413fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.031+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 >> 172.21.15.19:0/2350149037 conn(0x7f9b440678a0 msgr2=0x7f9b4415c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.031+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 shutdown_connections 2024-08-17T02:26:40.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.031+0000 7f9b4359e700 1 -- 172.21.15.19:0/2350149037 wait complete. 2024-08-17T02:26:40.046 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:40.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.147+0000 7f53d2851700 1 Processor -- start 2024-08-17T02:26:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.147+0000 7f53d2851700 1 -- start start 2024-08-17T02:26:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53cc0687a0 0x7f53cc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f53cc06d830 0x7f53cc0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc15ce60 con 0x7f53cc153a50 2024-08-17T02:26:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0ae710 con 0x7f53cc0687a0 2024-08-17T02:26:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc06dc30 con 0x7f53cc06d830 2024-08-17T02:26:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53cb7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53cc0687a0 0x7f53cc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53cbfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f53cc153a50 0x7f53cc0ae000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53838/0 (socket says 172.21.15.19:53838) 2024-08-17T02:26:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53cb7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53cc0687a0 0x7f53cc06d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50170/0 (socket says 172.21.15.19:50170) 2024-08-17T02:26:40.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53cbfff700 1 -- 172.21.15.19:0/951958296 learned_addr learned my addr 172.21.15.19:0/951958296 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:40.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d0dee700 1 --2- 172.21.15.19:0/951958296 >> v2:172.21.15.119:3300/0 conn(0x7f53cc06d830 0x7f53cc0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53cb7fe700 1 -- 172.21.15.19:0/951958296 >> v2:172.21.15.119:3300/0 conn(0x7f53cc06d830 msgr2=0x7f53cc0afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53cb7fe700 1 --2- 172.21.15.19:0/951958296 >> v2:172.21.15.119:3300/0 conn(0x7f53cc06d830 0x7f53cc0afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53cb7fe700 1 -- 172.21.15.19:0/951958296 >> v1:172.21.15.19:6789/0 conn(0x7f53cc153a50 legacy=0x7f53cc0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53caffd700 1 -- 172.21.15.19:0/951958296 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966992347 0 0) 0x7f53cc15ce60 con 0x7f53cc153a50 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53cb7fe700 1 -- 172.21.15.19:0/951958296 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc068bd0 con 0x7f53cc0687a0 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53cb7fe700 1 --2- 172.21.15.19:0/951958296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc0687a0 0x7f53cc06d2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f53cc153e20 tx=0x7f53b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad81cbe792f8068 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53caffd700 1 -- 172.21.15.19:0/951958296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b400e070 con 0x7f53cc0687a0 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53caffd700 1 -- 172.21.15.19:0/951958296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b400bb60 con 0x7f53cc0687a0 2024-08-17T02:26:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53caffd700 1 -- 172.21.15.19:0/951958296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4012430 con 0x7f53cc0687a0 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 -- 172.21.15.19:0/951958296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc0687a0 msgr2=0x7f53cc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 --2- 172.21.15.19:0/951958296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc0687a0 0x7f53cc06d2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f53cc153e20 tx=0x7f53b4009780 comp rx=0 tx=0).stop 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 -- 172.21.15.19:0/951958296 shutdown_connections 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 --2- 172.21.15.19:0/951958296 >> v2:172.21.15.119:3300/0 conn(0x7f53cc06d830 0x7f53cc0afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 --2- 172.21.15.19:0/951958296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc0687a0 0x7f53cc06d2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 -- 172.21.15.19:0/951958296 >> 172.21.15.19:0/951958296 conn(0x7f53cc0ceb30 msgr2=0x7f53cc06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 -- 172.21.15.19:0/951958296 shutdown_connections 2024-08-17T02:26:40.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.151+0000 7f53d2851700 1 -- 172.21.15.19:0/951958296 wait complete. 2024-08-17T02:26:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53d2851700 1 Processor -- start 2024-08-17T02:26:40.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53d2851700 1 -- start start 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53d2851700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc0687a0 0x7f53cc15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53d2851700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc06d830 0x7f53cc06b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53d2851700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53cc153a50 0x7f53cc06b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53d2851700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc14cdb0 con 0x7f53cc06d830 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53d2851700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc06ae30 con 0x7f53cc0687a0 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53d2851700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc15ce20 con 0x7f53cc153a50 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc06d830 0x7f53cc06b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc06d830 0x7f53cc06b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50184/0 (socket says 172.21.15.19:50184) 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cb7fe700 1 -- 172.21.15.19:0/830733229 learned_addr learned my addr 172.21.15.19:0/830733229 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cbfff700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc0687a0 0x7f53cc15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53d0dee700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53cc153a50 0x7f53cc06b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cb7fe700 1 -- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53cc153a50 msgr2=0x7f53cc06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cb7fe700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53cc153a50 0x7f53cc06b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cb7fe700 1 -- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc0687a0 msgr2=0x7f53cc15c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cb7fe700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc0687a0 0x7f53cc15c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cb7fe700 1 -- 172.21.15.19:0/830733229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009a20 con 0x7f53cc06d830 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cbfff700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc0687a0 0x7f53cc15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.155+0000 7f53cb7fe700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc06d830 0x7f53cc06b2c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f53b40099f0 tx=0x7f53b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53c3fff700 1 -- 172.21.15.19:0/830733229 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4012e30 con 0x7f53cc06d830 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53c3fff700 1 -- 172.21.15.19:0/830733229 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4027470 con 0x7f53cc06d830 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc15c860 con 0x7f53cc06d830 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53c3fff700 1 -- 172.21.15.19:0/830733229 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4027830 con 0x7f53cc06d830 2024-08-17T02:26:40.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc06aac0 con 0x7f53cc06d830 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc06afc0 con 0x7f53cc06d830 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53c3fff700 1 -- 172.21.15.19:0/830733229 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f53b4024070 con 0x7f53cc06d830 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53c3fff700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f53b0060860 0x7f53b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53c3fff700 1 -- 172.21.15.19:0/830733229 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53b407f260 con 0x7f53cc06d830 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.159+0000 7f53cbfff700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f53b0060860 0x7f53b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.163+0000 7f53cbfff700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f53b0060860 0x7f53b0062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f53c40011e0 tx=0x7f53c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.167+0000 7f53c3fff700 1 -- 172.21.15.19:0/830733229 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f53b404f6b0 con 0x7f53cc06d830 2024-08-17T02:26:40.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.367+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53cc0645c0 con 0x7f53cc06d830 2024-08-17T02:26:40.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.367+0000 7f53c3fff700 1 -- 172.21.15.19:0/830733229 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f53b4052cd0 con 0x7f53cc06d830 2024-08-17T02:26:40.373 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:40.373 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/903872793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":903872793},{"type":"v1","addr":"172.21.15.19:6833","nonce":903872793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3217936958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3217936958},{"type":"v1","addr":"172.21.15.19:6835","nonce":3217936958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/183789327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":183789327},{"type":"v1","addr":"172.21.15.119:6837","nonce":183789327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:28.987569+0000","modified":"2024-08-17T02:26:31.636583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:40.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f53b0060860 msgr2=0x7f53b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f53b0060860 0x7f53b0062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f53c40011e0 tx=0x7f53c4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:40.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc06d830 msgr2=0x7f53cc06b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc06d830 0x7f53cc06b2c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f53b40099f0 tx=0x7f53b4019000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 shutdown_connections 2024-08-17T02:26:40.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f53b0060860 0x7f53b0062d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53cc153a50 0x7f53cc06b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53cc06d830 0x7f53cc06b2c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 --2- 172.21.15.19:0/830733229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53cc0687a0 0x7f53cc15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 >> 172.21.15.19:0/830733229 conn(0x7f53cc0ceb30 msgr2=0x7f53cc0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 shutdown_connections 2024-08-17T02:26:40.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.371+0000 7f53d2851700 1 -- 172.21.15.19:0/830733229 wait complete. 2024-08-17T02:26:40.377 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-08-17T02:26:40.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:40.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c74ebb700 1 Processor -- start 2024-08-17T02:26:40.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c74ebb700 1 -- start start 2024-08-17T02:26:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c74ebb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 0x7f2c700af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c74ebb700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c7006e830 0x7f2c700a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c74ebb700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c700b0270 con 0x7f2c700a9260 2024-08-17T02:26:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c74ebb700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c700af660 con 0x7f2c7006e830 2024-08-17T02:26:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c74ebb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700af940 con 0x7f2c7015d540 2024-08-17T02:26:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6e59c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 0x7f2c700af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6dd9b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c7006e830 0x7f2c700a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6dd9b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c7006e830 0x7f2c700a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:54412/0 (socket says 172.21.15.19:54412) 2024-08-17T02:26:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6ed9d700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2c700a9260 0x7f2c700b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:50276/0 (socket says 172.21.15.19:50276) 2024-08-17T02:26:40.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6e59c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 0x7f2c700af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:50886/0 (socket says 172.21.15.19:50886) 2024-08-17T02:26:40.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6dd9b700 1 -- 172.21.15.19:0/2358265523 learned_addr learned my addr 172.21.15.19:0/2358265523 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:40.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6dd9b700 1 -- 172.21.15.19:0/2358265523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 msgr2=0x7f2c700af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6dd9b700 1 --2- 172.21.15.19:0/2358265523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 0x7f2c700af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6dd9b700 1 -- 172.21.15.19:0/2358265523 >> v1:172.21.15.119:6789/0 conn(0x7f2c700a9260 legacy=0x7f2c700b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6dd9b700 1 -- 172.21.15.19:0/2358265523 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700afc20 con 0x7f2c7006e830 2024-08-17T02:26:40.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6dd9b700 1 --2- 172.21.15.19:0/2358265523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c7006e830 0x7f2c700a8d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009f20 tx=0x7f2c68009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97283cb248b349b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6d59a700 1 -- 172.21.15.19:0/2358265523 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800e070 con 0x7f2c7006e830 2024-08-17T02:26:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6d59a700 1 -- 172.21.15.19:0/2358265523 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6800b9d0 con 0x7f2c7006e830 2024-08-17T02:26:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.495+0000 7f2c6d59a700 1 -- 172.21.15.19:0/2358265523 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680092e0 con 0x7f2c7006e830 2024-08-17T02:26:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 -- 172.21.15.19:0/2358265523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c7006e830 msgr2=0x7f2c700a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 --2- 172.21.15.19:0/2358265523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c7006e830 0x7f2c700a8d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009f20 tx=0x7f2c68009840 comp rx=0 tx=0).stop 2024-08-17T02:26:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 -- 172.21.15.19:0/2358265523 shutdown_connections 2024-08-17T02:26:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 --2- 172.21.15.19:0/2358265523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c7006e830 0x7f2c700a8d20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 --2- 172.21.15.19:0/2358265523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 0x7f2c700af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 -- 172.21.15.19:0/2358265523 >> 172.21.15.19:0/2358265523 conn(0x7f2c70066e00 msgr2=0x7f2c70067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 -- 172.21.15.19:0/2358265523 shutdown_connections 2024-08-17T02:26:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 -- 172.21.15.19:0/2358265523 wait complete. 2024-08-17T02:26:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 Processor -- start 2024-08-17T02:26:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.499+0000 7f2c74ebb700 1 -- start start 2024-08-17T02:26:40.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c74ebb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c7006e830 0x7f2c70158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c74ebb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c700a9260 0x7f2c70158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c74ebb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 0x7f2c70098d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c74ebb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700973b0 con 0x7f2c7006e830 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c74ebb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c70159310 con 0x7f2c700a9260 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c74ebb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700975a0 con 0x7f2c7015d540 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c7006e830 0x7f2c70158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c7006e830 0x7f2c70158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50194/0 (socket says 172.21.15.19:50194) 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6dd9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c700a9260 0x7f2c70158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6e59c700 1 -- 172.21.15.19:0/4281596442 learned_addr learned my addr 172.21.15.19:0/4281596442 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6ed9d700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 0x7f2c70098d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6e59c700 1 -- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 msgr2=0x7f2c70098d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6e59c700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 0x7f2c70098d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6e59c700 1 -- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c700a9260 msgr2=0x7f2c70158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6e59c700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c700a9260 0x7f2c70158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6e59c700 1 -- 172.21.15.19:0/4281596442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68009ae0 con 0x7f2c7006e830 2024-08-17T02:26:40.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6dd9b700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c700a9260 0x7f2c70158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c6e59c700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c7006e830 0x7f2c70158a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800e930 tx=0x7f2c580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c667fc700 1 -- 172.21.15.19:0/4281596442 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58013680 con 0x7f2c7006e830 2024-08-17T02:26:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c667fc700 1 -- 172.21.15.19:0/4281596442 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c580137e0 con 0x7f2c7006e830 2024-08-17T02:26:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c70158840 con 0x7f2c7006e830 2024-08-17T02:26:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c667fc700 1 -- 172.21.15.19:0/4281596442 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58013b80 con 0x7f2c7006e830 2024-08-17T02:26:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.503+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c70097b20 con 0x7f2c7006e830 2024-08-17T02:26:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.507+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c700645c0 con 0x7f2c7006e830 2024-08-17T02:26:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.507+0000 7f2c667fc700 1 -- 172.21.15.19:0/4281596442 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2c5800c3e0 con 0x7f2c7006e830 2024-08-17T02:26:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.507+0000 7f2c667fc700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2c50060860 0x7f2c50062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.507+0000 7f2c667fc700 1 -- 172.21.15.19:0/4281596442 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c5807cd00 con 0x7f2c7006e830 2024-08-17T02:26:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.507+0000 7f2c6dd9b700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2c50060860 0x7f2c50062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.507+0000 7f2c6dd9b700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2c50060860 0x7f2c50062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009880 tx=0x7f2c68018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.511+0000 7f2c667fc700 1 -- 172.21.15.19:0/4281596442 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2c5804d0b0 con 0x7f2c7006e830 2024-08-17T02:26:40.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.675+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c7006f360 con 0x7f2c7006e830 2024-08-17T02:26:40.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c667fc700 1 -- 172.21.15.19:0/4281596442 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f2c580506d0 con 0x7f2c7006e830 2024-08-17T02:26:40.684 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:40.684 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2c50060860 msgr2=0x7f2c50062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2c50060860 0x7f2c50062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009880 tx=0x7f2c68018000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c7006e830 msgr2=0x7f2c70158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c7006e830 0x7f2c70158a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800e930 tx=0x7f2c580091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 shutdown_connections 2024-08-17T02:26:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2c50060860 0x7f2c50062d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c7015d540 0x7f2c70098d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c700a9260 0x7f2c70158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 --2- 172.21.15.19:0/4281596442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c7006e830 0x7f2c70158a60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 >> 172.21.15.19:0/4281596442 conn(0x7f2c70066e00 msgr2=0x7f2c7006a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 shutdown_connections 2024-08-17T02:26:40.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.679+0000 7f2c74ebb700 1 -- 172.21.15.19:0/4281596442 wait complete. 2024-08-17T02:26:40.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:40.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.795+0000 7f22d0e8e700 1 Processor -- start 2024-08-17T02:26:40.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.795+0000 7f22d0e8e700 1 -- start start 2024-08-17T02:26:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.795+0000 7f22d0e8e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22cc159040 0x7f22cc0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.795+0000 7f22d0e8e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22cc0d0010 0x7f22cc0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.795+0000 7f22d0e8e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc0cf190 con 0x7f22cc15cea0 2024-08-17T02:26:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.795+0000 7f22d0e8e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc15d9f0 con 0x7f22cc0d0010 2024-08-17T02:26:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.795+0000 7f22d0e8e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0d09a0 con 0x7f22cc159040 2024-08-17T02:26:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22caffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22cc0d0010 0x7f22cc0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22caffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22cc0d0010 0x7f22cc0d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50202/0 (socket says 172.21.15.19:50202) 2024-08-17T02:26:40.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22caffd700 1 -- 172.21.15.19:0/4150882531 learned_addr learned my addr 172.21.15.19:0/4150882531 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22cb7fe700 1 --2- 172.21.15.19:0/4150882531 >> v2:172.21.15.119:3300/0 conn(0x7f22cc159040 0x7f22cc0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22caffd700 1 -- 172.21.15.19:0/4150882531 >> v2:172.21.15.119:3300/0 conn(0x7f22cc159040 msgr2=0x7f22cc0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22caffd700 1 --2- 172.21.15.19:0/4150882531 >> v2:172.21.15.119:3300/0 conn(0x7f22cc159040 0x7f22cc0cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22caffd700 1 -- 172.21.15.19:0/4150882531 >> v1:172.21.15.119:6789/0 conn(0x7f22cc15cea0 legacy=0x7f22cc15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22caffd700 1 -- 172.21.15.19:0/4150882531 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0ce5e0 con 0x7f22cc0d0010 2024-08-17T02:26:40.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22caffd700 1 --2- 172.21.15.19:0/4150882531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 0x7f22cc0d0460 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f22cc070d70 tx=0x7f22b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8836c9276b7151 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22ca7fc700 1 -- 172.21.15.19:0/4150882531 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4009e70 con 0x7f22cc0d0010 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22ca7fc700 1 -- 172.21.15.19:0/4150882531 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400b860 con 0x7f22cc0d0010 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22ca7fc700 1 -- 172.21.15.19:0/4150882531 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400bc00 con 0x7f22cc0d0010 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4150882531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 msgr2=0x7f22cc0d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22d0e8e700 1 --2- 172.21.15.19:0/4150882531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 0x7f22cc0d0460 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f22cc070d70 tx=0x7f22b4009250 comp rx=0 tx=0).stop 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4150882531 shutdown_connections 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22d0e8e700 1 --2- 172.21.15.19:0/4150882531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 0x7f22cc0d0460 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22d0e8e700 1 --2- 172.21.15.19:0/4150882531 >> v2:172.21.15.119:3300/0 conn(0x7f22cc159040 0x7f22cc0cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4150882531 >> 172.21.15.19:0/4150882531 conn(0x7f22cc068250 msgr2=0x7f22cc068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4150882531 shutdown_connections 2024-08-17T02:26:40.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4150882531 wait complete. 2024-08-17T02:26:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.799+0000 7f22d0e8e700 1 Processor -- start 2024-08-17T02:26:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22d0e8e700 1 -- start start 2024-08-17T02:26:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22d0e8e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 0x7f22cc16a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22d0e8e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc159040 0x7f22cc152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22d0e8e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22cc15cea0 0x7f22cc15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22d0e8e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0a69b0 con 0x7f22cc0d0010 2024-08-17T02:26:40.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22d0e8e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0a6c00 con 0x7f22cc159040 2024-08-17T02:26:40.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22d0e8e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0a6ee0 con 0x7f22cc15cea0 2024-08-17T02:26:40.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 0x7f22cc16a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 0x7f22cc16a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50208/0 (socket says 172.21.15.19:50208) 2024-08-17T02:26:40.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cb7fe700 1 -- 172.21.15.19:0/4215884132 learned_addr learned my addr 172.21.15.19:0/4215884132 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:40.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cbfff700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22cc15cea0 0x7f22cc15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22caffd700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc159040 0x7f22cc152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cb7fe700 1 -- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22cc15cea0 msgr2=0x7f22cc15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cb7fe700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22cc15cea0 0x7f22cc15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cb7fe700 1 -- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc159040 msgr2=0x7f22cc152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cb7fe700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc159040 0x7f22cc152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cb7fe700 1 -- 172.21.15.19:0/4215884132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40094f0 con 0x7f22cc0d0010 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22caffd700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc159040 0x7f22cc152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cbfff700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22cc15cea0 0x7f22cc15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22cb7fe700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 0x7f22cc16a6f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009e70 tx=0x7f22bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22c37fe700 1 -- 172.21.15.19:0/4215884132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00caa0 con 0x7f22cc0d0010 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22c37fe700 1 -- 172.21.15.19:0/4215884132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc00f040 con 0x7f22cc0d0010 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc0a71c0 con 0x7f22cc0d0010 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22c37fe700 1 -- 172.21.15.19:0/4215884132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00ce70 con 0x7f22cc0d0010 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.803+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc152740 con 0x7f22cc0d0010 2024-08-17T02:26:40.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.807+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc0a76a0 con 0x7f22cc0d0010 2024-08-17T02:26:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.807+0000 7f22c37fe700 1 -- 172.21.15.19:0/4215884132 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f22bc014690 con 0x7f22cc0d0010 2024-08-17T02:26:40.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.807+0000 7f22c37fe700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22ac060860 0x7f22ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.807+0000 7f22c37fe700 1 -- 172.21.15.19:0/4215884132 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22bc07d520 con 0x7f22cc0d0010 2024-08-17T02:26:40.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.807+0000 7f22caffd700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22ac060860 0x7f22ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.807+0000 7f22caffd700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22ac060860 0x7f22ac062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22cc070d70 tx=0x7f22b4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:40.815+0000 7f22c37fe700 1 -- 172.21.15.19:0/4215884132 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f22bc051410 con 0x7f22cc0d0010 2024-08-17T02:26:41.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.015+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22cc0643a0 con 0x7f22cc0d0010 2024-08-17T02:26:41.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22c37fe700 1 -- 172.21.15.19:0/4215884132 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f22bc050fa0 con 0x7f22cc0d0010 2024-08-17T02:26:41.022 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:41.023 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/903872793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":903872793},{"type":"v1","addr":"172.21.15.19:6833","nonce":903872793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3217936958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3217936958},{"type":"v1","addr":"172.21.15.19:6835","nonce":3217936958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/183789327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":183789327},{"type":"v1","addr":"172.21.15.119:6837","nonce":183789327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:28.987569+0000","modified":"2024-08-17T02:26:31.636583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22ac060860 msgr2=0x7f22ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22ac060860 0x7f22ac062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22cc070d70 tx=0x7f22b4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 msgr2=0x7f22cc16a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 0x7f22cc16a6f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009e70 tx=0x7f22bc00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 shutdown_connections 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22ac060860 0x7f22ac062d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22cc15cea0 0x7f22cc15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22cc159040 0x7f22cc152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 --2- 172.21.15.19:0/4215884132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc0d0010 0x7f22cc16a6f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 >> 172.21.15.19:0/4215884132 conn(0x7f22cc068250 msgr2=0x7f22cc0b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 shutdown_connections 2024-08-17T02:26:41.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.019+0000 7f22d0e8e700 1 -- 172.21.15.19:0/4215884132 wait complete. 2024-08-17T02:26:41.026 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-08-17T02:26:41.440 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:26:28.987569+0000', 'modified': '2024-08-17T02:26:31.636583+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34157}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34157': {'gid': 34157, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6835/480680634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 480680634}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 480680634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:26:41.441 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:26:41.441 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:26:41.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d6e3c5700 1 Processor -- start 2024-08-17T02:26:41.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d6e3c5700 1 -- start start 2024-08-17T02:26:41.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d6e3c5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d680b0e60 0x7f1d680b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d6e3c5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d680b0130 con 0x7f1d68069f90 2024-08-17T02:26:41.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d6e3c5700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d680b17f0 con 0x7f1d68068670 2024-08-17T02:26:41.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d6e3c5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d680af520 con 0x7f1d680b0e60 2024-08-17T02:26:41.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d67fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1d68069f90 0x7f1d680aead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53848/0 (socket says 172.21.15.19:53848) 2024-08-17T02:26:41.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d67fff700 1 -- 172.21.15.19:0/1405712155 learned_addr learned my addr 172.21.15.19:0/1405712155 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:41.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d677fe700 1 --2- 172.21.15.19:0/1405712155 >> v2:172.21.15.19:3300/0 conn(0x7f1d680b0e60 0x7f1d680b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d66ffd700 1 -- 172.21.15.19:0/1405712155 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534183726 0 0) 0x7f1d680b0130 con 0x7f1d68069f90 2024-08-17T02:26:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d66ffd700 1 -- 172.21.15.19:0/1405712155 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d54003570 con 0x7f1d68069f90 2024-08-17T02:26:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d677fe700 1 -- 172.21.15.19:0/1405712155 >> v1:172.21.15.119:6789/0 conn(0x7f1d68068670 legacy=0x7f1d68068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d677fe700 1 -- 172.21.15.19:0/1405712155 >> v1:172.21.15.19:6789/0 conn(0x7f1d68069f90 legacy=0x7f1d680aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d677fe700 1 -- 172.21.15.19:0/1405712155 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d680af800 con 0x7f1d680b0e60 2024-08-17T02:26:41.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d677fe700 1 --2- 172.21.15.19:0/1405712155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d680b0e60 0x7f1d680b12b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d500098e0 tx=0x7f1d500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0100e647c0f4ed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d66ffd700 1 -- 172.21.15.19:0/1405712155 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5000b640 con 0x7f1d680b0e60 2024-08-17T02:26:41.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d66ffd700 1 -- 172.21.15.19:0/1405712155 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5000b7a0 con 0x7f1d680b0e60 2024-08-17T02:26:41.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.559+0000 7f1d66ffd700 1 -- 172.21.15.19:0/1405712155 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5000bb40 con 0x7f1d680b0e60 2024-08-17T02:26:41.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.563+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/1405712155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d680b0e60 msgr2=0x7f1d680b12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.563+0000 7f1d6e3c5700 1 --2- 172.21.15.19:0/1405712155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d680b0e60 0x7f1d680b12b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d500098e0 tx=0x7f1d500091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.563+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/1405712155 shutdown_connections 2024-08-17T02:26:41.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.563+0000 7f1d6e3c5700 1 --2- 172.21.15.19:0/1405712155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d680b0e60 0x7f1d680b12b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.563+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/1405712155 >> 172.21.15.19:0/1405712155 conn(0x7f1d680ce060 msgr2=0x7f1d680ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.563+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/1405712155 shutdown_connections 2024-08-17T02:26:41.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.563+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/1405712155 wait complete. 2024-08-17T02:26:41.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.563+0000 7f1d6e3c5700 1 Processor -- start 2024-08-17T02:26:41.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.563+0000 7f1d6e3c5700 1 -- start start 2024-08-17T02:26:41.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d6e3c5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d68068670 0x7f1d68146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d6e3c5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d68069f90 0x7f1d68153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d6e3c5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d680b0e60 0x7f1d681518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d6e3c5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68147260 con 0x7f1d68068670 2024-08-17T02:26:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d6e3c5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68155850 con 0x7f1d68069f90 2024-08-17T02:26:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d6e3c5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d681553c0 con 0x7f1d680b0e60 2024-08-17T02:26:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d67fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d68068670 0x7f1d68146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d67fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d68068670 0x7f1d68146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50228/0 (socket says 172.21.15.19:50228) 2024-08-17T02:26:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d67fff700 1 -- 172.21.15.19:0/555376973 learned_addr learned my addr 172.21.15.19:0/555376973 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d677fe700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d68069f90 0x7f1d68153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d6c962700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d680b0e60 0x7f1d681518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d67fff700 1 -- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d680b0e60 msgr2=0x7f1d681518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d67fff700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d680b0e60 0x7f1d681518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d67fff700 1 -- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d68069f90 msgr2=0x7f1d68153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d67fff700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d68069f90 0x7f1d68153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d67fff700 1 -- 172.21.15.19:0/555376973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d50009420 con 0x7f1d68068670 2024-08-17T02:26:41.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d67fff700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d68068670 0x7f1d68146d20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800c7c0 tx=0x7f1d58007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d5ffff700 1 -- 172.21.15.19:0/555376973 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58005cd0 con 0x7f1d68068670 2024-08-17T02:26:41.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d5ffff700 1 -- 172.21.15.19:0/555376973 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d58005e30 con 0x7f1d68068670 2024-08-17T02:26:41.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/555376973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d681547f0 con 0x7f1d68068670 2024-08-17T02:26:41.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d5ffff700 1 -- 172.21.15.19:0/555376973 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58007320 con 0x7f1d68068670 2024-08-17T02:26:41.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.567+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/555376973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d68154d70 con 0x7f1d68068670 2024-08-17T02:26:41.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.571+0000 7f1d5ffff700 1 -- 172.21.15.19:0/555376973 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1d5801b3b0 con 0x7f1d68068670 2024-08-17T02:26:41.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.571+0000 7f1d5ffff700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d48060860 0x7f1d48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.571+0000 7f1d5ffff700 1 -- 172.21.15.19:0/555376973 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d5807c250 con 0x7f1d68068670 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.571+0000 7f1d677fe700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d48060860 0x7f1d48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.571+0000 7f1d677fe700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d48060860 0x7f1d48062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d500093f0 tx=0x7f1d50017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.571+0000 7f1d70674740 1 Processor -- start 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.571+0000 7f1d70674740 1 -- start start 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x15c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x1540ba0 con 0x13df790 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x153cb40 con 0x1394ae0 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x15020a0 con 0x1394710 2024-08-17T02:26:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d6c962700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d6c962700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50236/0 (socket says 172.21.15.19:50236) 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d6c962700 1 -- 172.21.15.19:0/3160527119 learned_addr learned my addr 172.21.15.19:0/3160527119 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d677fe700 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d67fff700 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x15c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d6c962700 1 -- 172.21.15.19:0/3160527119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 msgr2=0x15c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d6c962700 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d6c962700 1 -- 172.21.15.19:0/3160527119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 msgr2=0x15c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d6c962700 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x15c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d6c962700 1 -- 172.21.15.19:0/3160527119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x13e09e0 con 0x13df790 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d67fff700 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x15c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d6c962700 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1d60002ae0 tx=0x7f1d600015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972a0594b30342ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d5d7fa700 1 -- 172.21.15.19:0/3160527119 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000e860 con 0x13df790 2024-08-17T02:26:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d5d7fa700 1 -- 172.21.15.19:0/3160527119 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000e9c0 con 0x13df790 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d5d7fa700 1 -- 172.21.15.19:0/3160527119 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000ed40 con 0x13df790 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 -- 172.21.15.19:0/3160527119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 msgr2=0x15cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1d60002ae0 tx=0x7f1d600015f0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 -- 172.21.15.19:0/3160527119 shutdown_connections 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 --2- 172.21.15.19:0/3160527119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x15c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 -- 172.21.15.19:0/3160527119 >> 172.21.15.19:0/3160527119 conn(0x1394eb0 msgr2=0x15ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 -- 172.21.15.19:0/3160527119 shutdown_connections 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.575+0000 7f1d70674740 1 -- 172.21.15.19:0/3160527119 wait complete. 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 -- start start 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 Processor -- start 2024-08-17T02:26:41.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x1615aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1394ae0 0x1615fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x13df790 0x15cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x1501d40 con 0x1394ae0 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x14da970 con 0x13df790 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x14b5cb0 con 0x1394710 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 10 client.0 _ll_register_callbacks cb 0x14def00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d677fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1394ae0 0x1615fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d677fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1394ae0 0x1615fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50238/0 (socket says 172.21.15.19:50238) 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d677fe700 1 -- 172.21.15.19:0/2224178529 learned_addr learned my addr 172.21.15.19:0/2224178529 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d67fff700 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x1615aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d6c962700 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x13df790 0x15cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d677fe700 1 -- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 msgr2=0x1615aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d677fe700 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x1615aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d677fe700 1 -- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x13df790 msgr2=0x15cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d677fe700 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x13df790 0x15cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d677fe700 1 -- 172.21.15.19:0/2224178529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6000f040 con 0x1394ae0 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d677fe700 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1394ae0 0x1615fe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1d5001a5e0 tx=0x7f1d50021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa02653d7e8d4d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d467fc700 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d467fc700 1 -- 172.21.15.19:0/2224178529 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50030070 con 0x1394ae0 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 -- 172.21.15.19:0/2224178529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x13a2260 con 0x1394ae0 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d467fc700 1 -- 172.21.15.19:0/2224178529 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d50027430 con 0x1394ae0 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d467fc700 1 -- 172.21.15.19:0/2224178529 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d50021070 con 0x1394ae0 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 10 client.4674 fetch_fsmap learned FSMap version 6 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 -- 172.21.15.19:0/2224178529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x150a370 con 0x1394ae0 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d467fc700 1 -- 172.21.15.19:0/2224178529 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x13a2260 con 0x1394ae0 2024-08-17T02:26:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d467fc700 1 -- 172.21.15.19:0/2224178529 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1d50027800 con 0x1394ae0 2024-08-17T02:26:41.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 10 client.4674 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:26:41.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 10 client.4674 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:26:41.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 20 client.4674 populate_metadata read hostname 'smithi019' 2024-08-17T02:26:41.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] conn(0x161ec30 0x1621010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 4 client.4674 mds_command: new command op to 34157 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:26:41.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.579+0000 7f1d70674740 1 -- 172.21.15.19:0/2224178529 --> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x13ec4e0 con 0x161ec30 2024-08-17T02:26:41.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d67fff700 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] conn(0x161ec30 0x1621010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d67fff700 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] conn(0x161ec30 0x1621010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39a6670550d25686 server_cookie=df1ac5dc31007c94 in_seq=0 out_seq=0 2024-08-17T02:26:41.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d467fc700 10 client.4674 ms_handle_connect on v2:172.21.15.119:6834/480680634 2024-08-17T02:26:41.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d467fc700 1 -- 172.21.15.19:0/2224178529 <== mds.0 v2:172.21.15.119:6834/480680634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x13ec4e0 con 0x161ec30 2024-08-17T02:26:41.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d467fc700 10 client.4674 handle_command_reply: tid=0 2024-08-17T02:26:41.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 client.4674 shutdown 2024-08-17T02:26:41.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 -- 172.21.15.19:0/2224178529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1394ae0 msgr2=0x1615fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1394ae0 0x1615fe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1d5001a5e0 tx=0x7f1d50021000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 -- 172.21.15.19:0/2224178529 shutdown_connections 2024-08-17T02:26:41.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] conn(0x161ec30 0x1621010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x13df790 0x15cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d467fc700 0 client.4674 ms_handle_reset on v2:172.21.15.119:6834/480680634 2024-08-17T02:26:41.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1394ae0 0x1615fe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 --2- 172.21.15.19:0/2224178529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x1615aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 -- 172.21.15.19:0/2224178529 >> 172.21.15.19:0/2224178529 conn(0x1394eb0 msgr2=0x15cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 -- 172.21.15.19:0/2224178529 shutdown_connections 2024-08-17T02:26:41.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 1 -- 172.21.15.19:0/2224178529 wait complete. 2024-08-17T02:26:41.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.583+0000 7f1d70674740 20 client.4674 trim_cache size 0 max 16384 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d70674740 1 Processor -- start 2024-08-17T02:26:41.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d70674740 1 -- start start 2024-08-17T02:26:41.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d70674740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d70674740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x15c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d70674740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d70674740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x153f200 con 0x13df790 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d70674740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1540640 con 0x1394ae0 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d70674740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1542da0 con 0x1394710 2024-08-17T02:26:41.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d6c962700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d6c962700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50246/0 (socket says 172.21.15.19:50246) 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d6c962700 1 -- 172.21.15.19:0/1005595378 learned_addr learned my addr 172.21.15.19:0/1005595378 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d67fff700 1 --2- 172.21.15.19:0/1005595378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.607+0000 7f1d677fe700 1 --2- 172.21.15.19:0/1005595378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x15c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d6c962700 1 -- 172.21.15.19:0/1005595378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 msgr2=0x15c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d6c962700 1 --2- 172.21.15.19:0/1005595378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d6c962700 1 -- 172.21.15.19:0/1005595378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 msgr2=0x15c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d6c962700 1 --2- 172.21.15.19:0/1005595378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x15c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d6c962700 1 -- 172.21.15.19:0/1005595378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14f0d80 con 0x13df790 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d6c962700 1 --2- 172.21.15.19:0/1005595378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d60015000 tx=0x7f1d60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787763c06a901af5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d5dffb700 1 -- 172.21.15.19:0/1005595378 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60000f40 con 0x13df790 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d5dffb700 1 -- 172.21.15.19:0/1005595378 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d60006ba0 con 0x13df790 2024-08-17T02:26:41.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d5dffb700 1 -- 172.21.15.19:0/1005595378 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000eb30 con 0x13df790 2024-08-17T02:26:41.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 -- 172.21.15.19:0/1005595378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 msgr2=0x15cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 --2- 172.21.15.19:0/1005595378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d60015000 tx=0x7f1d60019000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 -- 172.21.15.19:0/1005595378 shutdown_connections 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 --2- 172.21.15.19:0/1005595378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x15cbc60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 --2- 172.21.15.19:0/1005595378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x15c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 --2- 172.21.15.19:0/1005595378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 -- 172.21.15.19:0/1005595378 >> 172.21.15.19:0/1005595378 conn(0x1394eb0 msgr2=0x1614e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 -- 172.21.15.19:0/1005595378 shutdown_connections 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 -- 172.21.15.19:0/1005595378 wait complete. 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 -- start start 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.611+0000 7f1d70674740 1 Processor -- start 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x166d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x166d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x1508d40 con 0x13df790 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x14eb140 con 0x1394ae0 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x150c820 con 0x1394710 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 10 client.0 _ll_register_callbacks cb 0x13609d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d6c962700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x166d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d67fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d677fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x166d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d6c962700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x166d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50258/0 (socket says 172.21.15.19:50258) 2024-08-17T02:26:41.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d6c962700 1 -- 172.21.15.19:0/1650678436 learned_addr learned my addr 172.21.15.19:0/1650678436 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d6c962700 1 -- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 msgr2=0x15c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d6c962700 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d6c962700 1 -- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 msgr2=0x166d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d6c962700 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x166d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d6c962700 1 -- 172.21.15.19:0/1650678436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x13e09e0 con 0x13df790 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d677fe700 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x166d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d6c962700 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x166d870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1d60021040 tx=0x7f1d60022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2c8fa49c6615ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d467fc700 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d467fc700 1 -- 172.21.15.19:0/1650678436 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000e860 con 0x13df790 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d467fc700 1 -- 172.21.15.19:0/1650678436 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d60014690 con 0x13df790 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 1 -- 172.21.15.19:0/1650678436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d6000e9c0 con 0x13df790 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d467fc700 1 -- 172.21.15.19:0/1650678436 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d60014a60 con 0x13df790 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 10 client.4680 fetch_fsmap learned FSMap version 6 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d70674740 1 -- 172.21.15.19:0/1650678436 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x14e5130 con 0x13df790 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d467fc700 1 -- 172.21.15.19:0/1650678436 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000e9c0 con 0x13df790 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.615+0000 7f1d467fc700 1 -- 172.21.15.19:0/1650678436 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1d60014bc0 con 0x13df790 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 10 client.4680 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:26:41.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 10 client.4680 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:26:41.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 20 client.4680 populate_metadata read hostname 'smithi019' 2024-08-17T02:26:41.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] conn(0x166ddb0 0x1621fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 4 client.4680 mds_command: new command op to 34157 tid=0[{"prefix": "status"}] 2024-08-17T02:26:41.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 -- 172.21.15.19:0/1650678436 --> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1411260 con 0x166ddb0 2024-08-17T02:26:41.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d67fff700 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] conn(0x166ddb0 0x1621fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d467fc700 10 client.4680 ms_handle_connect on v2:172.21.15.119:6834/480680634 2024-08-17T02:26:41.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d67fff700 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] conn(0x166ddb0 0x1621fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cbfc9cc53b614f server_cookie=2c13103cfed29924 in_seq=0 out_seq=0 2024-08-17T02:26:41.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d467fc700 1 -- 172.21.15.19:0/1650678436 <== mds.0 v2:172.21.15.119:6834/480680634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x1411260 con 0x166ddb0 2024-08-17T02:26:41.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d467fc700 10 client.4680 handle_command_reply: tid=0 2024-08-17T02:26:41.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 client.4680 shutdown 2024-08-17T02:26:41.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 -- 172.21.15.19:0/1650678436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 msgr2=0x166d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x166d870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1d60021040 tx=0x7f1d60022040 comp rx=0 tx=0).stop 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 -- 172.21.15.19:0/1650678436 shutdown_connections 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:6834/480680634,v1:172.21.15.119:6835/480680634] conn(0x166ddb0 0x1621fe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x13df790 0x166d870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1394ae0 0x166d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 --2- 172.21.15.19:0/1650678436 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1394710 0x15c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d467fc700 0 client.4680 ms_handle_reset on v2:172.21.15.119:6834/480680634 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 -- 172.21.15.19:0/1650678436 >> 172.21.15.19:0/1650678436 conn(0x1394eb0 msgr2=0x15c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 -- 172.21.15.19:0/1650678436 shutdown_connections 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 1 -- 172.21.15.19:0/1650678436 wait complete. 2024-08-17T02:26:41.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d70674740 20 client.4680 trim_cache size 0 max 16384 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "1a630ac0-5cc8-463b-a63c-db2f048e27a8", 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 34157, 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 11.99135304, 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 6, 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 22, 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 22, 2024-08-17T02:26:41.629 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 18.560724494999999 2024-08-17T02:26:41.630 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:26:41.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d48060860 msgr2=0x7f1d48062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d48060860 0x7f1d48062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d500093f0 tx=0x7f1d50017000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/555376973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d68068670 msgr2=0x7f1d68146d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d68068670 0x7f1d68146d20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800c7c0 tx=0x7f1d58007e00 comp rx=0 tx=0).stop 2024-08-17T02:26:41.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/555376973 shutdown_connections 2024-08-17T02:26:41.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d48060860 0x7f1d48062d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d680b0e60 0x7f1d681518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d68069f90 0x7f1d68153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 --2- 172.21.15.19:0/555376973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d68068670 0x7f1d68146d20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/555376973 >> 172.21.15.19:0/555376973 conn(0x7f1d680ce060 msgr2=0x7f1d680ad920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/555376973 shutdown_connections 2024-08-17T02:26:41.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.619+0000 7f1d6e3c5700 1 -- 172.21.15.19:0/555376973 wait complete. 2024-08-17T02:26:41.641 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-17T02:26:41.666 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-17T02:26:41.666 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:26:41.666 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-17T02:26:41.666 INFO:tasks.ceph_fuse:client.2 config is {} 2024-08-17T02:26:41.666 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-17T02:26:41.666 INFO:tasks.ceph_fuse:client.3 config is {} 2024-08-17T02:26:41.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:41.667 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-08-17T02:26:41.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:41.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-08-17T02:26:41.694 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:41.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:41.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:41.696 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-08-17T02:26:41.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:41.704 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-08-17T02:26:41.719 INFO:teuthology.orchestra.run.smithi119.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:41.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:41.720 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-17T02:26:41.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:41.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc3fff700 1 Processor -- start 2024-08-17T02:26:41.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc3fff700 1 -- start start 2024-08-17T02:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc3fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6dc4159040 0x7f6dc40cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc3fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc40d0010 0x7f6dc40d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc3fff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc40cf190 con 0x7f6dc415cea0 2024-08-17T02:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc3fff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc40d09a0 con 0x7f6dc4159040 2024-08-17T02:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc3fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40ce5e0 con 0x7f6dc40d0010 2024-08-17T02:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc2ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6dc4159040 0x7f6dc40cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6dc415cea0 0x7f6dc415d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53854/0 (socket says 172.21.15.19:53854) 2024-08-17T02:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc2ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6dc4159040 0x7f6dc40cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50266/0 (socket says 172.21.15.19:50266) 2024-08-17T02:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc37fe700 1 -- 172.21.15.19:0/1124129298 learned_addr learned my addr 172.21.15.19:0/1124129298 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:41.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dbbfff700 1 --2- 172.21.15.19:0/1124129298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc40d0010 0x7f6dc40d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc2ffd700 1 -- 172.21.15.19:0/1124129298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc40d0010 msgr2=0x7f6dc40d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc2ffd700 1 --2- 172.21.15.19:0/1124129298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc40d0010 0x7f6dc40d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc2ffd700 1 -- 172.21.15.19:0/1124129298 >> v1:172.21.15.19:6789/0 conn(0x7f6dc415cea0 legacy=0x7f6dc415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc2ffd700 1 -- 172.21.15.19:0/1124129298 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc40ce860 con 0x7f6dc4159040 2024-08-17T02:26:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc2ffd700 1 --2- 172.21.15.19:0/1124129298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc4159040 0x7f6dc40cf620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6db40098e0 tx=0x7f6db40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dc53929c74c7ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc27fc700 1 -- 172.21.15.19:0/1124129298 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400b640 con 0x7f6dc4159040 2024-08-17T02:26:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc27fc700 1 -- 172.21.15.19:0/1124129298 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db400b7a0 con 0x7f6dc4159040 2024-08-17T02:26:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.831+0000 7f6dc27fc700 1 -- 172.21.15.19:0/1124129298 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400bb40 con 0x7f6dc4159040 2024-08-17T02:26:41.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1124129298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc4159040 msgr2=0x7f6dc40cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 --2- 172.21.15.19:0/1124129298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc4159040 0x7f6dc40cf620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6db40098e0 tx=0x7f6db40091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1124129298 shutdown_connections 2024-08-17T02:26:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 --2- 172.21.15.19:0/1124129298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc40d0010 0x7f6dc40d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 --2- 172.21.15.19:0/1124129298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc4159040 0x7f6dc40cf620 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1124129298 >> 172.21.15.19:0/1124129298 conn(0x7f6dc4068250 msgr2=0x7f6dc4068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1124129298 shutdown_connections 2024-08-17T02:26:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1124129298 wait complete. 2024-08-17T02:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 Processor -- start 2024-08-17T02:26:41.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 -- start start 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc40d0010 0x7f6dc416aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc4159040 0x7f6dc40b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc415cea0 0x7f6dc4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40a69b0 con 0x7f6dc40d0010 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.835+0000 7f6dc3fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40a6c90 con 0x7f6dc415cea0 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc3fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40a6f70 con 0x7f6dc4159040 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc40d0010 0x7f6dc416aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc40d0010 0x7f6dc416aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50268/0 (socket says 172.21.15.19:50268) 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc2ffd700 1 -- 172.21.15.19:0/1821309446 learned_addr learned my addr 172.21.15.19:0/1821309446 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dbbfff700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc4159040 0x7f6dc40b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc37fe700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc415cea0 0x7f6dc4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc2ffd700 1 -- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc4159040 msgr2=0x7f6dc40b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc2ffd700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc4159040 0x7f6dc40b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc2ffd700 1 -- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc415cea0 msgr2=0x7f6dc4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc2ffd700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc415cea0 0x7f6dc4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc2ffd700 1 -- 172.21.15.19:0/1821309446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db4009420 con 0x7f6dc40d0010 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc2ffd700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc40d0010 0x7f6dc416aaf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6db400a010 tx=0x7f6db4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dbaffd700 1 -- 172.21.15.19:0/1821309446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db401bc80 con 0x7f6dc40d0010 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dbaffd700 1 -- 172.21.15.19:0/1821309446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db401bde0 con 0x7f6dc40d0010 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc40a7250 con 0x7f6dc40d0010 2024-08-17T02:26:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dbaffd700 1 -- 172.21.15.19:0/1821309446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4011670 con 0x7f6dc40d0010 2024-08-17T02:26:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc40b1990 con 0x7f6dc40d0010 2024-08-17T02:26:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.839+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc40b1b80 con 0x7f6dc40d0010 2024-08-17T02:26:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.843+0000 7f6dbaffd700 1 -- 172.21.15.19:0/1821309446 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6db4011aa0 con 0x7f6dc40d0010 2024-08-17T02:26:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.843+0000 7f6dbaffd700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6da4060860 0x7f6da4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.843+0000 7f6dbaffd700 1 -- 172.21.15.19:0/1821309446 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6db407dfb0 con 0x7f6dc40d0010 2024-08-17T02:26:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.843+0000 7f6dbbfff700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6da4060860 0x7f6da4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.843+0000 7f6dbbfff700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6da4060860 0x7f6da4062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40af270 tx=0x7f6dac0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:41.847+0000 7f6dbaffd700 1 -- 172.21.15.19:0/1821309446 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6dc40b1b80 con 0x7f6dc40d0010 2024-08-17T02:26:42.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.047+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6dc40b1b80 con 0x7f6dc40d0010 2024-08-17T02:26:42.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dbaffd700 1 -- 172.21.15.19:0/1821309446 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6dc40b1b80 con 0x7f6dc40d0010 2024-08-17T02:26:42.054 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6da4060860 msgr2=0x7f6da4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6da4060860 0x7f6da4062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40af270 tx=0x7f6dac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc40d0010 msgr2=0x7f6dc416aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc40d0010 0x7f6dc416aaf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6db400a010 tx=0x7f6db4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 shutdown_connections 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6da4060860 0x7f6da4062d10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dc415cea0 0x7f6dc4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dc4159040 0x7f6dc40b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 --2- 172.21.15.19:0/1821309446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6dc40d0010 0x7f6dc416aaf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 >> 172.21.15.19:0/1821309446 conn(0x7f6dc4068250 msgr2=0x7f6dc4153500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 shutdown_connections 2024-08-17T02:26:42.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:42.051+0000 7f6dc3fff700 1 -- 172.21.15.19:0/1821309446 wait complete. 2024-08-17T02:26:42.068 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:42.068 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:42.068 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-08-17T02:26:42.069 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:26:42.069 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:42.069 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:42.069 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:42.069 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:42.069 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:42.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.070 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-08-17T02:26:42.075 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:42.075 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:42.075 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:42.075 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42594sec preferred_lft 42594sec 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:42.076 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:42.077 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:42.077 INFO:teuthology.orchestra.run.smithi019.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:42.077 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:42:23:00:30:78 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:42.077 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:42.077 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:42.077 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:42.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.078 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:26:42.078 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:26:42.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:42.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:42.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-08-17T02:26:42.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:42.078 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:26:42.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.126 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:42.137 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-08-17T02:26:42.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.138 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-08-17T02:26:42.203 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-08-17T02:26:42.203 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:42.203 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-17T02:26:42.203 INFO:teuthology.orchestra.run.smithi019.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:42.203 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-17T02:26:42.203 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:42.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.204 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:26:42.204 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:26:42.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:26:42.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:26:42.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:26:42.204 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:26:42.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.246 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-08-17T02:26:42.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.252 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-08-17T02:26:42.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.259 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:26:42.259 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:26:42.259 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:42.259 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:26:42.259 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:26:42.289 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:26:42.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.289 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:26:42.289 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:26:42.289 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:26:42.289 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:42.289 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:26:42.289 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:26:42.289 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:26:42.289 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:26:42.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:42.362 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:26:42.362 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:26:42.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-08-17T02:26:42.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:42.362 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:26:42.388 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:26:42.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:42.388 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:42.395 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:42.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:42.395 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:42.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-08-17T02:26:42.412 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:42.413 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:42.470 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:42.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:42.471 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-08-17T02:26:42.478 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:26:42.478 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:26:42.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-08-17T02:26:42.496 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:42.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:42.510 INFO:teuthology.orchestra.run.smithi019.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:42.511 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:42.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:42.512 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-08-17T02:26:42.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-08-17T02:26:42.555+0000 7fdeccd62380 -1 init, newargv = 0x558385147820 newargc=15 2024-08-17T02:26:42.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[31173]: starting ceph client 2024-08-17T02:26:42.571 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[31173]: starting fuse 2024-08-17T02:26:43.619 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-08-17T02:26:43.638 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:43.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:43.698 INFO:teuthology.orchestra.run.smithi019.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:43.698 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:43.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:43.699 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-08-17T02:26:43.704 INFO:teuthology.orchestra.run.smithi019.stdout:52 2024-08-17T02:26:43.704 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:26:43.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:43.704 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-08-17T02:26:43.704 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-08-17T02:26:43.704 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-08-17T02:26:43.704 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-08-17T02:26:43.704 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-08-17T02:26:43.705 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-08-17T02:26:43.706 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-08-17T02:26:43.789 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.31173.asok 2024-08-17T02:26:43.970 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31173.asok 2024-08-17T02:26:43.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:43.970 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31173.asok status 2024-08-17T02:26:44.066 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:26:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-08-17T02:26:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-08-17T02:26:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-08-17T02:26:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:26:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "31173", 2024-08-17T02:26:44.067 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 34430, 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 34430 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-08-17T02:26:44.068 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3177198151 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3177198151 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.34430 192.168.0.1:0/3177198151", 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/3177198151", 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 6, 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 22, 2024-08-17T02:26:44.069 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-08-17T02:26:44.070 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-08-17T02:26:44.070 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:26:44.076 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d69101700 1 Processor -- start 2024-08-17T02:26:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d69101700 1 -- start start 2024-08-17T02:26:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d69101700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d640aac50 0x7f1d6415aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d69101700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d6415a2e0 0x7f1d641574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d69101700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d640b3b30 0x7f1d640b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d69101700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6415bc90 con 0x7f1d640b3b30 2024-08-17T02:26:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d69101700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640b4490 con 0x7f1d640aac50 2024-08-17T02:26:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d69101700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415b010 con 0x7f1d6415a2e0 2024-08-17T02:26:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d6359e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d640b3b30 0x7f1d640b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d62d9d700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d640aac50 0x7f1d6415aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d6259c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d6415a2e0 0x7f1d641574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d62d9d700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d640aac50 0x7f1d6415aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:54494/0 (socket says 172.21.15.19:54494) 2024-08-17T02:26:44.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d62d9d700 1 -- 172.21.15.19:0/1621886669 learned_addr learned my addr 172.21.15.19:0/1621886669 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d6359e700 1 -- 172.21.15.19:0/1621886669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d6415a2e0 msgr2=0x7f1d641574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d6359e700 1 --2- 172.21.15.19:0/1621886669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d6415a2e0 0x7f1d641574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d6359e700 1 -- 172.21.15.19:0/1621886669 >> v2:172.21.15.119:3300/0 conn(0x7f1d640aac50 msgr2=0x7f1d6415aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d6359e700 1 --2- 172.21.15.19:0/1621886669 >> v2:172.21.15.119:3300/0 conn(0x7f1d640aac50 0x7f1d6415aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d6359e700 1 -- 172.21.15.19:0/1621886669 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6415b2f0 con 0x7f1d640b3b30 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d62d9d700 1 --2- 172.21.15.19:0/1621886669 >> v2:172.21.15.119:3300/0 conn(0x7f1d640aac50 0x7f1d6415aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.175+0000 7f1d6359e700 1 --2- 172.21.15.19:0/1621886669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d640b3b30 0x7f1d640b3f50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1d6409e010 tx=0x7f1d5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686f4ce424869946 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d61d9b700 1 -- 172.21.15.19:0/1621886669 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c011630 con 0x7f1d640b3b30 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d61d9b700 1 -- 172.21.15.19:0/1621886669 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c0117b0 con 0x7f1d640b3b30 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d61d9b700 1 -- 172.21.15.19:0/1621886669 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c011b70 con 0x7f1d640b3b30 2024-08-17T02:26:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 -- 172.21.15.19:0/1621886669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d640b3b30 msgr2=0x7f1d640b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 --2- 172.21.15.19:0/1621886669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d640b3b30 0x7f1d640b3f50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1d6409e010 tx=0x7f1d5c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 -- 172.21.15.19:0/1621886669 shutdown_connections 2024-08-17T02:26:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 --2- 172.21.15.19:0/1621886669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d640b3b30 0x7f1d640b3f50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 --2- 172.21.15.19:0/1621886669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d6415a2e0 0x7f1d641574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 --2- 172.21.15.19:0/1621886669 >> v2:172.21.15.119:3300/0 conn(0x7f1d640aac50 0x7f1d6415aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 -- 172.21.15.19:0/1621886669 >> 172.21.15.19:0/1621886669 conn(0x7f1d640994d0 msgr2=0x7f1d640675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 -- 172.21.15.19:0/1621886669 shutdown_connections 2024-08-17T02:26:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 -- 172.21.15.19:0/1621886669 wait complete. 2024-08-17T02:26:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 Processor -- start 2024-08-17T02:26:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.179+0000 7f1d69101700 1 -- start start 2024-08-17T02:26:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d69101700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d640aac50 0x7f1d641565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d69101700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d640b3b30 0x7f1d64156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d69101700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d6415a2e0 0x7f1d64169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d69101700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640ac630 con 0x7f1d6415a2e0 2024-08-17T02:26:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d69101700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640ab350 con 0x7f1d640aac50 2024-08-17T02:26:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d69101700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6409a390 con 0x7f1d640b3b30 2024-08-17T02:26:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d6415a2e0 0x7f1d64169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d62d9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d640aac50 0x7f1d641565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d6415a2e0 0x7f1d64169280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50286/0 (socket says 172.21.15.19:50286) 2024-08-17T02:26:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6359e700 1 -- 172.21.15.19:0/1250616238 learned_addr learned my addr 172.21.15.19:0/1250616238 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6259c700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d640b3b30 0x7f1d64156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6359e700 1 -- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d640b3b30 msgr2=0x7f1d64156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6359e700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d640b3b30 0x7f1d64156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6359e700 1 -- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d640aac50 msgr2=0x7f1d641565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6359e700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d640aac50 0x7f1d641565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6359e700 1 -- 172.21.15.19:0/1250616238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54009ae0 con 0x7f1d6415a2e0 2024-08-17T02:26:44.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d62d9d700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d640aac50 0x7f1d641565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:44.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d6359e700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d6415a2e0 0x7f1d64169280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0093f0 tx=0x7f1d5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d4affd700 1 -- 172.21.15.19:0/1250616238 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c01f070 con 0x7f1d6415a2e0 2024-08-17T02:26:44.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d4affd700 1 -- 172.21.15.19:0/1250616238 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c011630 con 0x7f1d6415a2e0 2024-08-17T02:26:44.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c009420 con 0x7f1d6415a2e0 2024-08-17T02:26:44.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d4affd700 1 -- 172.21.15.19:0/1250616238 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c023680 con 0x7f1d6415a2e0 2024-08-17T02:26:44.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.183+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6409a950 con 0x7f1d6415a2e0 2024-08-17T02:26:44.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.187+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d640645c0 con 0x7f1d6415a2e0 2024-08-17T02:26:44.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.187+0000 7f1d4affd700 1 -- 172.21.15.19:0/1250616238 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1d5c02c440 con 0x7f1d6415a2e0 2024-08-17T02:26:44.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.187+0000 7f1d4affd700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d50060860 0x7f1d50062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.187+0000 7f1d4affd700 1 -- 172.21.15.19:0/1250616238 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d5c07deb0 con 0x7f1d6415a2e0 2024-08-17T02:26:44.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.187+0000 7f1d62d9d700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d50060860 0x7f1d50062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.187+0000 7f1d62d9d700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d50060860 0x7f1d50062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d640aa7f0 tx=0x7f1d5400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.195+0000 7f1d4affd700 1 -- 172.21.15.19:0/1250616238 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1d5c04e300 con 0x7f1d6415a2e0 2024-08-17T02:26:44.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.395+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d640b3890 con 0x7f1d6415a2e0 2024-08-17T02:26:44.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.395+0000 7f1d4affd700 1 -- 172.21.15.19:0/1250616238 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1d5c011b30 con 0x7f1d6415a2e0 2024-08-17T02:26:44.401 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:44.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d50060860 msgr2=0x7f1d50062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d50060860 0x7f1d50062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d640aa7f0 tx=0x7f1d5400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:44.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d6415a2e0 msgr2=0x7f1d64169280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d6415a2e0 0x7f1d64169280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0093f0 tx=0x7f1d5c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:44.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 shutdown_connections 2024-08-17T02:26:44.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1d50060860 0x7f1d50062d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d6415a2e0 0x7f1d64169280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d640b3b30 0x7f1d64156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 --2- 172.21.15.19:0/1250616238 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d640aac50 0x7f1d641565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 >> 172.21.15.19:0/1250616238 conn(0x7f1d640994d0 msgr2=0x7f1d641598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 shutdown_connections 2024-08-17T02:26:44.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:44.399+0000 7f1d69101700 1 -- 172.21.15.19:0/1250616238 wait complete. 2024-08-17T02:26:44.415 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:44.416 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:44.416 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-08-17T02:26:44.416 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:26:44.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:44.417 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:44.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:44.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:44.417 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:44.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.417 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-08-17T02:26:44.423 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:44.423 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:44.423 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:44.423 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.424 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:44.424 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.424 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:44.424 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:44.424 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:44.424 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:44.424 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:44.424 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:44.424 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42592sec preferred_lft 42592sec 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:42:23:00:30:78 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 9a:8d:51:c5:15:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:44.425 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.426 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::d445:7ff:fed2:b4ef/64 scope link 2024-08-17T02:26:44.426 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.426 INFO:teuthology.orchestra.run.smithi019.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:44.426 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 9a:8d:51:c5:15:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:44.426 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::988d:51ff:fec5:1503/64 scope link 2024-08-17T02:26:44.426 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.427 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:44.441 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-08-17T02:26:44.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.443 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-08-17T02:26:44.495 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-08-17T02:26:44.495 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:44.495 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-17T02:26:44.495 INFO:teuthology.orchestra.run.smithi019.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:44.495 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-17T02:26:44.495 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:44.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.495 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:26:44.496 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:26:44.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:26:44.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:26:44.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:26:44.496 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:26:44.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.539 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:26:44.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.546 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-08-17T02:26:44.552 INFO:teuthology.orchestra.run.smithi019.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:26:44.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.552 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:26:44.552 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:26:44.552 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:26:44.552 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:26:44.552 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:26:44.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.583 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:44.594 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:44.594 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:44.594 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:44.594 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.594 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:44.594 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.594 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:44.595 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether da:55:55:ca:ea:fc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:44.595 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:44.595 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.595 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::d855:55ff:feca:eafc/64 scope link 2024-08-17T02:26:44.595 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.596 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:44.654 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:44.654 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:44.655 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:44.655 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.655 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:44.655 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.655 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:44.655 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether da:55:55:ca:ea:fc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:44.655 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:44.655 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.656 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::d855:55ff:feca:eafc/64 scope link 2024-08-17T02:26:44.656 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:44.657 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:26:44.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.658 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:26:44.658 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:26:44.658 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:26:44.658 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:44.658 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:26:44.659 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:26:44.659 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:26:44.659 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:26:44.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:44.720 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:26:44.720 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:26:44.720 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.1 up 2024-08-17T02:26:44.720 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:44.721 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:26:44.749 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-08-17T02:26:44.749 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:44.749 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:44.797 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:44.797 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:44.797 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:44.804 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-08-17T02:26:44.822 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:44.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:44.839 INFO:teuthology.orchestra.run.smithi019.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:44.840 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:44.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:44.841 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-08-17T02:26:44.888 INFO:teuthology.orchestra.run.smithi019.stdout:52 2024-08-17T02:26:44.889 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:26:44.889 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-08-17T02:26:44.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-08-17T02:26:44.907 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:44.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:44.921 INFO:teuthology.orchestra.run.smithi019.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:44.922 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:44.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:44.923 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-08-17T02:26:44.973 INFO:teuthology.orchestra.run.smithi019.stdout:52 2024-08-17T02:26:44.977 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi019.stderr:2024-08-17T02:26:44.971+0000 7ff2e4a19380 -1 init, newargv = 0x5592cc14fc20 newargc=15 2024-08-17T02:26:44.977 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi019.stderr:ceph-fuse[31313]: starting ceph client 2024-08-17T02:26:44.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi019.stderr:ceph-fuse[31313]: starting fuse 2024-08-17T02:26:46.074 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-08-17T02:26:46.091 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:46.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:46.108 INFO:teuthology.orchestra.run.smithi019.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:46.109 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:46.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:46.109 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-08-17T02:26:46.161 INFO:teuthology.orchestra.run.smithi019.stdout:52 2024-08-17T02:26:46.161 INFO:teuthology.orchestra.run.smithi019.stdout:53 2024-08-17T02:26:46.161 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:26:46.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:46.161 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-08-17T02:26:46.161 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-08-17T02:26:46.161 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:46.162 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:46.163 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-08-17T02:26:46.163 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-08-17T02:26:46.163 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-08-17T02:26:46.163 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:46.163 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:26:46.163 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.2")) 2024-08-17T02:26:46.163 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-08-17T02:26:46.245 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.2.31313.asok 2024-08-17T02:26:46.429 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.31313.asok 2024-08-17T02:26:46.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:46.429 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.31313.asok status 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "2", 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "31313", 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:26:46.530 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4707, 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4707 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1842981328 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:26:46.531 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1842981328 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4707 192.168.0.2:0/1842981328", 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.2:0/1842981328", 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 6, 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 22, 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-08-17T02:26:46.532 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:26:46.539 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7759e700 1 Processor -- start 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7759e700 1 -- start start 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7759e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d780d0010 0x7f0d780d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7759e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d7815cea0 0x7f0d7815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7759e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d780cf190 con 0x7f0d78159040 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7759e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780d09a0 con 0x7f0d780d0010 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7759e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780ce5e0 con 0x7f0d7815cea0 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0d78159040 0x7f0d780cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53870/0 (socket says 172.21.15.19:53870) 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7659c700 1 -- 172.21.15.19:0/597257476 learned_addr learned my addr 172.21.15.19:0/597257476 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d75d9b700 1 --2- 172.21.15.19:0/597257476 >> v2:172.21.15.19:3300/0 conn(0x7f0d780d0010 0x7f0d780d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801448916 0 0) 0x7f0d780cf190 con 0x7f0d78159040 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d76d9d700 1 --2- 172.21.15.19:0/597257476 >> v2:172.21.15.119:3300/0 conn(0x7f0d7815cea0 0x7f0d7815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.647+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d60003570 con 0x7f0d78159040 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299269706 0 0) 0x7f0d60003570 con 0x7f0d78159040 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 >> v2:172.21.15.119:3300/0 conn(0x7f0d7815cea0 msgr2=0x7f0d7815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 --2- 172.21.15.19:0/597257476 >> v2:172.21.15.119:3300/0 conn(0x7f0d7815cea0 0x7f0d7815d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 >> v2:172.21.15.19:3300/0 conn(0x7f0d780d0010 msgr2=0x7f0d780d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 --2- 172.21.15.19:0/597257476 >> v2:172.21.15.19:3300/0 conn(0x7f0d780d0010 0x7f0d780d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780ce860 con 0x7f0d78159040 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f0d68001470 con 0x7f0d78159040 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 >> v1:172.21.15.19:6789/0 conn(0x7f0d78159040 legacy=0x7f0d780cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d60003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d60004810 0x7f0d60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d600051c0 0x7f0d6000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780d09a0 con 0x7f0d600051c0 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780ce5e0 con 0x7f0d60003a60 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6000c100 con 0x7f0d60004810 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7659c700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d60003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d76d9d700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d600051c0 0x7f0d6000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d75d9b700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d60004810 0x7f0d60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7659c700 1 -- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d60004810 msgr2=0x7f0d60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7659c700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d60004810 0x7f0d60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7659c700 1 -- 172.21.15.19:0/597257476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d600051c0 msgr2=0x7f0d6000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7659c700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d600051c0 0x7f0d6000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7659c700 1 -- 172.21.15.19:0/597257476 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60003570 con 0x7f0d60003a60 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d76d9d700 1 -- 172.21.15.19:0/597257476 reap_dead start 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7659c700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d60003e70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c3c0 tx=0x7f0d780cf100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24dfba92a5258ef8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800cc90 con 0x7f0d60003a60 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6800ce30 con 0x7f0d60003a60 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7559a700 1 -- 172.21.15.19:0/597257476 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68005b70 con 0x7f0d60003a60 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7759e700 1 -- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 msgr2=0x7f0d60003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7759e700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d60003e70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c3c0 tx=0x7f0d780cf100 comp rx=0 tx=0).stop 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7759e700 1 -- 172.21.15.19:0/597257476 shutdown_connections 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7759e700 1 --2- 172.21.15.19:0/597257476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d60003e70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7759e700 1 -- 172.21.15.19:0/597257476 >> 172.21.15.19:0/597257476 conn(0x7f0d78068250 msgr2=0x7f0d78068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7759e700 1 -- 172.21.15.19:0/597257476 shutdown_connections 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.651+0000 7f0d7759e700 1 -- 172.21.15.19:0/597257476 wait complete. 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7759e700 1 Processor -- start 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7759e700 1 -- start start 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7759e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d7816a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7759e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d780b2440 0x7f0d7816b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d7816c930 0x7f0d78154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7759e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7816b680 con 0x7f0d780b2440 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7759e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7816c4a0 con 0x7f0d60003a60 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780b28b0 con 0x7f0d7816c930 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d75d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d780b2440 0x7f0d7816b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d7816a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d75d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d780b2440 0x7f0d7816b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50318/0 (socket says 172.21.15.19:50318) 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d7816a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:54536/0 (socket says 172.21.15.19:54536) 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d75d9b700 1 -- 172.21.15.19:0/2260742791 learned_addr learned my addr 172.21.15.19:0/2260742791 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d76d9d700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d7816c930 0x7f0d78154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7659c700 1 -- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d7816c930 msgr2=0x7f0d78154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7659c700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d7816c930 0x7f0d78154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7659c700 1 -- 172.21.15.19:0/2260742791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d780b2440 msgr2=0x7f0d7816b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7659c700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d780b2440 0x7f0d7816b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7659c700 1 -- 172.21.15.19:0/2260742791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7816b890 con 0x7f0d60003a60 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.655+0000 7f0d7659c700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d7816a770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d68014000 tx=0x7f0d68015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.659+0000 7f0d667fc700 1 -- 172.21.15.19:0/2260742791 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800cc90 con 0x7f0d60003a60 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.659+0000 7f0d667fc700 1 -- 172.21.15.19:0/2260742791 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d68000fe0 con 0x7f0d60003a60 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.659+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7816bb70 con 0x7f0d60003a60 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.659+0000 7f0d667fc700 1 -- 172.21.15.19:0/2260742791 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68007530 con 0x7f0d60003a60 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.659+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7816c130 con 0x7f0d60003a60 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.659+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d780643a0 con 0x7f0d60003a60 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.659+0000 7f0d667fc700 1 -- 172.21.15.19:0/2260742791 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0d68040a70 con 0x7f0d60003a60 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.659+0000 7f0d667fc700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0d58060890 0x7f0d58062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.659+0000 7f0d667fc700 1 -- 172.21.15.19:0/2260742791 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d6807d5d0 con 0x7f0d60003a60 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.663+0000 7f0d75d9b700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0d58060890 0x7f0d58062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.663+0000 7f0d75d9b700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0d58060890 0x7f0d58062d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d7816afe0 tx=0x7f0d6c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.671+0000 7f0d667fc700 1 -- 172.21.15.19:0/2260742791 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0d6804daa0 con 0x7f0d60003a60 2024-08-17T02:26:46.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0d78159410 con 0x7f0d60003a60 2024-08-17T02:26:46.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d667fc700 1 -- 172.21.15.19:0/2260742791 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0d68017070 con 0x7f0d60003a60 2024-08-17T02:26:46.884 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0d58060890 msgr2=0x7f0d58062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0d58060890 0x7f0d58062d40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0d7816afe0 tx=0x7f0d6c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 msgr2=0x7f0d7816a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d7816a770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d68014000 tx=0x7f0d68015000 comp rx=0 tx=0).stop 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 shutdown_connections 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0d58060890 0x7f0d58062d40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d7816c930 0x7f0d78154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d780b2440 0x7f0d7816b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.879+0000 7f0d7759e700 1 --2- 172.21.15.19:0/2260742791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d60003a60 0x7f0d7816a770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.883+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 >> 172.21.15.19:0/2260742791 conn(0x7f0d78068250 msgr2=0x7f0d781579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.883+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 shutdown_connections 2024-08-17T02:26:46.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:46.883+0000 7f0d7759e700 1 -- 172.21.15.19:0/2260742791 wait complete. 2024-08-17T02:26:46.898 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:46.898 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:46.898 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-08-17T02:26:46.898 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:26:46.898 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:46.898 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:46.899 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:46.899 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:46.899 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:46.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:46.899 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-08-17T02:26:46.907 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:46.907 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:46.907 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:46.907 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42589sec preferred_lft 42589sec 2024-08-17T02:26:46.908 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2024-08-17T02:26:46.909 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:46.909 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:46.909 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:5f:96:fc:ab brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:46.909 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:46.909 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:46.909 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:46.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:46.909 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:26:46.909 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:26:46.909 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:46.909 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:46.909 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2024-08-17T02:26:46.910 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:46.910 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:26:46.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:46.991 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:47.001 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-08-17T02:26:47.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.002 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-08-17T02:26:47.028 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-08-17T02:26:47.028 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:47.028 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:47.028 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:47.028 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:47.028 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:47.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.030 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:26:47.030 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:26:47.030 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:47.030 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:47.030 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:47.030 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:26:47.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.071 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-08-17T02:26:47.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.120 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-08-17T02:26:47.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.127 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:26:47.128 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:26:47.128 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:47.128 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:26:47.128 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:26:47.160 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:26:47.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.160 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:26:47.160 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:26:47.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:26:47.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:47.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:26:47.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:26:47.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:26:47.161 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:26:47.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:47.283 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:26:47.283 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:26:47.283 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-08-17T02:26:47.283 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:47.283 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:26:47.311 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:26:47.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:47.311 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:47.318 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:47.318 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:47.318 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:47.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-08-17T02:26:47.382 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:47.382 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:47.392 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:47.393 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:47.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:47.394 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-08-17T02:26:47.400 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:26:47.401 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:26:47.403 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-08-17T02:26:47.418 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:47.419 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:47.430 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:47.431 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:47.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:47.431 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-08-17T02:26:47.488 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:2024-08-17T02:26:47.485+0000 7fb0fd57d380 -1 init, newargv = 0x55e61d67b800 newargc=15 2024-08-17T02:26:47.488 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:ceph-fuse[30320]: starting ceph client 2024-08-17T02:26:47.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:ceph-fuse[30320]: starting fuse 2024-08-17T02:26:48.537 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-08-17T02:26:48.554 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:48.554 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:48.567 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:48.568 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:48.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:48.569 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-08-17T02:26:48.575 INFO:teuthology.orchestra.run.smithi119.stdout:52 2024-08-17T02:26:48.575 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:26:48.575 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:48.575 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-08-17T02:26:48.575 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-08-17T02:26:48.575 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-08-17T02:26:48.575 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-08-17T02:26:48.575 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:26:48.575 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-08-17T02:26:48.575 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-08-17T02:26:48.576 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-08-17T02:26:48.577 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-08-17T02:26:48.577 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:48.577 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:26:48.577 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.1")) 2024-08-17T02:26:48.577 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-08-17T02:26:48.653 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.1.30320.asok 2024-08-17T02:26:48.839 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.30320.asok 2024-08-17T02:26:48.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:48.839 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.30320.asok status 2024-08-17T02:26:48.975 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-08-17T02:26:48.976 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-08-17T02:26:48.976 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:48.976 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:48.976 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "1", 2024-08-17T02:26:48.976 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-08-17T02:26:48.976 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:26:48.976 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "30320", 2024-08-17T02:26:48.976 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 34448, 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 34448 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-08-17T02:26:48.977 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 74832283 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 74832283 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.34448 192.168.0.1:0/74832283", 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/74832283", 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 6, 2024-08-17T02:26:48.978 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 22, 2024-08-17T02:26:48.979 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:48.979 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-08-17T02:26:48.979 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-08-17T02:26:48.979 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-08-17T02:26:48.985 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:49.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.095+0000 7fb04ecc5700 1 Processor -- start 2024-08-17T02:26:49.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.095+0000 7fb04ecc5700 1 -- start start 2024-08-17T02:26:49.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ecc5700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb048158aa0 0x7fb0480ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ecc5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0480ad8a0 con 0x7fb048155d80 2024-08-17T02:26:49.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ecc5700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0480adb80 con 0x7fb0480af5f0 2024-08-17T02:26:49.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ecc5700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480ade60 con 0x7fb048158aa0 2024-08-17T02:26:49.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04dcc3700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb048155d80 0x7fb0480aeee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39520/0 (socket says 172.21.15.19:39520) 2024-08-17T02:26:49.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04dcc3700 1 -- 172.21.15.19:0/1311395543 learned_addr learned my addr 172.21.15.19:0/1311395543 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:49.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04e4c4700 1 --2- 172.21.15.19:0/1311395543 >> v2:172.21.15.119:3300/0 conn(0x7fb048158aa0 0x7fb0480ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ccc1700 1 -- 172.21.15.19:0/1311395543 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480392514 0 0) 0x7fb0480ad8a0 con 0x7fb048155d80 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ccc1700 1 -- 172.21.15.19:0/1311395543 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb034003570 con 0x7fb048155d80 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04e4c4700 1 -- 172.21.15.19:0/1311395543 >> v1:172.21.15.119:6789/0 conn(0x7fb0480af5f0 legacy=0x7fb0480acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ccc1700 1 -- 172.21.15.19:0/1311395543 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244296065 0 0) 0x7fb0480adb80 con 0x7fb0480af5f0 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04e4c4700 1 -- 172.21.15.19:0/1311395543 >> v1:172.21.15.19:6789/0 conn(0x7fb048155d80 legacy=0x7fb0480aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04e4c4700 1 -- 172.21.15.19:0/1311395543 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480ae140 con 0x7fb048158aa0 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04e4c4700 1 --2- 172.21.15.19:0/1311395543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb048158aa0 0x7fb0480ad260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb040009e60 tx=0x7fb040009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18e45e840e6304f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ccc1700 1 -- 172.21.15.19:0/1311395543 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000e070 con 0x7fb048158aa0 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ccc1700 1 -- 172.21.15.19:0/1311395543 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04000bb60 con 0x7fb048158aa0 2024-08-17T02:26:49.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ccc1700 1 -- 172.21.15.19:0/1311395543 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000bee0 con 0x7fb048158aa0 2024-08-17T02:26:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ecc5700 1 -- 172.21.15.19:0/1311395543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb048158aa0 msgr2=0x7fb0480ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.099+0000 7fb04ecc5700 1 --2- 172.21.15.19:0/1311395543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb048158aa0 0x7fb0480ad260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb040009e60 tx=0x7fb040009780 comp rx=0 tx=0).stop 2024-08-17T02:26:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.103+0000 7fb04ecc5700 1 -- 172.21.15.19:0/1311395543 shutdown_connections 2024-08-17T02:26:49.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.103+0000 7fb04ecc5700 1 --2- 172.21.15.19:0/1311395543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb048158aa0 0x7fb0480ad260 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.103+0000 7fb04ecc5700 1 -- 172.21.15.19:0/1311395543 >> 172.21.15.19:0/1311395543 conn(0x7fb04806e070 msgr2=0x7fb0480b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.103+0000 7fb04ecc5700 1 -- 172.21.15.19:0/1311395543 shutdown_connections 2024-08-17T02:26:49.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.103+0000 7fb04ecc5700 1 -- 172.21.15.19:0/1311395543 wait complete. 2024-08-17T02:26:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.103+0000 7fb04ecc5700 1 Processor -- start 2024-08-17T02:26:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.103+0000 7fb04ecc5700 1 -- start start 2024-08-17T02:26:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04ecc5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0480af5f0 0x7fb048148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04ecc5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb048155d80 0x7fb04814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04ecc5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb048158aa0 0x7fb048154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04ecc5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb048151110 con 0x7fb0480af5f0 2024-08-17T02:26:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04ecc5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb048149050 con 0x7fb048155d80 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04ecc5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04814d9f0 con 0x7fb048158aa0 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04dcc3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0480af5f0 0x7fb048148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04dcc3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0480af5f0 0x7fb048148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59430/0 (socket says 172.21.15.19:59430) 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04dcc3700 1 -- 172.21.15.19:0/2705858649 learned_addr learned my addr 172.21.15.19:0/2705858649 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04d4c2700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb048155d80 0x7fb04814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04e4c4700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb048158aa0 0x7fb048154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04dcc3700 1 -- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb048158aa0 msgr2=0x7fb048154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04dcc3700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb048158aa0 0x7fb048154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04dcc3700 1 -- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb048155d80 msgr2=0x7fb04814ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04dcc3700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb048155d80 0x7fb04814ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04dcc3700 1 -- 172.21.15.19:0/2705858649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009a20 con 0x7fb0480af5f0 2024-08-17T02:26:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04dcc3700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0480af5f0 0x7fb048148b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0440011e0 tx=0x7fb044007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb03dffb700 1 -- 172.21.15.19:0/2705858649 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044005b30 con 0x7fb0480af5f0 2024-08-17T02:26:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb03dffb700 1 -- 172.21.15.19:0/2705858649 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044005c90 con 0x7fb0480af5f0 2024-08-17T02:26:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04814dcd0 con 0x7fb0480af5f0 2024-08-17T02:26:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb03dffb700 1 -- 172.21.15.19:0/2705858649 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044007300 con 0x7fb0480af5f0 2024-08-17T02:26:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.107+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04814e290 con 0x7fb0480af5f0 2024-08-17T02:26:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.111+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0480638f0 con 0x7fb0480af5f0 2024-08-17T02:26:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.111+0000 7fb03dffb700 1 -- 172.21.15.19:0/2705858649 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb044007670 con 0x7fb0480af5f0 2024-08-17T02:26:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.111+0000 7fb03dffb700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb02c060860 0x7fb02c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.111+0000 7fb03dffb700 1 -- 172.21.15.19:0/2705858649 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb04407bfb0 con 0x7fb0480af5f0 2024-08-17T02:26:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.111+0000 7fb04d4c2700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb02c060860 0x7fb02c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.111+0000 7fb04d4c2700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb02c060860 0x7fb02c062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb0480abbc0 tx=0x7fb038007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.115+0000 7fb03dffb700 1 -- 172.21.15.19:0/2705858649 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb04404c360 con 0x7fb0480af5f0 2024-08-17T02:26:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0480aeaf0 con 0x7fb0480af5f0 2024-08-17T02:26:49.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb03dffb700 1 -- 172.21.15.19:0/2705858649 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb044017070 con 0x7fb0480af5f0 2024-08-17T02:26:49.327 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb02c060860 msgr2=0x7fb02c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb02c060860 0x7fb02c062d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb0480abbc0 tx=0x7fb038007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0480af5f0 msgr2=0x7fb048148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0480af5f0 0x7fb048148b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0440011e0 tx=0x7fb044007df0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 shutdown_connections 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb02c060860 0x7fb02c062d10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb048158aa0 0x7fb048154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb048155d80 0x7fb04814ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 --2- 172.21.15.19:0/2705858649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0480af5f0 0x7fb048148b10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 >> 172.21.15.19:0/2705858649 conn(0x7fb04806e070 msgr2=0x7fb0481578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 shutdown_connections 2024-08-17T02:26:49.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:49.323+0000 7fb04ecc5700 1 -- 172.21.15.19:0/2705858649 wait complete. 2024-08-17T02:26:49.342 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:49.342 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:49.342 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-08-17T02:26:49.342 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:26:49.342 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:49.343 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:49.343 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:49.343 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:49.343 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:49.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.343 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-08-17T02:26:49.351 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42587sec preferred_lft 42587sec 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2024-08-17T02:26:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:5f:96:fc:ab brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 16:36:22:ed:1e:03 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c822:e4ff:fe07:ddf0/64 scope link 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 16:36:22:ed:1e:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::1436:22ff:feed:1e03/64 scope link 2024-08-17T02:26:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.354 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:49.406 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-08-17T02:26:49.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.408 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-08-17T02:26:49.416 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-08-17T02:26:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:26:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:26:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:26:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:26:49.418 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:49.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.418 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:26:49.418 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:26:49.418 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:49.419 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:49.419 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:49.419 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:26:49.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.456 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-08-17T02:26:49.507 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:26:49.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.508 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-08-17T02:26:49.514 INFO:teuthology.orchestra.run.smithi119.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:26:49.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.515 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:26:49.515 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:26:49.515 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:26:49.515 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:26:49.515 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:26:49.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:49.599 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:49.599 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:49.599 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 46:41:e1:40:1c:7c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::4441:e1ff:fe40:1c7c/64 scope link 2024-08-17T02:26:49.600 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.601 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:49.614 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 46:41:e1:40:1c:7c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::4441:e1ff:fe40:1c7c/64 scope link 2024-08-17T02:26:49.615 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:49.616 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:26:49.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.616 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:26:49.616 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:26:49.616 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:26:49.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:49.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:26:49.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:26:49.617 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:26:49.617 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:26:49.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:49.722 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:26:49.722 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:26:49.722 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.1 up 2024-08-17T02:26:49.722 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:49.723 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:26:49.749 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-08-17T02:26:49.749 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:49.749 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:49.754 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:49.754 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:49.754 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:49.802 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-08-17T02:26:49.820 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:49.820 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:49.830 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:49.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:49.830 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-08-17T02:26:49.879 INFO:teuthology.orchestra.run.smithi119.stdout:52 2024-08-17T02:26:49.879 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:26:49.879 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-08-17T02:26:49.882 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-08-17T02:26:49.899 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:49.899 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:49.954 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:49.955 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:49.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:49.955 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-08-17T02:26:49.959 INFO:teuthology.orchestra.run.smithi119.stdout:52 2024-08-17T02:26:49.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi119.stderr:2024-08-17T02:26:49.965+0000 7fca4dfa4380 -1 init, newargv = 0x563e3c9525d0 newargc=15 2024-08-17T02:26:49.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi119.stderr:ceph-fuse[30431]: starting ceph client 2024-08-17T02:26:49.974 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi119.stderr:ceph-fuse[30431]: starting fuse 2024-08-17T02:26:51.061 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-08-17T02:26:51.080 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:26:51.080 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:26:51.142 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:26:51.143 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:26:51.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.144 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-08-17T02:26:51.149 INFO:teuthology.orchestra.run.smithi119.stdout:52 2024-08-17T02:26:51.149 INFO:teuthology.orchestra.run.smithi119.stdout:53 2024-08-17T02:26:51.149 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:26:51.149 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:26:51.149 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-08-17T02:26:51.149 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-08-17T02:26:51.149 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-08-17T02:26:51.149 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-08-17T02:26:51.149 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:26:51.149 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-08-17T02:26:51.149 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-08-17T02:26:51.150 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-08-17T02:26:51.151 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:26:51.151 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:26:51.151 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.3")) 2024-08-17T02:26:51.151 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-08-17T02:26:51.233 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.3.30431.asok 2024-08-17T02:26:51.416 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.30431.asok 2024-08-17T02:26:51.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.416 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.30431.asok status 2024-08-17T02:26:51.507 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-08-17T02:26:51.507 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-08-17T02:26:51.507 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "3", 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "30431", 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 34454, 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 34454 2024-08-17T02:26:51.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1906290697 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1906290697 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.34454 192.168.0.2:0/1906290697", 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.2:0/1906290697", 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 6, 2024-08-17T02:26:51.509 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 22, 2024-08-17T02:26:51.510 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:26:51.510 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-08-17T02:26:51.510 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-08-17T02:26:51.510 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-08-17T02:26:51.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.518 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-08-17T02:26:51.518 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:51.527 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-08-17T02:26:51.527 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:51.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.527 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:51.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.589 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-08-17T02:26:51.589 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:51.596 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-08-17T02:26:51.597 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:51.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:51.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.617 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-08-17T02:26:51.617 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:51.626 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-08-17T02:26:51.626 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:51.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.626 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:51.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.641 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-08-17T02:26:51.641 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:51.692 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-08-17T02:26:51.692 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:51.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:51.692 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:51.705 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:26:51.723 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd730d36700 1 Processor -- start 2024-08-17T02:26:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd730d36700 1 -- start start 2024-08-17T02:26:51.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd730d36700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd72c1536f0 0x7fd72c15a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd730d36700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72c153b70 con 0x7fd72c153320 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd730d36700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72c15dbd0 con 0x7fd72c0cd1b0 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd730d36700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c0ce430 con 0x7fd72c1536f0 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd72bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd72c1536f0 0x7fd72c15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd72b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd72c153320 0x7fd72c0ccaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39528/0 (socket says 172.21.15.19:39528) 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd72bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd72c1536f0 0x7fd72c15a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59432/0 (socket says 172.21.15.19:59432) 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd72b7fe700 1 -- 172.21.15.19:0/99342893 learned_addr learned my addr 172.21.15.19:0/99342893 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd72bfff700 1 -- 172.21.15.19:0/99342893 >> v1:172.21.15.119:6789/0 conn(0x7fd72c0cd1b0 legacy=0x7fd72c0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd72bfff700 1 -- 172.21.15.19:0/99342893 >> v1:172.21.15.19:6789/0 conn(0x7fd72c153320 legacy=0x7fd72c0ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.835+0000 7fd72bfff700 1 -- 172.21.15.19:0/99342893 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c15d370 con 0x7fd72c1536f0 2024-08-17T02:26:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd72bfff700 1 --2- 172.21.15.19:0/99342893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 0x7fd72c15a190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd724009e90 tx=0x7fd724009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36489fe8db08864 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd72a7fc700 1 -- 172.21.15.19:0/99342893 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72400e070 con 0x7fd72c1536f0 2024-08-17T02:26:51.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd72a7fc700 1 -- 172.21.15.19:0/99342893 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72400bbf0 con 0x7fd72c1536f0 2024-08-17T02:26:51.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd72a7fc700 1 -- 172.21.15.19:0/99342893 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724012430 con 0x7fd72c1536f0 2024-08-17T02:26:51.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd730d36700 1 -- 172.21.15.19:0/99342893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 msgr2=0x7fd72c15a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd730d36700 1 --2- 172.21.15.19:0/99342893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 0x7fd72c15a190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd724009e90 tx=0x7fd724009780 comp rx=0 tx=0).stop 2024-08-17T02:26:51.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd730d36700 1 -- 172.21.15.19:0/99342893 shutdown_connections 2024-08-17T02:26:51.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd730d36700 1 --2- 172.21.15.19:0/99342893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 0x7fd72c15a190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd730d36700 1 -- 172.21.15.19:0/99342893 >> 172.21.15.19:0/99342893 conn(0x7fd72c0d00a0 msgr2=0x7fd72c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd730d36700 1 -- 172.21.15.19:0/99342893 shutdown_connections 2024-08-17T02:26:51.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.839+0000 7fd730d36700 1 -- 172.21.15.19:0/99342893 wait complete. 2024-08-17T02:26:51.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 Processor -- start 2024-08-17T02:26:51.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 -- start start 2024-08-17T02:26:51.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c0cd1b0 0x7fd72c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd72c153320 0x7fd72c0b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 0x7fd72c14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c14e840 con 0x7fd72c1536f0 2024-08-17T02:26:51.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c14dcc0 con 0x7fd72c0cd1b0 2024-08-17T02:26:51.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c14dfa0 con 0x7fd72c153320 2024-08-17T02:26:51.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 0x7fd72c14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 0x7fd72c14bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59436/0 (socket says 172.21.15.19:59436) 2024-08-17T02:26:51.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72bfff700 1 -- 172.21.15.19:0/2350586644 learned_addr learned my addr 172.21.15.19:0/2350586644 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:51.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72b7fe700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c0cd1b0 0x7fd72c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72affd700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd72c153320 0x7fd72c0b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72bfff700 1 -- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd72c153320 msgr2=0x7fd72c0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72bfff700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd72c153320 0x7fd72c0b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72bfff700 1 -- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c0cd1b0 msgr2=0x7fd72c14d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72bfff700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c0cd1b0 0x7fd72c14d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72bfff700 1 -- 172.21.15.19:0/2350586644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724009a20 con 0x7fd72c1536f0 2024-08-17T02:26:51.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72b7fe700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c0cd1b0 0x7fd72c14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:51.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72affd700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd72c153320 0x7fd72c0b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:51.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd72bfff700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 0x7fd72c14bd00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd7240099f0 tx=0x7fd724019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd7137fe700 1 -- 172.21.15.19:0/2350586644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72401e630 con 0x7fd72c1536f0 2024-08-17T02:26:51.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd7137fe700 1 -- 172.21.15.19:0/2350586644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72401e7b0 con 0x7fd72c1536f0 2024-08-17T02:26:51.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c14e280 con 0x7fd72c1536f0 2024-08-17T02:26:51.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd7137fe700 1 -- 172.21.15.19:0/2350586644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72401eb70 con 0x7fd72c1536f0 2024-08-17T02:26:51.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.843+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c0b0b30 con 0x7fd72c1536f0 2024-08-17T02:26:51.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.847+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c0638f0 con 0x7fd72c1536f0 2024-08-17T02:26:51.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.847+0000 7fd7137fe700 1 -- 172.21.15.19:0/2350586644 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd724024070 con 0x7fd72c1536f0 2024-08-17T02:26:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.847+0000 7fd7137fe700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd718060860 0x7fd718062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.847+0000 7fd7137fe700 1 -- 172.21.15.19:0/2350586644 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd72407f510 con 0x7fd72c1536f0 2024-08-17T02:26:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.847+0000 7fd72b7fe700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd718060860 0x7fd718062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.851+0000 7fd72b7fe700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd718060860 0x7fd718062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0018c0 tx=0x7fd71c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:51.859+0000 7fd7137fe700 1 -- 172.21.15.19:0/2350586644 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd72404f960 con 0x7fd72c1536f0 2024-08-17T02:26:52.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.023+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd72c0b2ed0 con 0x7fd72c1536f0 2024-08-17T02:26:52.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.023+0000 7fd7137fe700 1 -- 172.21.15.19:0/2350586644 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd724052f80 con 0x7fd72c1536f0 2024-08-17T02:26:52.029 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:52.030 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd718060860 msgr2=0x7fd718062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd718060860 0x7fd718062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0018c0 tx=0x7fd71c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 msgr2=0x7fd72c14bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 0x7fd72c14bd00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd7240099f0 tx=0x7fd724019000 comp rx=0 tx=0).stop 2024-08-17T02:26:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 shutdown_connections 2024-08-17T02:26:52.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd718060860 0x7fd718062d10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd72c1536f0 0x7fd72c14bd00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd72c153320 0x7fd72c0b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 --2- 172.21.15.19:0/2350586644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c0cd1b0 0x7fd72c14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 >> 172.21.15.19:0/2350586644 conn(0x7fd72c0d00a0 msgr2=0x7fd72c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 shutdown_connections 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.027+0000 7fd730d36700 1 -- 172.21.15.19:0/2350586644 wait complete. 2024-08-17T02:26:52.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:27.555224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:27.958499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:52.045 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:52.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18e9a8700 1 Processor -- start 2024-08-17T02:26:52.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18e9a8700 1 -- start start 2024-08-17T02:26:52.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18e9a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18814fe10 0x7fe1880686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18e9a8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1880ae120 con 0x7fe188068be0 2024-08-17T02:26:52.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18e9a8700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe188069030 con 0x7fe18814fa40 2024-08-17T02:26:52.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18e9a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1881569b0 con 0x7fe18814fe10 2024-08-17T02:26:52.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18e1a7700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe188068be0 0x7fe188155c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39534/0 (socket says 172.21.15.19:39534) 2024-08-17T02:26:52.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18e1a7700 1 -- 172.21.15.19:0/396482634 learned_addr learned my addr 172.21.15.19:0/396482634 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:52.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469657835 0 0) 0x7fe1880ae120 con 0x7fe188068be0 2024-08-17T02:26:52.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe174003570 con 0x7fe188068be0 2024-08-17T02:26:52.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18d1a5700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18814fe10 0x7fe1880686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2117844372 0 0) 0x7fe174003570 con 0x7fe188068be0 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18814fe10 msgr2=0x7fe1880686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18c9a4700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18814fe10 0x7fe1880686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 >> v1:172.21.15.119:6789/0 conn(0x7fe18814fa40 legacy=0x7fe188156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1880ad7f0 con 0x7fe188068be0 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7fe1800017f0 con 0x7fe188068be0 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.155+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 >> v1:172.21.15.19:6789/0 conn(0x7fe188068be0 legacy=0x7fe188155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18c9a4700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe174003a90 0x7fe174003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18c9a4700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18814fe10 0x7fe174004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18c9a4700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe174004da0 0x7fe1740051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1881569b0 con 0x7fe174003a90 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17400de30 con 0x7fe174004da0 2024-08-17T02:26:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17400dff0 con 0x7fe18814fe10 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18d9a6700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe174003a90 0x7fe174003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18e1a7700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe174004da0 0x7fe1740051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18d9a6700 1 -- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18814fe10 msgr2=0x7fe174004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18d9a6700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18814fe10 0x7fe174004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18d9a6700 1 -- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe174004da0 msgr2=0x7fe1740051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18d9a6700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe174004da0 0x7fe1740051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18d9a6700 1 -- 172.21.15.19:0/396482634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174003570 con 0x7fe174003a90 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18e1a7700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe174004da0 0x7fe1740051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18d9a6700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe174003a90 0x7fe174003ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe178001880 tx=0x7fe178007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416b8328ed32ece8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178012420 con 0x7fe174003a90 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe178012580 con 0x7fe174003a90 2024-08-17T02:26:52.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18c9a4700 1 -- 172.21.15.19:0/396482634 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178012920 con 0x7fe174003a90 2024-08-17T02:26:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18e9a8700 1 -- 172.21.15.19:0/396482634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe174003a90 msgr2=0x7fe174003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18e9a8700 1 --2- 172.21.15.19:0/396482634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe174003a90 0x7fe174003ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe178001880 tx=0x7fe178007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18e1a7700 1 -- 172.21.15.19:0/396482634 reap_dead start 2024-08-17T02:26:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18e9a8700 1 -- 172.21.15.19:0/396482634 shutdown_connections 2024-08-17T02:26:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18e9a8700 1 -- 172.21.15.19:0/396482634 >> 172.21.15.19:0/396482634 conn(0x7fe18806e310 msgr2=0x7fe18806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18e9a8700 1 -- 172.21.15.19:0/396482634 shutdown_connections 2024-08-17T02:26:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.159+0000 7fe18e9a8700 1 -- 172.21.15.19:0/396482634 wait complete. 2024-08-17T02:26:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e9a8700 1 Processor -- start 2024-08-17T02:26:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e9a8700 1 -- start start 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e9a8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe174003a90 0x7fe188148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e9a8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe188150340 0x7fe18806b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e9a8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1881683b0 0x7fe188168820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e9a8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe188168d60 con 0x7fe1881683b0 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e9a8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18814a420 con 0x7fe188150340 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e9a8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18814a6c0 con 0x7fe174003a90 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e1a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1881683b0 0x7fe188168820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e1a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1881683b0 0x7fe188168820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59464/0 (socket says 172.21.15.19:59464) 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e1a7700 1 -- 172.21.15.19:0/1878347049 learned_addr learned my addr 172.21.15.19:0/1878347049 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18d9a6700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe174003a90 0x7fe188148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18d1a5700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe188150340 0x7fe18806b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e1a7700 1 -- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe174003a90 msgr2=0x7fe188148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e1a7700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe174003a90 0x7fe188148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e1a7700 1 -- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe188150340 msgr2=0x7fe18806b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e1a7700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe188150340 0x7fe18806b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e1a7700 1 -- 172.21.15.19:0/1878347049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18814a9a0 con 0x7fe1881683b0 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18d9a6700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe174003a90 0x7fe188148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.163+0000 7fe18e1a7700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1881683b0 0x7fe188168820 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe188064d10 tx=0x7fe180009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.167+0000 7fe17dffb700 1 -- 172.21.15.19:0/1878347049 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180004dc0 con 0x7fe1881683b0 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.167+0000 7fe17dffb700 1 -- 172.21.15.19:0/1878347049 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18000bba0 con 0x7fe1881683b0 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.167+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18814ac80 con 0x7fe1881683b0 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.167+0000 7fe17dffb700 1 -- 172.21.15.19:0/1878347049 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180007190 con 0x7fe1881683b0 2024-08-17T02:26:52.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.167+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe188150790 con 0x7fe1881683b0 2024-08-17T02:26:52.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.167+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1880638f0 con 0x7fe1881683b0 2024-08-17T02:26:52.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.167+0000 7fe17dffb700 1 -- 172.21.15.19:0/1878347049 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe180007500 con 0x7fe1881683b0 2024-08-17T02:26:52.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.167+0000 7fe17dffb700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe16c060890 0x7fe16c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.171+0000 7fe17dffb700 1 -- 172.21.15.19:0/1878347049 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe18007cbc0 con 0x7fe1881683b0 2024-08-17T02:26:52.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.171+0000 7fe18d9a6700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe16c060890 0x7fe16c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.171+0000 7fe18d9a6700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe16c060890 0x7fe16c062d40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe178008fd0 tx=0x7fe178015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.179+0000 7fe17dffb700 1 -- 172.21.15.19:0/1878347049 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe18004b480 con 0x7fe1881683b0 2024-08-17T02:26:52.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe188155490 con 0x7fe1881683b0 2024-08-17T02:26:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe17dffb700 1 -- 172.21.15.19:0/1878347049 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe18004d090 con 0x7fe1881683b0 2024-08-17T02:26:52.343 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:26:52.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe16c060890 msgr2=0x7fe16c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe16c060890 0x7fe16c062d40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe178008fd0 tx=0x7fe178015000 comp rx=0 tx=0).stop 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1881683b0 msgr2=0x7fe188168820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1881683b0 0x7fe188168820 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe188064d10 tx=0x7fe180009040 comp rx=0 tx=0).stop 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 shutdown_connections 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe16c060890 0x7fe16c062d40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1881683b0 0x7fe188168820 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe188150340 0x7fe18806b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 --2- 172.21.15.19:0/1878347049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe174003a90 0x7fe188148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 >> 172.21.15.19:0/1878347049 conn(0x7fe18806e310 msgr2=0x7fe188155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 shutdown_connections 2024-08-17T02:26:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.339+0000 7fe18e9a8700 1 -- 172.21.15.19:0/1878347049 wait complete. 2024-08-17T02:26:52.357 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.471+0000 7f497bfff700 1 Processor -- start 2024-08-17T02:26:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.471+0000 7f497bfff700 1 -- start start 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f497c0688d0 0x7f497c0aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497bfff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f497c158b70 0x7f497c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497bfff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c159510 con 0x7f497c068ca0 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497bfff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c0ab0f0 con 0x7f497c0688d0 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497bfff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c0ab3d0 con 0x7f497c158b70 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f497c0688d0 0x7f497c0aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f497c0688d0 0x7f497c0aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59466/0 (socket says 172.21.15.19:59466) 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497affd700 1 -- 172.21.15.19:0/1173556374 learned_addr learned my addr 172.21.15.19:0/1173556374 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:52.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497b7fe700 1 --2- 172.21.15.19:0/1173556374 >> v2:172.21.15.119:3300/0 conn(0x7f497c158b70 0x7f497c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497affd700 1 -- 172.21.15.19:0/1173556374 >> v2:172.21.15.119:3300/0 conn(0x7f497c158b70 msgr2=0x7f497c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497affd700 1 --2- 172.21.15.19:0/1173556374 >> v2:172.21.15.119:3300/0 conn(0x7f497c158b70 0x7f497c158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497affd700 1 -- 172.21.15.19:0/1173556374 >> v1:172.21.15.119:6789/0 conn(0x7f497c068ca0 legacy=0x7f497c066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497affd700 1 -- 172.21.15.19:0/1173556374 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0ab6b0 con 0x7f497c0688d0 2024-08-17T02:26:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497affd700 1 --2- 172.21.15.19:0/1173556374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 0x7f497c0aab10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f497c0ae280 tx=0x7f496c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f77b82c9bdc0f01 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497a7fc700 1 -- 172.21.15.19:0/1173556374 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c009e70 con 0x7f497c0688d0 2024-08-17T02:26:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497a7fc700 1 -- 172.21.15.19:0/1173556374 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c00b860 con 0x7f497c0688d0 2024-08-17T02:26:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.475+0000 7f497a7fc700 1 -- 172.21.15.19:0/1173556374 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00bc00 con 0x7f497c0688d0 2024-08-17T02:26:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 -- 172.21.15.19:0/1173556374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 msgr2=0x7f497c0aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 --2- 172.21.15.19:0/1173556374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 0x7f497c0aab10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f497c0ae280 tx=0x7f496c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 -- 172.21.15.19:0/1173556374 shutdown_connections 2024-08-17T02:26:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 --2- 172.21.15.19:0/1173556374 >> v2:172.21.15.119:3300/0 conn(0x7f497c158b70 0x7f497c158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 --2- 172.21.15.19:0/1173556374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 0x7f497c0aab10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 -- 172.21.15.19:0/1173556374 >> 172.21.15.19:0/1173556374 conn(0x7f497c06e310 msgr2=0x7f497c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 -- 172.21.15.19:0/1173556374 shutdown_connections 2024-08-17T02:26:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 -- 172.21.15.19:0/1173556374 wait complete. 2024-08-17T02:26:52.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 Processor -- start 2024-08-17T02:26:52.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 -- start start 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 0x7f497c148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f497c068ca0 0x7f497c155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f497c158b70 0x7f497c155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0b1f90 con 0x7f497c0688d0 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0b1380 con 0x7f497c068ca0 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497bfff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0b1660 con 0x7f497c158b70 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 0x7f497c148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 0x7f497c148760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59480/0 (socket says 172.21.15.19:59480) 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497b7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f497c158b70 0x7f497c155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f497affd700 1 -- 172.21.15.19:0/574313850 learned_addr learned my addr 172.21.15.19:0/574313850 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:52.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.479+0000 7f4973fff700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f497c068ca0 0x7f497c155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f497affd700 1 -- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f497c158b70 msgr2=0x7f497c155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f497affd700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f497c158b70 0x7f497c155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f497affd700 1 -- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f497c068ca0 msgr2=0x7f497c155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f497affd700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f497c068ca0 0x7f497c155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f497affd700 1 -- 172.21.15.19:0/574313850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0094f0 con 0x7f497c0688d0 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f497affd700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 0x7f497c148760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f497c064ce0 tx=0x7f496c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f4972ffd700 1 -- 172.21.15.19:0/574313850 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00bbe0 con 0x7f497c0688d0 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f4972ffd700 1 -- 172.21.15.19:0/574313850 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c000c90 con 0x7f497c0688d0 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f4972ffd700 1 -- 172.21.15.19:0/574313850 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c011650 con 0x7f497c0688d0 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c0b1940 con 0x7f497c0688d0 2024-08-17T02:26:52.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.483+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c0b2420 con 0x7f497c0688d0 2024-08-17T02:26:52.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.487+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c071360 con 0x7f497c0688d0 2024-08-17T02:26:52.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.487+0000 7f4972ffd700 1 -- 172.21.15.19:0/574313850 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f496c011a80 con 0x7f497c0688d0 2024-08-17T02:26:52.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.487+0000 7f4972ffd700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4960060860 0x7f4960062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.487+0000 7f4972ffd700 1 -- 172.21.15.19:0/574313850 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f496c07e400 con 0x7f497c0688d0 2024-08-17T02:26:52.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.487+0000 7f4973fff700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4960060860 0x7f4960062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.487+0000 7f4973fff700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4960060860 0x7f4960062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f497c1576c0 tx=0x7f4964000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.495+0000 7f4972ffd700 1 -- 172.21.15.19:0/574313850 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f496c04e850 con 0x7f497c0688d0 2024-08-17T02:26:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.655+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f497c1576f0 con 0x7f497c0688d0 2024-08-17T02:26:52.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.655+0000 7f4972ffd700 1 -- 172.21.15.19:0/574313850 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f496c051e70 con 0x7f497c0688d0 2024-08-17T02:26:52.661 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:26:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4960060860 msgr2=0x7f4960062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4960060860 0x7f4960062d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f497c1576c0 tx=0x7f4964000bc0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 msgr2=0x7f497c148760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 0x7f497c148760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f497c064ce0 tx=0x7f496c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 shutdown_connections 2024-08-17T02:26:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4960060860 0x7f4960062d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f497c158b70 0x7f497c155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f497c068ca0 0x7f497c155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 --2- 172.21.15.19:0/574313850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f497c0688d0 0x7f497c148760 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 >> 172.21.15.19:0/574313850 conn(0x7f497c06e310 msgr2=0x7f497c06b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 shutdown_connections 2024-08-17T02:26:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.659+0000 7f497bfff700 1 -- 172.21.15.19:0/574313850 wait complete. 2024-08-17T02:26:52.679 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:52.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.787+0000 7fe60e426700 1 Processor -- start 2024-08-17T02:26:52.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.787+0000 7fe60e426700 1 -- start start 2024-08-17T02:26:52.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60e426700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe608068db0 0x7fe608160a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60e426700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe608157160 con 0x7fe6081501e0 2024-08-17T02:26:52.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60e426700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe608156550 con 0x7fe6081505b0 2024-08-17T02:26:52.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60e426700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe608156830 con 0x7fe608068db0 2024-08-17T02:26:52.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60d424700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe6081501e0 0x7fe6080ab7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39544/0 (socket says 172.21.15.19:39544) 2024-08-17T02:26:52.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60d424700 1 -- 172.21.15.19:0/4149799862 learned_addr learned my addr 172.21.15.19:0/4149799862 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:52.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60dc25700 1 --2- 172.21.15.19:0/4149799862 >> v2:172.21.15.119:3300/0 conn(0x7fe608068db0 0x7fe608160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe5fffff700 1 -- 172.21.15.19:0/4149799862 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791369030 0 0) 0x7fe608157160 con 0x7fe6081501e0 2024-08-17T02:26:52.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe5fffff700 1 -- 172.21.15.19:0/4149799862 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f4003570 con 0x7fe6081501e0 2024-08-17T02:26:52.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60dc25700 1 -- 172.21.15.19:0/4149799862 >> v1:172.21.15.119:6789/0 conn(0x7fe6081505b0 legacy=0x7fe6080686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60dc25700 1 -- 172.21.15.19:0/4149799862 >> v1:172.21.15.19:6789/0 conn(0x7fe6081501e0 legacy=0x7fe6080ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe5fffff700 1 -- 172.21.15.19:0/4149799862 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3182795348 0 0) 0x7fe5f4003570 con 0x7fe6081501e0 2024-08-17T02:26:52.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60dc25700 1 -- 172.21.15.19:0/4149799862 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608156b10 con 0x7fe608068db0 2024-08-17T02:26:52.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe60dc25700 1 --2- 172.21.15.19:0/4149799862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608068db0 0x7fe608160a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe600009e60 tx=0x7fe600009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=817a4f4b83f0deae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe5fffff700 1 -- 172.21.15.19:0/4149799862 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000e070 con 0x7fe608068db0 2024-08-17T02:26:52.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe5fffff700 1 -- 172.21.15.19:0/4149799862 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000b850 con 0x7fe608068db0 2024-08-17T02:26:52.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.791+0000 7fe5fffff700 1 -- 172.21.15.19:0/4149799862 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604001470 con 0x7fe608068db0 2024-08-17T02:26:52.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.795+0000 7fe60e426700 1 -- 172.21.15.19:0/4149799862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608068db0 msgr2=0x7fe608160a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.795+0000 7fe60e426700 1 --2- 172.21.15.19:0/4149799862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608068db0 0x7fe608160a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe600009e60 tx=0x7fe600009780 comp rx=0 tx=0).stop 2024-08-17T02:26:52.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.795+0000 7fe60e426700 1 -- 172.21.15.19:0/4149799862 shutdown_connections 2024-08-17T02:26:52.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.795+0000 7fe60e426700 1 --2- 172.21.15.19:0/4149799862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608068db0 0x7fe608160a10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.795+0000 7fe60e426700 1 -- 172.21.15.19:0/4149799862 >> 172.21.15.19:0/4149799862 conn(0x7fe60806e310 msgr2=0x7fe60806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.795+0000 7fe60e426700 1 -- 172.21.15.19:0/4149799862 shutdown_connections 2024-08-17T02:26:52.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.795+0000 7fe60e426700 1 -- 172.21.15.19:0/4149799862 wait complete. 2024-08-17T02:26:52.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.795+0000 7fe60e426700 1 Processor -- start 2024-08-17T02:26:52.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.795+0000 7fe60e426700 1 -- start start 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60e426700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe608068db0 0x7fe608152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60e426700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6081501e0 0x7fe608166c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60e426700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6081505b0 0x7fe60815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60e426700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6081595a0 con 0x7fe6081505b0 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60e426700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60815bb60 con 0x7fe6081501e0 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60e426700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6081597f0 con 0x7fe608068db0 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60dc25700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6081505b0 0x7fe60815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60dc25700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6081505b0 0x7fe60815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59488/0 (socket says 172.21.15.19:59488) 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60dc25700 1 -- 172.21.15.19:0/1083616940 learned_addr learned my addr 172.21.15.19:0/1083616940 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:52.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60cc23700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6081501e0 0x7fe608166c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60d424700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe608068db0 0x7fe608152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60cc23700 1 -- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe608068db0 msgr2=0x7fe608152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60cc23700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe608068db0 0x7fe608152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60cc23700 1 -- 172.21.15.19:0/1083616940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6081505b0 msgr2=0x7fe60815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60cc23700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6081505b0 0x7fe60815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60cc23700 1 -- 172.21.15.19:0/1083616940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009a20 con 0x7fe6081501e0 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60cc23700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6081501e0 0x7fe608166c70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c490 tx=0x7fe5f8007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe5fd7fa700 1 -- 172.21.15.19:0/1083616940 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800ce40 con 0x7fe6081501e0 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe5fd7fa700 1 -- 172.21.15.19:0/1083616940 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8011590 con 0x7fe6081501e0 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe608159ad0 con 0x7fe6081501e0 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe5fd7fa700 1 -- 172.21.15.19:0/1083616940 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8011950 con 0x7fe6081501e0 2024-08-17T02:26:52.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.799+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60814c200 con 0x7fe6081501e0 2024-08-17T02:26:52.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.803+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe608159fd0 con 0x7fe6081501e0 2024-08-17T02:26:52.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.803+0000 7fe5fd7fa700 1 -- 172.21.15.19:0/1083616940 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe5f8011cc0 con 0x7fe6081501e0 2024-08-17T02:26:52.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.803+0000 7fe5fd7fa700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe5ec060860 0x7fe5ec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.803+0000 7fe5fd7fa700 1 -- 172.21.15.19:0/1083616940 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5f807c270 con 0x7fe6081501e0 2024-08-17T02:26:52.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.803+0000 7fe60d424700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe5ec060860 0x7fe5ec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.803+0000 7fe60d424700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe5ec060860 0x7fe5ec062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe604001620 tx=0x7fe604000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.815+0000 7fe5fd7fa700 1 -- 172.21.15.19:0/1083616940 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe5f804c740 con 0x7fe6081501e0 2024-08-17T02:26:52.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.979+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6080638f0 con 0x7fe6081501e0 2024-08-17T02:26:52.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.979+0000 7fe5fd7fa700 1 -- 172.21.15.19:0/1083616940 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5f80170a0 con 0x7fe6081501e0 2024-08-17T02:26:52.985 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-08-17T02:26:52.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe5ec060860 msgr2=0x7fe5ec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe5ec060860 0x7fe5ec062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe604001620 tx=0x7fe604000bc0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6081501e0 msgr2=0x7fe608166c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6081501e0 0x7fe608166c70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c490 tx=0x7fe5f8007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 shutdown_connections 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe5ec060860 0x7fe5ec062d10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6081505b0 0x7fe60815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6081501e0 0x7fe608166c70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 --2- 172.21.15.19:0/1083616940 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe608068db0 0x7fe608152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 >> 172.21.15.19:0/1083616940 conn(0x7fe60806e310 msgr2=0x7fe60806bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 shutdown_connections 2024-08-17T02:26:52.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:52.983+0000 7fe60e426700 1 -- 172.21.15.19:0/1083616940 wait complete. 2024-08-17T02:26:52.999 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385ffff700 1 Processor -- start 2024-08-17T02:26:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385ffff700 1 -- start start 2024-08-17T02:26:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3860157070 0x7f38600c8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3860158000 0x7f38600adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385ffff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38600ad670 con 0x7f38600ae040 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385ffff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38600acd80 con 0x7f3860157070 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385ffff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3860157440 con 0x7f3860158000 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f38600ae040 0x7f38600c96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39552/0 (socket says 172.21.15.19:39552) 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3860157070 0x7f38600c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385f7fe700 1 -- 172.21.15.19:0/2981298135 learned_addr learned my addr 172.21.15.19:0/2981298135 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385e7fc700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3860158000 0x7f38600adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527379132 0 0) 0x7f38600ad670 con 0x7f38600ae040 2024-08-17T02:26:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f384c003570 con 0x7f38600ae040 2024-08-17T02:26:53.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1108578236 0 0) 0x7f384c003570 con 0x7f38600ae040 2024-08-17T02:26:53.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3860158000 msgr2=0x7f38600adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3860158000 0x7f38600adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 >> v2:172.21.15.19:3300/0 conn(0x7f3860157070 msgr2=0x7f38600c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 --2- 172.21.15.19:0/2981298135 >> v2:172.21.15.19:3300/0 conn(0x7f3860157070 0x7f38600c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38601585d0 con 0x7f38600ae040 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f38580017f0 con 0x7f38600ae040 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 >> v1:172.21.15.19:6789/0 conn(0x7f38600ae040 legacy=0x7f38600c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3860158000 0x7f384c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c003fe0 0x7f384c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c004d50 0x7f384c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600acd80 con 0x7f384c003fe0 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860157440 con 0x7f384c004d50 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c00ba90 con 0x7f3860158000 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385e7fc700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c003fe0 0x7f384c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385effd700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3860158000 0x7f384c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385f7fe700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c004d50 0x7f384c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385e7fc700 1 -- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3860158000 msgr2=0x7f384c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385e7fc700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3860158000 0x7f384c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385e7fc700 1 -- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c004d50 msgr2=0x7f384c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385e7fc700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c004d50 0x7f384c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385e7fc700 1 -- 172.21.15.19:0/2981298135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c003570 con 0x7f384c003fe0 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385f7fe700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c004d50 0x7f384c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.103+0000 7f385e7fc700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c003fe0 0x7f384c004810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3848009c00 tx=0x7f38480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1bd86a5dccc880 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800e6b0 con 0x7f384c003fe0 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384800e810 con 0x7f384c003fe0 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385dffb700 1 -- 172.21.15.19:0/2981298135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800ebd0 con 0x7f384c003fe0 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385ffff700 1 -- 172.21.15.19:0/2981298135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c003fe0 msgr2=0x7f384c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385ffff700 1 --2- 172.21.15.19:0/2981298135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c003fe0 0x7f384c004810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3848009c00 tx=0x7f38480091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385f7fe700 1 -- 172.21.15.19:0/2981298135 reap_dead start 2024-08-17T02:26:53.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385ffff700 1 -- 172.21.15.19:0/2981298135 shutdown_connections 2024-08-17T02:26:53.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385ffff700 1 -- 172.21.15.19:0/2981298135 >> 172.21.15.19:0/2981298135 conn(0x7f38600ccfc0 msgr2=0x7f38600c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385ffff700 1 -- 172.21.15.19:0/2981298135 shutdown_connections 2024-08-17T02:26:53.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385ffff700 1 -- 172.21.15.19:0/2981298135 wait complete. 2024-08-17T02:26:53.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385ffff700 1 Processor -- start 2024-08-17T02:26:53.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.107+0000 7f385ffff700 1 -- start start 2024-08-17T02:26:53.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c003fe0 0x7f38601549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3860154f00 0x7f38600b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38600b0710 0x7f38600b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385ffff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860155f90 con 0x7f3860154f00 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385ffff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860155380 con 0x7f38600b0710 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385ffff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3860155660 con 0x7f384c003fe0 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3860154f00 0x7f38600b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3860154f00 0x7f38600b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59510/0 (socket says 172.21.15.19:59510) 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385e7fc700 1 -- 172.21.15.19:0/3364869403 learned_addr learned my addr 172.21.15.19:0/3364869403 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385f7fe700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38600b0710 0x7f38600b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385effd700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c003fe0 0x7f38601549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385e7fc700 1 -- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c003fe0 msgr2=0x7f38601549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385e7fc700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c003fe0 0x7f38601549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385e7fc700 1 -- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38600b0710 msgr2=0x7f38600b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385e7fc700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38600b0710 0x7f38600b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385e7fc700 1 -- 172.21.15.19:0/3364869403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3860155940 con 0x7f3860154f00 2024-08-17T02:26:53.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385e7fc700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3860154f00 0x7f38600b01d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38480091e0 tx=0x7f384801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f3856ffd700 1 -- 172.21.15.19:0/3364869403 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848022070 con 0x7f3860154f00 2024-08-17T02:26:53.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f3856ffd700 1 -- 172.21.15.19:0/3364869403 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384800e980 con 0x7f3860154f00 2024-08-17T02:26:53.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3860155c20 con 0x7f3860154f00 2024-08-17T02:26:53.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f3856ffd700 1 -- 172.21.15.19:0/3364869403 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848027470 con 0x7f3860154f00 2024-08-17T02:26:53.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.111+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38600b1330 con 0x7f3860154f00 2024-08-17T02:26:53.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.115+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3860156140 con 0x7f3860154f00 2024-08-17T02:26:53.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.115+0000 7f3856ffd700 1 -- 172.21.15.19:0/3364869403 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f38480278c0 con 0x7f3860154f00 2024-08-17T02:26:53.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.115+0000 7f3856ffd700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3840060860 0x7f3840062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.115+0000 7f3856ffd700 1 -- 172.21.15.19:0/3364869403 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f384807e510 con 0x7f3860154f00 2024-08-17T02:26:53.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.115+0000 7f385effd700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3840060860 0x7f3840062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.115+0000 7f385effd700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3840060860 0x7f3840062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3850009ee0 tx=0x7f3850008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.123+0000 7f3856ffd700 1 -- 172.21.15.19:0/3364869403 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3860156140 con 0x7f3860154f00 2024-08-17T02:26:53.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.291+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38600638f0 con 0x7f3860154f00 2024-08-17T02:26:53.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.291+0000 7f3856ffd700 1 -- 172.21.15.19:0/3364869403 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f3848017090 con 0x7f3860154f00 2024-08-17T02:26:53.297 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:53.298 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:53.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3840060860 msgr2=0x7f3840062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3840060860 0x7f3840062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3850009ee0 tx=0x7f3850008040 comp rx=0 tx=0).stop 2024-08-17T02:26:53.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3860154f00 msgr2=0x7f38600b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3860154f00 0x7f38600b01d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f38480091e0 tx=0x7f384801a000 comp rx=0 tx=0).stop 2024-08-17T02:26:53.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 shutdown_connections 2024-08-17T02:26:53.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3840060860 0x7f3840062d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38600b0710 0x7f38600b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3860154f00 0x7f38600b01d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 --2- 172.21.15.19:0/3364869403 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c003fe0 0x7f38601549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 >> 172.21.15.19:0/3364869403 conn(0x7f38600ccfc0 msgr2=0x7f38601505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 shutdown_connections 2024-08-17T02:26:53.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.295+0000 7f385ffff700 1 -- 172.21.15.19:0/3364869403 wait complete. 2024-08-17T02:26:53.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:27.555224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:27.958499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:53.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:53.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7ba62ba700 1 Processor -- start 2024-08-17T02:26:53.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7ba62ba700 1 -- start start 2024-08-17T02:26:53.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7ba62ba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7ba00b2210 0x7f7ba00b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7ba62ba700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ba00b5040 0x7f7ba00b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7ba62ba700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba00b5a00 con 0x7f7ba00cc840 2024-08-17T02:26:53.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7ba62ba700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba00af570 con 0x7f7ba00b2210 2024-08-17T02:26:53.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7ba62ba700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba0159ce0 con 0x7f7ba00b5040 2024-08-17T02:26:53.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7b9ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7ba00cc840 0x7f7ba00ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39562/0 (socket says 172.21.15.19:39562) 2024-08-17T02:26:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7b9ffff700 1 -- 172.21.15.19:0/9321988 learned_addr learned my addr 172.21.15.19:0/9321988 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7b9f7fe700 1 --2- 172.21.15.19:0/9321988 >> v2:172.21.15.19:3300/0 conn(0x7f7ba00b2210 0x7f7ba00b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7ba4857700 1 --2- 172.21.15.19:0/9321988 >> v2:172.21.15.119:3300/0 conn(0x7f7ba00b5040 0x7f7ba00b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7b9effd700 1 -- 172.21.15.19:0/9321988 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788065869 0 0) 0x7f7ba00b5a00 con 0x7f7ba00cc840 2024-08-17T02:26:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.419+0000 7f7b9effd700 1 -- 172.21.15.19:0/9321988 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b8c003570 con 0x7f7ba00cc840 2024-08-17T02:26:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7b9f7fe700 1 -- 172.21.15.19:0/9321988 >> v2:172.21.15.119:3300/0 conn(0x7f7ba00b5040 msgr2=0x7f7ba00b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7b9f7fe700 1 --2- 172.21.15.19:0/9321988 >> v2:172.21.15.119:3300/0 conn(0x7f7ba00b5040 0x7f7ba00b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7b9f7fe700 1 -- 172.21.15.19:0/9321988 >> v1:172.21.15.19:6789/0 conn(0x7f7ba00cc840 legacy=0x7f7ba00ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7b9f7fe700 1 -- 172.21.15.19:0/9321988 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba0159fc0 con 0x7f7ba00b2210 2024-08-17T02:26:53.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7b9f7fe700 1 --2- 172.21.15.19:0/9321988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 0x7f7ba00b2670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00b0f20 tx=0x7f7b880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3fd0d4f0512757 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7b9effd700 1 -- 172.21.15.19:0/9321988 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88011630 con 0x7f7ba00b2210 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7b9effd700 1 -- 172.21.15.19:0/9321988 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b880117b0 con 0x7f7ba00b2210 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7b9effd700 1 -- 172.21.15.19:0/9321988 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88011b70 con 0x7f7ba00b2210 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 -- 172.21.15.19:0/9321988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 msgr2=0x7f7ba00b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 --2- 172.21.15.19:0/9321988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 0x7f7ba00b2670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00b0f20 tx=0x7f7b880091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 -- 172.21.15.19:0/9321988 shutdown_connections 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 --2- 172.21.15.19:0/9321988 >> v2:172.21.15.119:3300/0 conn(0x7f7ba00b5040 0x7f7ba00b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 --2- 172.21.15.19:0/9321988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 0x7f7ba00b2670 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 -- 172.21.15.19:0/9321988 >> 172.21.15.19:0/9321988 conn(0x7f7ba00682c0 msgr2=0x7f7ba00686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 -- 172.21.15.19:0/9321988 shutdown_connections 2024-08-17T02:26:53.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 -- 172.21.15.19:0/9321988 wait complete. 2024-08-17T02:26:53.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 Processor -- start 2024-08-17T02:26:53.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.423+0000 7f7ba62ba700 1 -- start start 2024-08-17T02:26:53.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba62ba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 0x7f7ba01568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba62ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba00b5040 0x7f7ba015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba62ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba00cc840 0x7f7ba016cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba62ba700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0154370 con 0x7f7ba00b2210 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba62ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0154650 con 0x7f7ba00cc840 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba62ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0154930 con 0x7f7ba00b5040 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 0x7f7ba01568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 0x7f7ba01568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59524/0 (socket says 172.21.15.19:59524) 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9ffff700 1 -- 172.21.15.19:0/2652201554 learned_addr learned my addr 172.21.15.19:0/2652201554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9f7fe700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba00b5040 0x7f7ba015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba4857700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba00cc840 0x7f7ba016cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9ffff700 1 -- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba00b5040 msgr2=0x7f7ba015cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9ffff700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba00b5040 0x7f7ba015cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9ffff700 1 -- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba00cc840 msgr2=0x7f7ba016cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9ffff700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba00cc840 0x7f7ba016cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9ffff700 1 -- 172.21.15.19:0/2652201554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88009420 con 0x7f7ba00b2210 2024-08-17T02:26:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b9ffff700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 0x7f7ba01568f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000c7c0 tx=0x7f7b90007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b97fff700 1 -- 172.21.15.19:0/2652201554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90005cd0 con 0x7f7ba00b2210 2024-08-17T02:26:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b97fff700 1 -- 172.21.15.19:0/2652201554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b90005e30 con 0x7f7ba00b2210 2024-08-17T02:26:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba0154c10 con 0x7f7ba00b2210 2024-08-17T02:26:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7b97fff700 1 -- 172.21.15.19:0/2652201554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90007320 con 0x7f7ba00b2210 2024-08-17T02:26:53.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba01561d0 con 0x7f7ba00b2210 2024-08-17T02:26:53.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.427+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba00645c0 con 0x7f7ba00b2210 2024-08-17T02:26:53.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.431+0000 7f7b97fff700 1 -- 172.21.15.19:0/2652201554 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7b9001b3b0 con 0x7f7ba00b2210 2024-08-17T02:26:53.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.431+0000 7f7b97fff700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7b80060890 0x7f7b80062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.431+0000 7f7b97fff700 1 -- 172.21.15.19:0/2652201554 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b9007c230 con 0x7f7ba00b2210 2024-08-17T02:26:53.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.431+0000 7f7b9f7fe700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7b80060890 0x7f7b80062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.431+0000 7f7b9f7fe700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7b80060890 0x7f7b80062d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00b0f20 tx=0x7f7b88017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.439+0000 7f7b97fff700 1 -- 172.21.15.19:0/2652201554 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7b9004c680 con 0x7f7ba00b2210 2024-08-17T02:26:53.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.603+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ba00b1570 con 0x7f7ba00b2210 2024-08-17T02:26:53.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.603+0000 7f7b97fff700 1 -- 172.21.15.19:0/2652201554 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b9004fca0 con 0x7f7ba00b2210 2024-08-17T02:26:53.610 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:26:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7b80060890 msgr2=0x7f7b80062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7b80060890 0x7f7b80062d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00b0f20 tx=0x7f7b88017000 comp rx=0 tx=0).stop 2024-08-17T02:26:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 msgr2=0x7f7ba01568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 0x7f7ba01568f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000c7c0 tx=0x7f7b90007e00 comp rx=0 tx=0).stop 2024-08-17T02:26:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 shutdown_connections 2024-08-17T02:26:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7b80060890 0x7f7b80062d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba00cc840 0x7f7ba016cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba00b5040 0x7f7ba015cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 --2- 172.21.15.19:0/2652201554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ba00b2210 0x7f7ba01568f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 >> 172.21.15.19:0/2652201554 conn(0x7f7ba00682c0 msgr2=0x7f7ba00b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 shutdown_connections 2024-08-17T02:26:53.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.607+0000 7f7ba62ba700 1 -- 172.21.15.19:0/2652201554 wait complete. 2024-08-17T02:26:53.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:53.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.735+0000 7f1a95a7a700 1 Processor -- start 2024-08-17T02:26:53.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95a7a700 1 -- start start 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95a7a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a90068db0 0x7f1a90150580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95a7a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9015a3b0 con 0x7f1a901501b0 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95a7a700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a900b0550 con 0x7f1a900ab860 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95a7a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a90159ac0 con 0x7f1a90068db0 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95279700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a90068db0 0x7f1a90150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95279700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a90068db0 0x7f1a90150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59538/0 (socket says 172.21.15.19:59538) 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95279700 1 -- 172.21.15.19:0/207512608 learned_addr learned my addr 172.21.15.19:0/207512608 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a94a78700 1 --1- 172.21.15.19:0/207512608 >> v1:172.21.15.19:6789/0 conn(0x7f1a901501b0 0x7f1a90156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39564/0 (socket says 172.21.15.19:39564) 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a8f7fe700 1 -- 172.21.15.19:0/207512608 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858191423 0 0) 0x7f1a9015a3b0 con 0x7f1a901501b0 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a8f7fe700 1 -- 172.21.15.19:0/207512608 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a80003570 con 0x7f1a901501b0 2024-08-17T02:26:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95279700 1 -- 172.21.15.19:0/207512608 >> v1:172.21.15.119:6789/0 conn(0x7f1a900ab860 legacy=0x7f1a900686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95279700 1 -- 172.21.15.19:0/207512608 >> v1:172.21.15.19:6789/0 conn(0x7f1a901501b0 legacy=0x7f1a90156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95279700 1 -- 172.21.15.19:0/207512608 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90159d60 con 0x7f1a90068db0 2024-08-17T02:26:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a95279700 1 --2- 172.21.15.19:0/207512608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a90068db0 0x7f1a90150580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009f20 tx=0x7f1a88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106c50942c8b5947 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a8f7fe700 1 -- 172.21.15.19:0/207512608 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800e070 con 0x7f1a90068db0 2024-08-17T02:26:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a8f7fe700 1 -- 172.21.15.19:0/207512608 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8800b9d0 con 0x7f1a90068db0 2024-08-17T02:26:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.739+0000 7f1a8f7fe700 1 -- 172.21.15.19:0/207512608 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a880092e0 con 0x7f1a90068db0 2024-08-17T02:26:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.743+0000 7f1a95a7a700 1 -- 172.21.15.19:0/207512608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a90068db0 msgr2=0x7f1a90150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.743+0000 7f1a95a7a700 1 --2- 172.21.15.19:0/207512608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a90068db0 0x7f1a90150580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009f20 tx=0x7f1a88009840 comp rx=0 tx=0).stop 2024-08-17T02:26:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.743+0000 7f1a95a7a700 1 -- 172.21.15.19:0/207512608 shutdown_connections 2024-08-17T02:26:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.743+0000 7f1a95a7a700 1 --2- 172.21.15.19:0/207512608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a90068db0 0x7f1a90150580 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.743+0000 7f1a95a7a700 1 -- 172.21.15.19:0/207512608 >> 172.21.15.19:0/207512608 conn(0x7f1a9006e350 msgr2=0x7f1a9006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.743+0000 7f1a95a7a700 1 -- 172.21.15.19:0/207512608 shutdown_connections 2024-08-17T02:26:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.743+0000 7f1a95a7a700 1 -- 172.21.15.19:0/207512608 wait complete. 2024-08-17T02:26:53.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.743+0000 7f1a95a7a700 1 Processor -- start 2024-08-17T02:26:53.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.743+0000 7f1a95a7a700 1 -- start start 2024-08-17T02:26:53.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95a7a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a90068db0 0x7f1a90158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95a7a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a900ab860 0x7f1a90147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95a7a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a901501b0 0x7f1a90067ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95a7a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90148000 con 0x7f1a901501b0 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95a7a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90158e90 con 0x7f1a900ab860 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95a7a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a900ac610 con 0x7f1a90068db0 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95279700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a901501b0 0x7f1a90067ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95279700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a901501b0 0x7f1a90067ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59554/0 (socket says 172.21.15.19:59554) 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95279700 1 -- 172.21.15.19:0/3636316447 learned_addr learned my addr 172.21.15.19:0/3636316447 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a94a78700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a90068db0 0x7f1a90158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a8ffff700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a900ab860 0x7f1a90147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95279700 1 -- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a90068db0 msgr2=0x7f1a90158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95279700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a90068db0 0x7f1a90158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95279700 1 -- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a900ab860 msgr2=0x7f1a90147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95279700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a900ab860 0x7f1a90147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95279700 1 -- 172.21.15.19:0/3636316447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009ae0 con 0x7f1a901501b0 2024-08-17T02:26:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95279700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a901501b0 0x7f1a90067ae0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a88012000 tx=0x7f1a88018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a8cff9700 1 -- 172.21.15.19:0/3636316447 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a880032f0 con 0x7f1a901501b0 2024-08-17T02:26:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a8cff9700 1 -- 172.21.15.19:0/3636316447 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a88026460 con 0x7f1a901501b0 2024-08-17T02:26:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a900ac8f0 con 0x7f1a901501b0 2024-08-17T02:26:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a8cff9700 1 -- 172.21.15.19:0/3636316447 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88026820 con 0x7f1a901501b0 2024-08-17T02:26:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a900aceb0 con 0x7f1a901501b0 2024-08-17T02:26:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.747+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a900638f0 con 0x7f1a901501b0 2024-08-17T02:26:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.751+0000 7f1a8cff9700 1 -- 172.21.15.19:0/3636316447 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1a88003040 con 0x7f1a901501b0 2024-08-17T02:26:53.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.751+0000 7f1a8cff9700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a74060890 0x7f1a74062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.751+0000 7f1a8cff9700 1 -- 172.21.15.19:0/3636316447 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a8807ecb0 con 0x7f1a901501b0 2024-08-17T02:26:53.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.751+0000 7f1a94a78700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a74060890 0x7f1a74062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.751+0000 7f1a94a78700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a74060890 0x7f1a74062d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a84004f70 tx=0x7f1a84007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.759+0000 7f1a8cff9700 1 -- 172.21.15.19:0/3636316447 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1a8804f060 con 0x7f1a901501b0 2024-08-17T02:26:53.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.923+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a901536c0 con 0x7f1a901501b0 2024-08-17T02:26:53.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.923+0000 7f1a8cff9700 1 -- 172.21.15.19:0/3636316447 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a88052680 con 0x7f1a901501b0 2024-08-17T02:26:53.928 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:26:53.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.923+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a74060890 msgr2=0x7f1a74062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.923+0000 7f1a95a7a700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a74060890 0x7f1a74062d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1a84004f70 tx=0x7f1a84007d40 comp rx=0 tx=0).stop 2024-08-17T02:26:53.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.923+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a901501b0 msgr2=0x7f1a90067ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.923+0000 7f1a95a7a700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a901501b0 0x7f1a90067ae0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a88012000 tx=0x7f1a88018000 comp rx=0 tx=0).stop 2024-08-17T02:26:53.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.923+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 shutdown_connections 2024-08-17T02:26:53.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.923+0000 7f1a95a7a700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1a74060890 0x7f1a74062d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.927+0000 7f1a95a7a700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a901501b0 0x7f1a90067ae0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.927+0000 7f1a95a7a700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a900ab860 0x7f1a90147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.927+0000 7f1a95a7a700 1 --2- 172.21.15.19:0/3636316447 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a90068db0 0x7f1a90158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.927+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 >> 172.21.15.19:0/3636316447 conn(0x7f1a9006e350 msgr2=0x7f1a90069850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.927+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 shutdown_connections 2024-08-17T02:26:53.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:53.927+0000 7f1a95a7a700 1 -- 172.21.15.19:0/3636316447 wait complete. 2024-08-17T02:26:53.942 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:54.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.055+0000 7f218a9ab700 1 Processor -- start 2024-08-17T02:26:54.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.055+0000 7f218a9ab700 1 -- start start 2024-08-17T02:26:54.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.055+0000 7f218a9ab700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f218413f680 0x7f21840aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.055+0000 7f218a9ab700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21840b0810 con 0x7f21840ad6c0 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.055+0000 7f218a9ab700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21840afc70 con 0x7f218413fa50 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.055+0000 7f218a9ab700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21840af060 con 0x7f218413f680 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f21899a9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f218413f680 0x7f21840aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a1aa700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f21840ad6c0 0x7f218406e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39576/0 (socket says 172.21.15.19:39576) 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f21899a9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f218413f680 0x7f21840aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59558/0 (socket says 172.21.15.19:59558) 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a1aa700 1 -- 172.21.15.19:0/3303940862 learned_addr learned my addr 172.21.15.19:0/3303940862 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f21899a9700 1 -- 172.21.15.19:0/3303940862 >> v1:172.21.15.119:6789/0 conn(0x7f218413fa50 legacy=0x7f21840b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f21899a9700 1 -- 172.21.15.19:0/3303940862 >> v1:172.21.15.19:6789/0 conn(0x7f21840ad6c0 legacy=0x7f218406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f21899a9700 1 -- 172.21.15.19:0/3303940862 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840af340 con 0x7f218413f680 2024-08-17T02:26:54.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f21899a9700 1 --2- 172.21.15.19:0/3303940862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413f680 0x7f21840aea80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f21800098e0 tx=0x7f21800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48db7c0d5fee577 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f21889a7700 1 -- 172.21.15.19:0/3303940862 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180009e80 con 0x7f218413f680 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f21889a7700 1 -- 172.21.15.19:0/3303940862 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218000b860 con 0x7f218413f680 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f21889a7700 1 -- 172.21.15.19:0/3303940862 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218000bbe0 con 0x7f218413f680 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a9ab700 1 -- 172.21.15.19:0/3303940862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413f680 msgr2=0x7f21840aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a9ab700 1 --2- 172.21.15.19:0/3303940862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413f680 0x7f21840aea80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f21800098e0 tx=0x7f21800091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a9ab700 1 -- 172.21.15.19:0/3303940862 shutdown_connections 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a9ab700 1 --2- 172.21.15.19:0/3303940862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413f680 0x7f21840aea80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a9ab700 1 -- 172.21.15.19:0/3303940862 >> 172.21.15.19:0/3303940862 conn(0x7f21840678a0 msgr2=0x7f2184067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a9ab700 1 -- 172.21.15.19:0/3303940862 shutdown_connections 2024-08-17T02:26:54.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a9ab700 1 -- 172.21.15.19:0/3303940862 wait complete. 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a9ab700 1 Processor -- start 2024-08-17T02:26:54.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.059+0000 7f218a9ab700 1 -- start start 2024-08-17T02:26:54.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a9ab700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21840ad6c0 0x7f21840a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a9ab700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218413f680 0x7f21840aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a9ab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413fa50 0x7f21840aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a9ab700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21840a7a50 con 0x7f218413fa50 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a9ab700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21840a65b0 con 0x7f218413f680 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a9ab700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21840a59a0 con 0x7f21840ad6c0 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a1aa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413fa50 0x7f21840aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a1aa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413fa50 0x7f21840aa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59562/0 (socket says 172.21.15.19:59562) 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a1aa700 1 -- 172.21.15.19:0/4270899581 learned_addr learned my addr 172.21.15.19:0/4270899581 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f21899a9700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21840ad6c0 0x7f21840a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f21891a8700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218413f680 0x7f21840aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a1aa700 1 -- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21840ad6c0 msgr2=0x7f21840a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a1aa700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21840ad6c0 0x7f21840a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a1aa700 1 -- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218413f680 msgr2=0x7f21840aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a1aa700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218413f680 0x7f21840aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a1aa700 1 -- 172.21.15.19:0/4270899581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180009420 con 0x7f218413fa50 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a1aa700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413fa50 0x7f21840aa630 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f217c00cc40 tx=0x7f217c001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f2179ffb700 1 -- 172.21.15.19:0/4270899581 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c00a8b0 con 0x7f218413fa50 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f2179ffb700 1 -- 172.21.15.19:0/4270899581 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c00aa10 con 0x7f218413fa50 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21840a5c80 con 0x7f218413fa50 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f2179ffb700 1 -- 172.21.15.19:0/4270899581 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c00add0 con 0x7f218413fa50 2024-08-17T02:26:54.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.063+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21840a6240 con 0x7f218413fa50 2024-08-17T02:26:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.067+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2184064330 con 0x7f218413fa50 2024-08-17T02:26:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.067+0000 7f2179ffb700 1 -- 172.21.15.19:0/4270899581 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f217c007300 con 0x7f218413fa50 2024-08-17T02:26:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.067+0000 7f2179ffb700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2168060860 0x7f2168062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.067+0000 7f2179ffb700 1 -- 172.21.15.19:0/4270899581 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f217c07ceb0 con 0x7f218413fa50 2024-08-17T02:26:54.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.067+0000 7f21899a9700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2168060860 0x7f2168062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.067+0000 7f21899a9700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2168060860 0x7f2168062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f21800093f0 tx=0x7f2180017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.075+0000 7f2179ffb700 1 -- 172.21.15.19:0/4270899581 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f217c04d300 con 0x7f218413fa50 2024-08-17T02:26:54.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f218406ed70 con 0x7f218413fa50 2024-08-17T02:26:54.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f2179ffb700 1 -- 172.21.15.19:0/4270899581 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f217c050920 con 0x7f218413fa50 2024-08-17T02:26:54.239 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-08-17T02:26:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2168060860 msgr2=0x7f2168062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2168060860 0x7f2168062d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f21800093f0 tx=0x7f2180017000 comp rx=0 tx=0).stop 2024-08-17T02:26:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413fa50 msgr2=0x7f21840aa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413fa50 0x7f21840aa630 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f217c00cc40 tx=0x7f217c001a50 comp rx=0 tx=0).stop 2024-08-17T02:26:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 shutdown_connections 2024-08-17T02:26:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2168060860 0x7f2168062d10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f218413fa50 0x7f21840aa630 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f218413f680 0x7f21840aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 --2- 172.21.15.19:0/4270899581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21840ad6c0 0x7f21840a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 >> 172.21.15.19:0/4270899581 conn(0x7f21840678a0 msgr2=0x7f2184069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 shutdown_connections 2024-08-17T02:26:54.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.235+0000 7f218a9ab700 1 -- 172.21.15.19:0/4270899581 wait complete. 2024-08-17T02:26:54.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:54.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.359+0000 7f5f5348e700 1 Processor -- start 2024-08-17T02:26:54.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.359+0000 7f5f5348e700 1 -- start start 2024-08-17T02:26:54.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.359+0000 7f5f5348e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5f4c159c00 0x7f5f4c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.359+0000 7f5f5348e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c153430 0x7f5f4c153890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.359+0000 7f5f5348e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c0b1c50 con 0x7f5f4c0b0780 2024-08-17T02:26:54.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.359+0000 7f5f5348e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c15a8c0 con 0x7f5f4c159c00 2024-08-17T02:26:54.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.359+0000 7f5f5348e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0ac890 con 0x7f5f4c153430 2024-08-17T02:26:54.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.359+0000 7f5f51c8b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5f4c0b0780 0x7f5f4c0b0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39580/0 (socket says 172.21.15.19:39580) 2024-08-17T02:26:54.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.359+0000 7f5f51c8b700 1 -- 172.21.15.19:0/3186874055 learned_addr learned my addr 172.21.15.19:0/3186874055 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:54.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f52c8d700 1 --2- 172.21.15.19:0/3186874055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c153430 0x7f5f4c153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5148a700 1 -- 172.21.15.19:0/3186874055 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057995094 0 0) 0x7f5f4c0b1c50 con 0x7f5f4c0b0780 2024-08-17T02:26:54.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5148a700 1 -- 172.21.15.19:0/3186874055 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f38003570 con 0x7f5f4c0b0780 2024-08-17T02:26:54.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5248c700 1 --2- 172.21.15.19:0/3186874055 >> v2:172.21.15.119:3300/0 conn(0x7f5f4c159c00 0x7f5f4c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f52c8d700 1 -- 172.21.15.19:0/3186874055 >> v2:172.21.15.119:3300/0 conn(0x7f5f4c159c00 msgr2=0x7f5f4c159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:54.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f52c8d700 1 --2- 172.21.15.19:0/3186874055 >> v2:172.21.15.119:3300/0 conn(0x7f5f4c159c00 0x7f5f4c159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f52c8d700 1 -- 172.21.15.19:0/3186874055 >> v1:172.21.15.19:6789/0 conn(0x7f5f4c0b0780 legacy=0x7f5f4c0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f52c8d700 1 -- 172.21.15.19:0/3186874055 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c153dd0 con 0x7f5f4c153430 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f52c8d700 1 --2- 172.21.15.19:0/3186874055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c153430 0x7f5f4c153890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e60 tx=0x7f5f44009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a8e27516b37758b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5148a700 1 -- 172.21.15.19:0/3186874055 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400e070 con 0x7f5f4c153430 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5148a700 1 -- 172.21.15.19:0/3186874055 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400bb60 con 0x7f5f4c153430 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5148a700 1 -- 172.21.15.19:0/3186874055 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44012430 con 0x7f5f4c153430 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 -- 172.21.15.19:0/3186874055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c153430 msgr2=0x7f5f4c153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 --2- 172.21.15.19:0/3186874055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c153430 0x7f5f4c153890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e60 tx=0x7f5f44009780 comp rx=0 tx=0).stop 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 -- 172.21.15.19:0/3186874055 shutdown_connections 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 --2- 172.21.15.19:0/3186874055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c153430 0x7f5f4c153890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 --2- 172.21.15.19:0/3186874055 >> v2:172.21.15.119:3300/0 conn(0x7f5f4c159c00 0x7f5f4c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 -- 172.21.15.19:0/3186874055 >> 172.21.15.19:0/3186874055 conn(0x7f5f4c0ccdb0 msgr2=0x7f5f4c0cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 -- 172.21.15.19:0/3186874055 shutdown_connections 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 -- 172.21.15.19:0/3186874055 wait complete. 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 Processor -- start 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.363+0000 7f5f5348e700 1 -- start start 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f5348e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c0b0780 0x7f5f4c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f5348e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f4c153430 0x7f5f4c14d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f5348e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f4c159c00 0x7f5f4c16a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f5348e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c1547f0 con 0x7f5f4c153430 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f5348e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c154ad0 con 0x7f5f4c159c00 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f5348e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c154db0 con 0x7f5f4c0b0780 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f51c8b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f4c153430 0x7f5f4c14d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f51c8b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f4c153430 0x7f5f4c14d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59566/0 (socket says 172.21.15.19:59566) 2024-08-17T02:26:54.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f51c8b700 1 -- 172.21.15.19:0/3413715411 learned_addr learned my addr 172.21.15.19:0/3413715411 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:54.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f5248c700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c0b0780 0x7f5f4c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f52c8d700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f4c159c00 0x7f5f4c16a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f51c8b700 1 -- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c0b0780 msgr2=0x7f5f4c153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f51c8b700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c0b0780 0x7f5f4c153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f51c8b700 1 -- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f4c159c00 msgr2=0x7f5f4c16a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f51c8b700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f4c159c00 0x7f5f4c16a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f51c8b700 1 -- 172.21.15.19:0/3413715411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44009a20 con 0x7f5f4c153430 2024-08-17T02:26:54.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f52c8d700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f4c159c00 0x7f5f4c16a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:54.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f51c8b700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f4c153430 0x7f5f4c14d540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00c7c0 tx=0x7f5f3c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f427fc700 1 -- 172.21.15.19:0/3413715411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c005b30 con 0x7f5f4c153430 2024-08-17T02:26:54.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f427fc700 1 -- 172.21.15.19:0/3413715411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c005cb0 con 0x7f5f4c153430 2024-08-17T02:26:54.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c155090 con 0x7f5f4c153430 2024-08-17T02:26:54.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f427fc700 1 -- 172.21.15.19:0/3413715411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c007320 con 0x7f5f4c153430 2024-08-17T02:26:54.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.367+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c154500 con 0x7f5f4c153430 2024-08-17T02:26:54.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.371+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c155570 con 0x7f5f4c153430 2024-08-17T02:26:54.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.371+0000 7f5f427fc700 1 -- 172.21.15.19:0/3413715411 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5f3c01b3b0 con 0x7f5f4c153430 2024-08-17T02:26:54.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.371+0000 7f5f427fc700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5f30060860 0x7f5f30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.371+0000 7f5f427fc700 1 -- 172.21.15.19:0/3413715411 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f3c07c080 con 0x7f5f4c153430 2024-08-17T02:26:54.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.371+0000 7f5f5248c700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5f30060860 0x7f5f30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.371+0000 7f5f5248c700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5f30060860 0x7f5f30062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f48006fd0 tx=0x7f5f48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.375+0000 7f5f427fc700 1 -- 172.21.15.19:0/3413715411 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5f3c04c4d0 con 0x7f5f4c153430 2024-08-17T02:26:54.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.543+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f4c0638f0 con 0x7f5f4c153430 2024-08-17T02:26:54.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.543+0000 7f5f427fc700 1 -- 172.21.15.19:0/3413715411 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5f3c04faf0 con 0x7f5f4c153430 2024-08-17T02:26:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:54.550 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5f30060860 msgr2=0x7f5f30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5f30060860 0x7f5f30062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f48006fd0 tx=0x7f5f48008040 comp rx=0 tx=0).stop 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f4c153430 msgr2=0x7f5f4c14d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f4c153430 0x7f5f4c14d540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00c7c0 tx=0x7f5f3c007e00 comp rx=0 tx=0).stop 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 shutdown_connections 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5f30060860 0x7f5f30062d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f4c159c00 0x7f5f4c16a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f4c153430 0x7f5f4c14d540 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 --2- 172.21.15.19:0/3413715411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5f4c0b0780 0x7f5f4c153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 >> 172.21.15.19:0/3413715411 conn(0x7f5f4c0ccdb0 msgr2=0x7f5f4c0cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 shutdown_connections 2024-08-17T02:26:54.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.547+0000 7f5f5348e700 1 -- 172.21.15.19:0/3413715411 wait complete. 2024-08-17T02:26:54.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:27.555224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:27.958499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:54.564 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:54.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.671+0000 7f2d5a9a7700 1 Processor -- start 2024-08-17T02:26:54.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.671+0000 7f2d5a9a7700 1 -- start start 2024-08-17T02:26:54.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2d541574f0 0x7f2d54157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5406e010 con 0x7f2d541514d0 2024-08-17T02:26:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d54157fb0 con 0x7f2d540b0d90 2024-08-17T02:26:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d54158290 con 0x7f2d541574f0 2024-08-17T02:26:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d599a5700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2d541514d0 0x7f2d5406ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39586/0 (socket says 172.21.15.19:39586) 2024-08-17T02:26:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d599a5700 1 -- 172.21.15.19:0/2692400740 learned_addr learned my addr 172.21.15.19:0/2692400740 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d591a4700 1 --2- 172.21.15.19:0/2692400740 >> v2:172.21.15.119:3300/0 conn(0x7f2d541574f0 0x7f2d54157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d589a3700 1 -- 172.21.15.19:0/2692400740 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243265790 0 0) 0x7f2d5406e010 con 0x7f2d541514d0 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d589a3700 1 -- 172.21.15.19:0/2692400740 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d3c003570 con 0x7f2d541514d0 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d591a4700 1 -- 172.21.15.19:0/2692400740 >> v1:172.21.15.119:6789/0 conn(0x7f2d540b0d90 legacy=0x7f2d540c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d591a4700 1 -- 172.21.15.19:0/2692400740 >> v1:172.21.15.19:6789/0 conn(0x7f2d541514d0 legacy=0x7f2d5406ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d591a4700 1 -- 172.21.15.19:0/2692400740 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5406e260 con 0x7f2d541574f0 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d591a4700 1 --2- 172.21.15.19:0/2692400740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d541574f0 0x7f2d54157970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2d500098e0 tx=0x7f2d500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a26b2107c4e98ce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d589a3700 1 -- 172.21.15.19:0/2692400740 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000b640 con 0x7f2d541574f0 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d589a3700 1 -- 172.21.15.19:0/2692400740 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5000b7a0 con 0x7f2d541574f0 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d589a3700 1 -- 172.21.15.19:0/2692400740 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000bb40 con 0x7f2d541574f0 2024-08-17T02:26:54.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2692400740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d541574f0 msgr2=0x7f2d54157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 --2- 172.21.15.19:0/2692400740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d541574f0 0x7f2d54157970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2d500098e0 tx=0x7f2d500091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2692400740 shutdown_connections 2024-08-17T02:26:54.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 --2- 172.21.15.19:0/2692400740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d541574f0 0x7f2d54157970 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2692400740 >> 172.21.15.19:0/2692400740 conn(0x7f2d540678a0 msgr2=0x7f2d54067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2692400740 shutdown_connections 2024-08-17T02:26:54.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2692400740 wait complete. 2024-08-17T02:26:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 Processor -- start 2024-08-17T02:26:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.675+0000 7f2d5a9a7700 1 -- start start 2024-08-17T02:26:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a9a7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d540b0d90 0x7f2d5416d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a9a7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d541514d0 0x7f2d5414d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a9a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d541574f0 0x7f2d5414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a9a7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d540af7a0 con 0x7f2d541574f0 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a9a7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5414e500 con 0x7f2d540b0d90 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a9a7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5414e7e0 con 0x7f2d541514d0 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a1a6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d541574f0 0x7f2d5414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a1a6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d541574f0 0x7f2d5414dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59582/0 (socket says 172.21.15.19:59582) 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a1a6700 1 -- 172.21.15.19:0/2634169485 learned_addr learned my addr 172.21.15.19:0/2634169485 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d591a4700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d541514d0 0x7f2d5414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d599a5700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d540b0d90 0x7f2d5416d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a1a6700 1 -- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d541514d0 msgr2=0x7f2d5414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a1a6700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d541514d0 0x7f2d5414d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a1a6700 1 -- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d540b0d90 msgr2=0x7f2d5416d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a1a6700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d540b0d90 0x7f2d5416d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a1a6700 1 -- 172.21.15.19:0/2634169485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50009420 con 0x7f2d541574f0 2024-08-17T02:26:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d591a4700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d541514d0 0x7f2d5414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d599a5700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d540b0d90 0x7f2d5416d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a1a6700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d541574f0 0x7f2d5414dc50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00c560 tx=0x7f2d4c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d49ffb700 1 -- 172.21.15.19:0/2634169485 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c011590 con 0x7f2d541574f0 2024-08-17T02:26:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5414eac0 con 0x7f2d541574f0 2024-08-17T02:26:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d49ffb700 1 -- 172.21.15.19:0/2634169485 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0116f0 con 0x7f2d541574f0 2024-08-17T02:26:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d49ffb700 1 -- 172.21.15.19:0/2634169485 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c011ab0 con 0x7f2d541574f0 2024-08-17T02:26:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.679+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5416d910 con 0x7f2d541574f0 2024-08-17T02:26:54.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.683+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d540af910 con 0x7f2d541574f0 2024-08-17T02:26:54.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.683+0000 7f2d49ffb700 1 -- 172.21.15.19:0/2634169485 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2d4c01b3b0 con 0x7f2d541574f0 2024-08-17T02:26:54.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.683+0000 7f2d49ffb700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d40060860 0x7f2d40062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.683+0000 7f2d49ffb700 1 -- 172.21.15.19:0/2634169485 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d4c07c200 con 0x7f2d541574f0 2024-08-17T02:26:54.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.683+0000 7f2d599a5700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d40060860 0x7f2d40062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.683+0000 7f2d599a5700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d40060860 0x7f2d40062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d44005c50 tx=0x7f2d44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.691+0000 7f2d49ffb700 1 -- 172.21.15.19:0/2634169485 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2d4c04c5b0 con 0x7f2d541574f0 2024-08-17T02:26:54.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.855+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d54064330 con 0x7f2d541574f0 2024-08-17T02:26:54.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d49ffb700 1 -- 172.21.15.19:0/2634169485 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d4c0170a0 con 0x7f2d541574f0 2024-08-17T02:26:54.863 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:26:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d40060860 msgr2=0x7f2d40062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d40060860 0x7f2d40062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d44005c50 tx=0x7f2d44009040 comp rx=0 tx=0).stop 2024-08-17T02:26:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d541574f0 msgr2=0x7f2d5414dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d541574f0 0x7f2d5414dc50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00c560 tx=0x7f2d4c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 shutdown_connections 2024-08-17T02:26:54.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d40060860 0x7f2d40062d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d541574f0 0x7f2d5414dc50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d541514d0 0x7f2d5414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 --2- 172.21.15.19:0/2634169485 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d540b0d90 0x7f2d5416d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 >> 172.21.15.19:0/2634169485 conn(0x7f2d540678a0 msgr2=0x7f2d54155eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 shutdown_connections 2024-08-17T02:26:54.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.859+0000 7f2d5a9a7700 1 -- 172.21.15.19:0/2634169485 wait complete. 2024-08-17T02:26:54.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:54.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.979+0000 7f65e2631700 1 Processor -- start 2024-08-17T02:26:54.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.979+0000 7f65e2631700 1 -- start start 2024-08-17T02:26:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65dc067030 0x7f65dc067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65dc0cfb00 0x7f65dc0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc0cf670 con 0x7f65dc0cb5c0 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc0cea60 con 0x7f65dc0cfb00 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc0ced40 con 0x7f65dc067030 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e0e2e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65dc0cfb00 0x7f65dc0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e0e2e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65dc0cfb00 0x7f65dc0cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59584/0 (socket says 172.21.15.19:59584) 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e0e2e700 1 -- 172.21.15.19:0/1686620714 learned_addr learned my addr 172.21.15.19:0/1686620714 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e162f700 1 --2- 172.21.15.19:0/1686620714 >> v2:172.21.15.119:3300/0 conn(0x7f65dc067030 0x7f65dc067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e0e2e700 1 -- 172.21.15.19:0/1686620714 >> v2:172.21.15.119:3300/0 conn(0x7f65dc067030 msgr2=0x7f65dc067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e0e2e700 1 --2- 172.21.15.19:0/1686620714 >> v2:172.21.15.119:3300/0 conn(0x7f65dc067030 0x7f65dc067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e0e2e700 1 -- 172.21.15.19:0/1686620714 >> v1:172.21.15.119:6789/0 conn(0x7f65dc0cb5c0 legacy=0x7f65dc158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e0e2e700 1 -- 172.21.15.19:0/1686620714 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0cf020 con 0x7f65dc0cfb00 2024-08-17T02:26:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e0e2e700 1 --2- 172.21.15.19:0/1686620714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc0cfb00 0x7f65dc0cb080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0d1070 tx=0x7f65d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b606e3082436bb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65d3fff700 1 -- 172.21.15.19:0/1686620714 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800b860 con 0x7f65dc0cfb00 2024-08-17T02:26:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65d3fff700 1 -- 172.21.15.19:0/1686620714 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d800b9c0 con 0x7f65dc0cfb00 2024-08-17T02:26:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65d3fff700 1 -- 172.21.15.19:0/1686620714 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800bd60 con 0x7f65dc0cfb00 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 -- 172.21.15.19:0/1686620714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc0cfb00 msgr2=0x7f65dc0cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 --2- 172.21.15.19:0/1686620714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc0cfb00 0x7f65dc0cb080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0d1070 tx=0x7f65d8009250 comp rx=0 tx=0).stop 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 -- 172.21.15.19:0/1686620714 shutdown_connections 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 --2- 172.21.15.19:0/1686620714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc0cfb00 0x7f65dc0cb080 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 --2- 172.21.15.19:0/1686620714 >> v2:172.21.15.119:3300/0 conn(0x7f65dc067030 0x7f65dc067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 -- 172.21.15.19:0/1686620714 >> 172.21.15.19:0/1686620714 conn(0x7f65dc0d0b50 msgr2=0x7f65dc0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 -- 172.21.15.19:0/1686620714 shutdown_connections 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.983+0000 7f65e2631700 1 -- 172.21.15.19:0/1686620714 wait complete. 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 Processor -- start 2024-08-17T02:26:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 -- start start 2024-08-17T02:26:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc067030 0x7f65dc13c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc0cb5c0 0x7f65dc1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc0cfb00 0x7f65dc0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc13c5c0 con 0x7f65dc067030 2024-08-17T02:26:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0c8b50 con 0x7f65dc0cfb00 2024-08-17T02:26:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc13cd40 con 0x7f65dc0cb5c0 2024-08-17T02:26:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e162f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc067030 0x7f65dc13c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e162f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc067030 0x7f65dc13c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59598/0 (socket says 172.21.15.19:59598) 2024-08-17T02:26:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e162f700 1 -- 172.21.15.19:0/3149786783 learned_addr learned my addr 172.21.15.19:0/3149786783 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e1e30700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc0cfb00 0x7f65dc0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e0e2e700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc0cb5c0 0x7f65dc1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e162f700 1 -- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc0cb5c0 msgr2=0x7f65dc1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e162f700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc0cb5c0 0x7f65dc1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e162f700 1 -- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc0cfb00 msgr2=0x7f65dc0c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e162f700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc0cfb00 0x7f65dc0c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e162f700 1 -- 172.21.15.19:0/3149786783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d80094f0 con 0x7f65dc067030 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e1e30700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc0cfb00 0x7f65dc0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e162f700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc067030 0x7f65dc13c800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00d8c0 tx=0x7f65cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65d17fa700 1 -- 172.21.15.19:0/3149786783 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0125f0 con 0x7f65dc067030 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65d17fa700 1 -- 172.21.15.19:0/3149786783 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc012750 con 0x7f65dc067030 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc14fbf0 con 0x7f65dc067030 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65d17fa700 1 -- 172.21.15.19:0/3149786783 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc012af0 con 0x7f65dc067030 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.987+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc0c8500 con 0x7f65dc067030 2024-08-17T02:26:54.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.991+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc0638f0 con 0x7f65dc067030 2024-08-17T02:26:54.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.991+0000 7f65d17fa700 1 -- 172.21.15.19:0/3149786783 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f65cc01e460 con 0x7f65dc067030 2024-08-17T02:26:54.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.991+0000 7f65d17fa700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f65c8060860 0x7f65c8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.991+0000 7f65d17fa700 1 -- 172.21.15.19:0/3149786783 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65cc07d110 con 0x7f65dc067030 2024-08-17T02:26:54.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.991+0000 7f65e0e2e700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f65c8060860 0x7f65c8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.995+0000 7f65e0e2e700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f65c8060860 0x7f65c8062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0d1070 tx=0x7f65d8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:54.999+0000 7f65d17fa700 1 -- 172.21.15.19:0/3149786783 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f65cc050ff0 con 0x7f65dc067030 2024-08-17T02:26:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.163+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65dc153310 con 0x7f65dc067030 2024-08-17T02:26:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.163+0000 7f65d17fa700 1 -- 172.21.15.19:0/3149786783 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65cc050b80 con 0x7f65dc067030 2024-08-17T02:26:55.168 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:26:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f65c8060860 msgr2=0x7f65c8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f65c8060860 0x7f65c8062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f65dc0d1070 tx=0x7f65d8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc067030 msgr2=0x7f65dc13c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc067030 0x7f65dc13c800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00d8c0 tx=0x7f65cc008040 comp rx=0 tx=0).stop 2024-08-17T02:26:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 shutdown_connections 2024-08-17T02:26:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f65c8060860 0x7f65c8062d10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65dc0cfb00 0x7f65dc0c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65dc0cb5c0 0x7f65dc1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 --2- 172.21.15.19:0/3149786783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65dc067030 0x7f65dc13c800 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 >> 172.21.15.19:0/3149786783 conn(0x7f65dc0d0b50 msgr2=0x7f65dc0b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 shutdown_connections 2024-08-17T02:26:55.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.167+0000 7f65e2631700 1 -- 172.21.15.19:0/3149786783 wait complete. 2024-08-17T02:26:55.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:55.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.295+0000 7f6d4ff60700 1 Processor -- start 2024-08-17T02:26:55.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.295+0000 7f6d4ff60700 1 -- start start 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.295+0000 7f6d4ff60700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480cbc30 0x7f6d480ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.295+0000 7f6d4ff60700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480c8cd0 con 0x7f6d480ad6e0 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.295+0000 7f6d4ff60700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480c89f0 con 0x7f6d480adb30 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.295+0000 7f6d4ff60700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480c3940 con 0x7f6d480cbc30 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.295+0000 7f6d4d4fb700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6d480ad6e0 0x7f6d480c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39592/0 (socket says 172.21.15.19:39592) 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.295+0000 7f6d4d4fb700 1 -- 172.21.15.19:0/935794413 learned_addr learned my addr 172.21.15.19:0/935794413 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.295+0000 7f6d4dcfc700 1 --2- 172.21.15.19:0/935794413 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480cbc30 0x7f6d480ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ccfa700 1 -- 172.21.15.19:0/935794413 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795954483 0 0) 0x7f6d480c8cd0 con 0x7f6d480ad6e0 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ccfa700 1 -- 172.21.15.19:0/935794413 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d34003570 con 0x7f6d480ad6e0 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ccfa700 1 -- 172.21.15.19:0/935794413 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178146649 0 0) 0x7f6d480c89f0 con 0x7f6d480adb30 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ccfa700 1 -- 172.21.15.19:0/935794413 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d480c8cd0 con 0x7f6d480adb30 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4dcfc700 1 -- 172.21.15.19:0/935794413 >> v1:172.21.15.119:6789/0 conn(0x7f6d480adb30 legacy=0x7f6d480cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4dcfc700 1 -- 172.21.15.19:0/935794413 >> v1:172.21.15.19:6789/0 conn(0x7f6d480ad6e0 legacy=0x7f6d480c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4dcfc700 1 -- 172.21.15.19:0/935794413 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480c3c20 con 0x7f6d480cbc30 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4dcfc700 1 --2- 172.21.15.19:0/935794413 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480cbc30 0x7f6d480ca2e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009910 tx=0x7f6d380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf8fd83ffb40142f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ccfa700 1 -- 172.21.15.19:0/935794413 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38011630 con 0x7f6d480cbc30 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ccfa700 1 -- 172.21.15.19:0/935794413 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d38011790 con 0x7f6d480cbc30 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ccfa700 1 -- 172.21.15.19:0/935794413 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38011b10 con 0x7f6d480cbc30 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ff60700 1 -- 172.21.15.19:0/935794413 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480cbc30 msgr2=0x7f6d480ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ff60700 1 --2- 172.21.15.19:0/935794413 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480cbc30 0x7f6d480ca2e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009910 tx=0x7f6d380091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ff60700 1 -- 172.21.15.19:0/935794413 shutdown_connections 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ff60700 1 --2- 172.21.15.19:0/935794413 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480cbc30 0x7f6d480ca2e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ff60700 1 -- 172.21.15.19:0/935794413 >> 172.21.15.19:0/935794413 conn(0x7f6d480caad0 msgr2=0x7f6d480caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ff60700 1 -- 172.21.15.19:0/935794413 shutdown_connections 2024-08-17T02:26:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.299+0000 7f6d4ff60700 1 -- 172.21.15.19:0/935794413 wait complete. 2024-08-17T02:26:55.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 Processor -- start 2024-08-17T02:26:55.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 -- start start 2024-08-17T02:26:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480ad6e0 0x7f6d4813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d480adb30 0x7f6d480af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d480cbc30 0x7f6d480afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48169bf0 con 0x7f6d480cbc30 2024-08-17T02:26:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48068f80 con 0x7f6d480adb30 2024-08-17T02:26:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480b2750 con 0x7f6d480ad6e0 2024-08-17T02:26:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4e4fd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d480cbc30 0x7f6d480afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4e4fd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d480cbc30 0x7f6d480afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59610/0 (socket says 172.21.15.19:59610) 2024-08-17T02:26:55.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4e4fd700 1 -- 172.21.15.19:0/2876152603 learned_addr learned my addr 172.21.15.19:0/2876152603 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:55.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4dcfc700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480ad6e0 0x7f6d4813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4d4fb700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d480adb30 0x7f6d480af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4e4fd700 1 -- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480ad6e0 msgr2=0x7f6d4813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4e4fd700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480ad6e0 0x7f6d4813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4e4fd700 1 -- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d480adb30 msgr2=0x7f6d480af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4e4fd700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d480adb30 0x7f6d480af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4e4fd700 1 -- 172.21.15.19:0/2876152603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38009420 con 0x7f6d480cbc30 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4dcfc700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480ad6e0 0x7f6d4813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4e4fd700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d480cbc30 0x7f6d480afa60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c940 tx=0x7f6d40007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d3dffb700 1 -- 172.21.15.19:0/2876152603 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40012630 con 0x7f6d480cbc30 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d3dffb700 1 -- 172.21.15.19:0/2876152603 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d400127b0 con 0x7f6d480cbc30 2024-08-17T02:26:55.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d480b1eb0 con 0x7f6d480cbc30 2024-08-17T02:26:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d3dffb700 1 -- 172.21.15.19:0/2876152603 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40012b70 con 0x7f6d480cbc30 2024-08-17T02:26:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.303+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d480b2470 con 0x7f6d480cbc30 2024-08-17T02:26:55.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.307+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d48068d50 con 0x7f6d480cbc30 2024-08-17T02:26:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.307+0000 7f6d3dffb700 1 -- 172.21.15.19:0/2876152603 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6d4001b400 con 0x7f6d480cbc30 2024-08-17T02:26:55.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.307+0000 7f6d3dffb700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6d2c060860 0x7f6d2c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.307+0000 7f6d3dffb700 1 -- 172.21.15.19:0/2876152603 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d4007ced0 con 0x7f6d480cbc30 2024-08-17T02:26:55.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.307+0000 7f6d4dcfc700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6d2c060860 0x7f6d2c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.307+0000 7f6d4dcfc700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6d2c060860 0x7f6d2c062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009860 tx=0x7f6d38017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.311+0000 7f6d3dffb700 1 -- 172.21.15.19:0/2876152603 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6d48068d50 con 0x7f6d480cbc30 2024-08-17T02:26:55.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.475+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d48069130 con 0x7f6d480cbc30 2024-08-17T02:26:55.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.475+0000 7f6d3dffb700 1 -- 172.21.15.19:0/2876152603 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d48069130 con 0x7f6d480cbc30 2024-08-17T02:26:55.481 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-08-17T02:26:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6d2c060860 msgr2=0x7f6d2c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6d2c060860 0x7f6d2c062d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009860 tx=0x7f6d38017000 comp rx=0 tx=0).stop 2024-08-17T02:26:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d480cbc30 msgr2=0x7f6d480afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d480cbc30 0x7f6d480afa60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c940 tx=0x7f6d40007f90 comp rx=0 tx=0).stop 2024-08-17T02:26:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 shutdown_connections 2024-08-17T02:26:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6d2c060860 0x7f6d2c062d10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d480cbc30 0x7f6d480afa60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d480adb30 0x7f6d480af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 --2- 172.21.15.19:0/2876152603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d480ad6e0 0x7f6d4813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 >> 172.21.15.19:0/2876152603 conn(0x7f6d480caad0 msgr2=0x7f6d480ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 shutdown_connections 2024-08-17T02:26:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.479+0000 7f6d4ff60700 1 -- 172.21.15.19:0/2876152603 wait complete. 2024-08-17T02:26:55.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.595+0000 7fdcda1fe700 1 Processor -- start 2024-08-17T02:26:55.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.595+0000 7fdcda1fe700 1 -- start start 2024-08-17T02:26:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.595+0000 7fdcda1fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcd40688d0 0x7fdcd4068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.595+0000 7fdcda1fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdcd40cc160 0x7fdcd40caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.595+0000 7fdcda1fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd406a470 0x7fdcd406a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.595+0000 7fdcda1fe700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd40cb220 con 0x7fdcd40688d0 2024-08-17T02:26:55.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.595+0000 7fdcda1fe700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd40c7750 con 0x7fdcd40cc160 2024-08-17T02:26:55.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.595+0000 7fdcda1fe700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40caf80 con 0x7fdcd406a470 2024-08-17T02:26:55.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.595+0000 7fdcd37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcd40688d0 0x7fdcd4068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd406a470 0x7fdcd406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd2ffd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdcd40cc160 0x7fdcd40caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcd40688d0 0x7fdcd4068ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59622/0 (socket says 172.21.15.19:59622) 2024-08-17T02:26:55.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd406a470 0x7fdcd406a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:47098/0 (socket says 172.21.15.19:47098) 2024-08-17T02:26:55.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd37fe700 1 -- 172.21.15.19:0/1785726117 learned_addr learned my addr 172.21.15.19:0/1785726117 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd37fe700 1 -- 172.21.15.19:0/1785726117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd406a470 msgr2=0x7fdcd406a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd37fe700 1 --2- 172.21.15.19:0/1785726117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd406a470 0x7fdcd406a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd37fe700 1 -- 172.21.15.19:0/1785726117 >> v2:172.21.15.119:3300/0 conn(0x7fdcd40cc160 msgr2=0x7fdcd40caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd37fe700 1 --2- 172.21.15.19:0/1785726117 >> v2:172.21.15.119:3300/0 conn(0x7fdcd40cc160 0x7fdcd40caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd37fe700 1 -- 172.21.15.19:0/1785726117 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40c6e20 con 0x7fdcd40688d0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd37fe700 1 --2- 172.21.15.19:0/1785726117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40688d0 0x7fdcd4068ca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4069320 tx=0x7fdcc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472afd0a11ea927d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd27fc700 1 -- 172.21.15.19:0/1785726117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400b640 con 0x7fdcd40688d0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd27fc700 1 -- 172.21.15.19:0/1785726117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc400b7a0 con 0x7fdcd40688d0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcd27fc700 1 -- 172.21.15.19:0/1785726117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400bb60 con 0x7fdcd40688d0 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcda1fe700 1 -- 172.21.15.19:0/1785726117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40688d0 msgr2=0x7fdcd4068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/1785726117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40688d0 0x7fdcd4068ca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4069320 tx=0x7fdcc4009250 comp rx=0 tx=0).stop 2024-08-17T02:26:55.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcda1fe700 1 -- 172.21.15.19:0/1785726117 shutdown_connections 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/1785726117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd406a470 0x7fdcd406a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/1785726117 >> v2:172.21.15.119:3300/0 conn(0x7fdcd40cc160 0x7fdcd40caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/1785726117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40688d0 0x7fdcd4068ca0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcda1fe700 1 -- 172.21.15.19:0/1785726117 >> 172.21.15.19:0/1785726117 conn(0x7fdcd40c9c20 msgr2=0x7fdcd406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcda1fe700 1 -- 172.21.15.19:0/1785726117 shutdown_connections 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.599+0000 7fdcda1fe700 1 -- 172.21.15.19:0/1785726117 wait complete. 2024-08-17T02:26:55.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 Processor -- start 2024-08-17T02:26:55.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 -- start start 2024-08-17T02:26:55.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd40688d0 0x7fdcd41530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd406a470 0x7fdcd4154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40cc160 0x7fdcd41554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40aeb30 con 0x7fdcd40cc160 2024-08-17T02:26:55.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40ac920 con 0x7fdcd406a470 2024-08-17T02:26:55.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40acc00 con 0x7fdcd40688d0 2024-08-17T02:26:55.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40cc160 0x7fdcd41554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40cc160 0x7fdcd41554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59630/0 (socket says 172.21.15.19:59630) 2024-08-17T02:26:55.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd3fff700 1 -- 172.21.15.19:0/3695936687 learned_addr learned my addr 172.21.15.19:0/3695936687 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:55.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd2ffd700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd406a470 0x7fdcd4154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd37fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd40688d0 0x7fdcd41530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd3fff700 1 -- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd40688d0 msgr2=0x7fdcd41530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd3fff700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd40688d0 0x7fdcd41530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd3fff700 1 -- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd406a470 msgr2=0x7fdcd4154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd3fff700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd406a470 0x7fdcd4154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd3fff700 1 -- 172.21.15.19:0/3695936687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40094f0 con 0x7fdcd40cc160 2024-08-17T02:26:55.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcd3fff700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40cc160 0x7fdcd41554b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009df0 tx=0x7fdccc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcbb7fe700 1 -- 172.21.15.19:0/3695936687 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc00cb30 con 0x7fdcd40cc160 2024-08-17T02:26:55.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcbb7fe700 1 -- 172.21.15.19:0/3695936687 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc00f040 con 0x7fdcd40cc160 2024-08-17T02:26:55.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd40acee0 con 0x7fdcd40cc160 2024-08-17T02:26:55.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcbb7fe700 1 -- 172.21.15.19:0/3695936687 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc014480 con 0x7fdcd40cc160 2024-08-17T02:26:55.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.603+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd40ad4a0 con 0x7fdcd40cc160 2024-08-17T02:26:55.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.607+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4159470 con 0x7fdcd40cc160 2024-08-17T02:26:55.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.607+0000 7fdcbb7fe700 1 -- 172.21.15.19:0/3695936687 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdccc014830 con 0x7fdcd40cc160 2024-08-17T02:26:55.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.607+0000 7fdcbb7fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdcc0060890 0x7fdcc0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.607+0000 7fdcbb7fe700 1 -- 172.21.15.19:0/3695936687 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdccc07d470 con 0x7fdcd40cc160 2024-08-17T02:26:55.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.607+0000 7fdcd37fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdcc0060890 0x7fdcc0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.607+0000 7fdcd37fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdcc0060890 0x7fdcc0062d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4069320 tx=0x7fdcc4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.615+0000 7fdcbb7fe700 1 -- 172.21.15.19:0/3695936687 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdccc04d820 con 0x7fdcd40cc160 2024-08-17T02:26:55.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.775+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcd40645c0 con 0x7fdcd40cc160 2024-08-17T02:26:55.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.775+0000 7fdcbb7fe700 1 -- 172.21.15.19:0/3695936687 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fdccc050e40 con 0x7fdcd40cc160 2024-08-17T02:26:55.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:55.782 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdcc0060890 msgr2=0x7fdcc0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdcc0060890 0x7fdcc0062d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4069320 tx=0x7fdcc4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40cc160 msgr2=0x7fdcd41554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40cc160 0x7fdcd41554b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009df0 tx=0x7fdccc00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 shutdown_connections 2024-08-17T02:26:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdcc0060890 0x7fdcc0062d40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd40cc160 0x7fdcd41554b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcd406a470 0x7fdcd4154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 --2- 172.21.15.19:0/3695936687 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcd40688d0 0x7fdcd41530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 >> 172.21.15.19:0/3695936687 conn(0x7fdcd40c9c20 msgr2=0x7fdcd406b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 shutdown_connections 2024-08-17T02:26:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.779+0000 7fdcda1fe700 1 -- 172.21.15.19:0/3695936687 wait complete. 2024-08-17T02:26:55.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:27.555224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:27.958499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:55.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:55.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.911+0000 7f593edcc700 1 Processor -- start 2024-08-17T02:26:55.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.911+0000 7f593edcc700 1 -- start start 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5938140910 0x7f59380c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59380cbab0 0x7f59380cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59380c2c80 0x7f59380c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59380cc450 con 0x7f59380cbab0 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59380c3e30 con 0x7f5938140910 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59380c4110 con 0x7f59380c2c80 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593d5c9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59380cbab0 0x7f59380cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593d5c9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59380cbab0 0x7f59380cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59634/0 (socket says 172.21.15.19:59634) 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593d5c9700 1 -- 172.21.15.19:0/1642228613 learned_addr learned my addr 172.21.15.19:0/1642228613 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593ddca700 1 --2- 172.21.15.19:0/1642228613 >> v2:172.21.15.119:3300/0 conn(0x7f5938140910 0x7f59380c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593e5cb700 1 --2- 172.21.15.19:0/1642228613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59380c2c80 0x7f59380c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593d5c9700 1 -- 172.21.15.19:0/1642228613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59380c2c80 msgr2=0x7f59380c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593d5c9700 1 --2- 172.21.15.19:0/1642228613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59380c2c80 0x7f59380c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593d5c9700 1 -- 172.21.15.19:0/1642228613 >> v2:172.21.15.119:3300/0 conn(0x7f5938140910 msgr2=0x7f59380c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593d5c9700 1 --2- 172.21.15.19:0/1642228613 >> v2:172.21.15.119:3300/0 conn(0x7f5938140910 0x7f59380c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593d5c9700 1 -- 172.21.15.19:0/1642228613 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59380c43f0 con 0x7f59380cbab0 2024-08-17T02:26:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593ddca700 1 --2- 172.21.15.19:0/1642228613 >> v2:172.21.15.119:3300/0 conn(0x7f5938140910 0x7f59380c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593d5c9700 1 --2- 172.21.15.19:0/1642228613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 0x7f59380cbf10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f593806e260 tx=0x7f592c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e62936859edc896 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593cdc8700 1 -- 172.21.15.19:0/1642228613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00b640 con 0x7f59380cbab0 2024-08-17T02:26:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593cdc8700 1 -- 172.21.15.19:0/1642228613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c00b7a0 con 0x7f59380cbab0 2024-08-17T02:26:55.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593cdc8700 1 -- 172.21.15.19:0/1642228613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00bb60 con 0x7f59380cbab0 2024-08-17T02:26:55.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 -- 172.21.15.19:0/1642228613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 msgr2=0x7f59380cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 --2- 172.21.15.19:0/1642228613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 0x7f59380cbf10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f593806e260 tx=0x7f592c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:55.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 -- 172.21.15.19:0/1642228613 shutdown_connections 2024-08-17T02:26:55.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 --2- 172.21.15.19:0/1642228613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 0x7f59380cbf10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 --2- 172.21.15.19:0/1642228613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59380c2c80 0x7f59380c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 --2- 172.21.15.19:0/1642228613 >> v2:172.21.15.119:3300/0 conn(0x7f5938140910 0x7f59380c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 -- 172.21.15.19:0/1642228613 >> 172.21.15.19:0/1642228613 conn(0x7f59380cdee0 msgr2=0x7f59380ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 -- 172.21.15.19:0/1642228613 shutdown_connections 2024-08-17T02:26:55.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.915+0000 7f593edcc700 1 -- 172.21.15.19:0/1642228613 wait complete. 2024-08-17T02:26:55.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593edcc700 1 Processor -- start 2024-08-17T02:26:55.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593edcc700 1 -- start start 2024-08-17T02:26:55.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593edcc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59380c2c80 0x7f5938155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593edcc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 0x7f59380c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593edcc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5938140910 0x7f5938159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593edcc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59381569f0 con 0x7f59380cbab0 2024-08-17T02:26:55.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593edcc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59380c5680 con 0x7f59380c2c80 2024-08-17T02:26:55.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593edcc700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59380c79f0 con 0x7f5938140910 2024-08-17T02:26:55.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593d5c9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 0x7f59380c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593d5c9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 0x7f59380c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59636/0 (socket says 172.21.15.19:59636) 2024-08-17T02:26:55.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.919+0000 7f593d5c9700 1 -- 172.21.15.19:0/3720637595 learned_addr learned my addr 172.21.15.19:0/3720637595 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:55.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593e5cb700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5938140910 0x7f5938159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593ddca700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59380c2c80 0x7f5938155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593d5c9700 1 -- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5938140910 msgr2=0x7f5938159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593d5c9700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5938140910 0x7f5938159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593d5c9700 1 -- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59380c2c80 msgr2=0x7f5938155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593d5c9700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59380c2c80 0x7f5938155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593d5c9700 1 -- 172.21.15.19:0/3720637595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5934009420 con 0x7f59380cbab0 2024-08-17T02:26:55.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593d5c9700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 0x7f59380c5b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f593806fbe0 tx=0x7f592c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f5929ffb700 1 -- 172.21.15.19:0/3720637595 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00b910 con 0x7f59380cbab0 2024-08-17T02:26:55.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f5929ffb700 1 -- 172.21.15.19:0/3720637595 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c00ba70 con 0x7f59380cbab0 2024-08-17T02:26:55.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0094f0 con 0x7f59380cbab0 2024-08-17T02:26:55.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f5929ffb700 1 -- 172.21.15.19:0/3720637595 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c011630 con 0x7f59380cbab0 2024-08-17T02:26:55.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59380c5030 con 0x7f59380cbab0 2024-08-17T02:26:55.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.923+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59380638f0 con 0x7f59380cbab0 2024-08-17T02:26:55.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.927+0000 7f5929ffb700 1 -- 172.21.15.19:0/3720637595 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f592c0119a0 con 0x7f59380cbab0 2024-08-17T02:26:55.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.927+0000 7f5929ffb700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f591c060860 0x7f591c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.927+0000 7f5929ffb700 1 -- 172.21.15.19:0/3720637595 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f592c07de70 con 0x7f59380cbab0 2024-08-17T02:26:55.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.927+0000 7f593ddca700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f591c060860 0x7f591c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.927+0000 7f593ddca700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f591c060860 0x7f591c062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5934009f40 tx=0x7f59340091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:55.939+0000 7f5929ffb700 1 -- 172.21.15.19:0/3720637595 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f592c04e350 con 0x7f59380cbab0 2024-08-17T02:26:56.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.103+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59380c57c0 con 0x7f59380cbab0 2024-08-17T02:26:56.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f5929ffb700 1 -- 172.21.15.19:0/3720637595 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f592c051970 con 0x7f59380cbab0 2024-08-17T02:26:56.110 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:26:56.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f591c060860 msgr2=0x7f591c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f591c060860 0x7f591c062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5934009f40 tx=0x7f59340091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 msgr2=0x7f59380c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 0x7f59380c5b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f593806fbe0 tx=0x7f592c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:56.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 shutdown_connections 2024-08-17T02:26:56.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f591c060860 0x7f591c062d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5938140910 0x7f5938159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59380cbab0 0x7f59380c5b10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 --2- 172.21.15.19:0/3720637595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59380c2c80 0x7f5938155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 >> 172.21.15.19:0/3720637595 conn(0x7f59380cdee0 msgr2=0x7f59380cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 shutdown_connections 2024-08-17T02:26:56.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.107+0000 7f593edcc700 1 -- 172.21.15.19:0/3720637595 wait complete. 2024-08-17T02:26:56.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.231+0000 7ff30b59e700 1 Processor -- start 2024-08-17T02:26:56.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30b59e700 1 -- start start 2024-08-17T02:26:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30b59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 0x7ff30c0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30b59e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff30c0ae6f0 0x7ff30c0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30b59e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30c0cc440 con 0x7ff30c0cbab0 2024-08-17T02:26:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30b59e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30c0c3e30 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30b59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0c4110 con 0x7ff30c140910 2024-08-17T02:26:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff30c0ae6f0 0x7ff30c0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff309d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff30c0cbab0 0x7ff30c0c2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39604/0 (socket says 172.21.15.19:39604) 2024-08-17T02:26:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff309d9b700 1 -- 172.21.15.19:0/2539558932 learned_addr learned my addr 172.21.15.19:0/2539558932 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30a59c700 1 --2- 172.21.15.19:0/2539558932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 0x7ff30c0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30ad9d700 1 -- 172.21.15.19:0/2539558932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 msgr2=0x7ff30c0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30ad9d700 1 --2- 172.21.15.19:0/2539558932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 0x7ff30c0c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30ad9d700 1 -- 172.21.15.19:0/2539558932 >> v1:172.21.15.19:6789/0 conn(0x7ff30c0cbab0 legacy=0x7ff30c0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30ad9d700 1 -- 172.21.15.19:0/2539558932 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c0c43f0 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30959a700 1 -- 172.21.15.19:0/2539558932 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675200445 0 0) 0x7ff30c0cc440 con 0x7ff30c0cbab0 2024-08-17T02:26:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30a59c700 1 --2- 172.21.15.19:0/2539558932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 0x7ff30c0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30ad9d700 1 --2- 172.21.15.19:0/2539558932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 0x7ff30c0cbf00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff304009e60 tx=0x7ff304009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2230ac9f4a67e954 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30959a700 1 -- 172.21.15.19:0/2539558932 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30400e070 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30959a700 1 -- 172.21.15.19:0/2539558932 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30400bc30 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.235+0000 7ff30959a700 1 -- 172.21.15.19:0/2539558932 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304012430 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 -- 172.21.15.19:0/2539558932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 msgr2=0x7ff30c0cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 --2- 172.21.15.19:0/2539558932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 0x7ff30c0cbf00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff304009e60 tx=0x7ff304009780 comp rx=0 tx=0).stop 2024-08-17T02:26:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 -- 172.21.15.19:0/2539558932 shutdown_connections 2024-08-17T02:26:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 --2- 172.21.15.19:0/2539558932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 0x7ff30c0cbf00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 --2- 172.21.15.19:0/2539558932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 0x7ff30c0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 -- 172.21.15.19:0/2539558932 >> 172.21.15.19:0/2539558932 conn(0x7ff30c0cdee0 msgr2=0x7ff30c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 -- 172.21.15.19:0/2539558932 shutdown_connections 2024-08-17T02:26:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 -- 172.21.15.19:0/2539558932 wait complete. 2024-08-17T02:26:56.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 Processor -- start 2024-08-17T02:26:56.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 -- start start 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 0x7ff30c0a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c0cbab0 0x7ff30c0a8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 0x7ff30c16a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0a86a0 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0a5f20 con 0x7ff30c0cbab0 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.239+0000 7ff30b59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0a55f0 con 0x7ff30c140910 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 0x7ff30c0a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 0x7ff30c0a7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59656/0 (socket says 172.21.15.19:59656) 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30a59c700 1 -- 172.21.15.19:0/3202072620 learned_addr learned my addr 172.21.15.19:0/3202072620 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30ad9d700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 0x7ff30c16a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff309d9b700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c0cbab0 0x7ff30c0a8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30a59c700 1 -- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 msgr2=0x7ff30c16a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30a59c700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 0x7ff30c16a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30a59c700 1 -- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c0cbab0 msgr2=0x7ff30c0a8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30a59c700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c0cbab0 0x7ff30c0a8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30a59c700 1 -- 172.21.15.19:0/3202072620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304009a20 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30a59c700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 0x7ff30c0a7c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d860 tx=0x7ff2f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff3027fc700 1 -- 172.21.15.19:0/3202072620 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40125f0 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff3027fc700 1 -- 172.21.15.19:0/3202072620 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f4012750 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30c0a58d0 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c16abc0 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff3027fc700 1 -- 172.21.15.19:0/3202072620 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4012af0 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f00052b0 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.243+0000 7ff3027fc700 1 -- 172.21.15.19:0/3202072620 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff2f4013480 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.247+0000 7ff3027fc700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff2ec060860 0x7ff2ec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.247+0000 7ff3027fc700 1 -- 172.21.15.19:0/3202072620 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2f407ccc0 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.247+0000 7ff309d9b700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff2ec060860 0x7ff2ec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.247+0000 7ff309d9b700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff2ec060860 0x7ff2ec062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff30c1380d0 tx=0x7ff2fc007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.255+0000 7ff3027fc700 1 -- 172.21.15.19:0/3202072620 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff2f404d110 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.415+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2f0005ae0 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.415+0000 7ff3027fc700 1 -- 172.21.15.19:0/3202072620 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff2f4050730 con 0x7ff30c0ae6f0 2024-08-17T02:26:56.422 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:26:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff2ec060860 msgr2=0x7ff2ec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff2ec060860 0x7ff2ec062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff30c1380d0 tx=0x7ff2fc007d30 comp rx=0 tx=0).stop 2024-08-17T02:26:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 msgr2=0x7ff30c0a7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 0x7ff30c0a7c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d860 tx=0x7ff2f4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 shutdown_connections 2024-08-17T02:26:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff2ec060860 0x7ff2ec062d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff30c140910 0x7ff30c16a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff30c0cbab0 0x7ff30c0a8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 --2- 172.21.15.19:0/3202072620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff30c0ae6f0 0x7ff30c0a7c20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 >> 172.21.15.19:0/3202072620 conn(0x7ff30c0cdee0 msgr2=0x7ff30c06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.419+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 shutdown_connections 2024-08-17T02:26:56.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.423+0000 7ff30b59e700 1 -- 172.21.15.19:0/3202072620 wait complete. 2024-08-17T02:26:56.440 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:56.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:56.474 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:56.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe1147c700 1 Processor -- start 2024-08-17T02:26:56.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe1147c700 1 -- start start 2024-08-17T02:26:56.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe1147c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe0c159300 0x7fbe0c0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe1147c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbe0c1596d0 0x7fbe0c066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe1147c700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c0cba90 con 0x7fbe0c15dbc0 2024-08-17T02:26:56.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe1147c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0b2b60 con 0x7fbe0c159300 2024-08-17T02:26:56.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe1147c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0cb160 con 0x7fbe0c1596d0 2024-08-17T02:26:56.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe0affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe0c159300 0x7fbe0c0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe0affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe0c159300 0x7fbe0c0b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59664/0 (socket says 172.21.15.19:59664) 2024-08-17T02:26:56.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe0affd700 1 -- 172.21.15.19:0/3795877065 learned_addr learned my addr 172.21.15.19:0/3795877065 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:56.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.551+0000 7fbe0a7fc700 1 --2- 172.21.15.19:0/3795877065 >> v2:172.21.15.119:3300/0 conn(0x7fbe0c1596d0 0x7fbe0c066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe0affd700 1 -- 172.21.15.19:0/3795877065 >> v2:172.21.15.119:3300/0 conn(0x7fbe0c1596d0 msgr2=0x7fbe0c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe0affd700 1 --2- 172.21.15.19:0/3795877065 >> v2:172.21.15.119:3300/0 conn(0x7fbe0c1596d0 0x7fbe0c066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe0affd700 1 -- 172.21.15.19:0/3795877065 >> v1:172.21.15.119:6789/0 conn(0x7fbe0c15dbc0 legacy=0x7fbe0c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe0affd700 1 -- 172.21.15.19:0/3795877065 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0cb440 con 0x7fbe0c159300 2024-08-17T02:26:56.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe0affd700 1 --2- 172.21.15.19:0/3795877065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 0x7fbe0c0b2230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0b2d20 tx=0x7fbe00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94196667cec13585 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe09ffb700 1 -- 172.21.15.19:0/3795877065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00009e70 con 0x7fbe0c159300 2024-08-17T02:26:56.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe09ffb700 1 -- 172.21.15.19:0/3795877065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0000b860 con 0x7fbe0c159300 2024-08-17T02:26:56.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe09ffb700 1 -- 172.21.15.19:0/3795877065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000bc00 con 0x7fbe0c159300 2024-08-17T02:26:56.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe1147c700 1 -- 172.21.15.19:0/3795877065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 msgr2=0x7fbe0c0b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe1147c700 1 --2- 172.21.15.19:0/3795877065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 0x7fbe0c0b2230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0b2d20 tx=0x7fbe00009250 comp rx=0 tx=0).stop 2024-08-17T02:26:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe1147c700 1 -- 172.21.15.19:0/3795877065 shutdown_connections 2024-08-17T02:26:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe1147c700 1 --2- 172.21.15.19:0/3795877065 >> v2:172.21.15.119:3300/0 conn(0x7fbe0c1596d0 0x7fbe0c066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe1147c700 1 --2- 172.21.15.19:0/3795877065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 0x7fbe0c0b2230 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe1147c700 1 -- 172.21.15.19:0/3795877065 >> 172.21.15.19:0/3795877065 conn(0x7fbe0c0682c0 msgr2=0x7fbe0c0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe1147c700 1 -- 172.21.15.19:0/3795877065 shutdown_connections 2024-08-17T02:26:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.555+0000 7fbe1147c700 1 -- 172.21.15.19:0/3795877065 wait complete. 2024-08-17T02:26:56.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.559+0000 7fbe1147c700 1 Processor -- start 2024-08-17T02:26:56.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.559+0000 7fbe1147c700 1 -- start start 2024-08-17T02:26:56.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.559+0000 7fbe1147c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 0x7fbe0c0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.559+0000 7fbe1147c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe0c1596d0 0x7fbe0c16c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.559+0000 7fbe1147c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe0c15dbc0 0x7fbe0c16d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.559+0000 7fbe1147c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c54e0 con 0x7fbe0c159300 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.559+0000 7fbe1147c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c4ed0 con 0x7fbe0c1596d0 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.559+0000 7fbe1147c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0ca000 con 0x7fbe0c15dbc0 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 0x7fbe0c0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 0x7fbe0c0c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59670/0 (socket says 172.21.15.19:59670) 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0affd700 1 -- 172.21.15.19:0/908009411 learned_addr learned my addr 172.21.15.19:0/908009411 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0a7fc700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe0c1596d0 0x7fbe0c16c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0b7fe700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe0c15dbc0 0x7fbe0c16d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0affd700 1 -- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe0c15dbc0 msgr2=0x7fbe0c16d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0affd700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe0c15dbc0 0x7fbe0c16d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0affd700 1 -- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe0c1596d0 msgr2=0x7fbe0c16c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0affd700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe0c1596d0 0x7fbe0c16c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0affd700 1 -- 172.21.15.19:0/908009411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe000094f0 con 0x7fbe0c159300 2024-08-17T02:26:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe0affd700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 0x7fbe0c0c9720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cde20 tx=0x7fbe00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbdf2ffd700 1 -- 172.21.15.19:0/908009411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000bbe0 con 0x7fbe0c159300 2024-08-17T02:26:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbdf2ffd700 1 -- 172.21.15.19:0/908009411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00011420 con 0x7fbe0c159300 2024-08-17T02:26:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c0c5170 con 0x7fbe0c159300 2024-08-17T02:26:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbdf2ffd700 1 -- 172.21.15.19:0/908009411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000117c0 con 0x7fbe0c159300 2024-08-17T02:26:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c0c9c60 con 0x7fbe0c159300 2024-08-17T02:26:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c0645c0 con 0x7fbe0c159300 2024-08-17T02:26:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.563+0000 7fbdf2ffd700 1 -- 172.21.15.19:0/908009411 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbe00011bf0 con 0x7fbe0c159300 2024-08-17T02:26:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.567+0000 7fbdf2ffd700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdf8060860 0x7fbdf8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.567+0000 7fbdf2ffd700 1 -- 172.21.15.19:0/908009411 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe0007dfb0 con 0x7fbe0c159300 2024-08-17T02:26:56.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.567+0000 7fbe0a7fc700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdf8060860 0x7fbdf8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.567+0000 7fbe0a7fc700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdf8060860 0x7fbdf8062d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cd100 tx=0x7fbdfc0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.571+0000 7fbdf2ffd700 1 -- 172.21.15.19:0/908009411 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbe000ae480 con 0x7fbe0c159300 2024-08-17T02:26:56.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.739+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe0c0cf4c0 con 0x7fbe0c159300 2024-08-17T02:26:56.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbdf2ffd700 1 -- 172.21.15.19:0/908009411 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe0004e400 con 0x7fbe0c159300 2024-08-17T02:26:56.746 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdf8060860 msgr2=0x7fbdf8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdf8060860 0x7fbdf8062d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cd100 tx=0x7fbdfc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 msgr2=0x7fbe0c0c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 0x7fbe0c0c9720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cde20 tx=0x7fbe00017000 comp rx=0 tx=0).stop 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 shutdown_connections 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbdf8060860 0x7fbdf8062d10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe0c15dbc0 0x7fbe0c16d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe0c1596d0 0x7fbe0c16c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 --2- 172.21.15.19:0/908009411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe0c159300 0x7fbe0c0c9720 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 >> 172.21.15.19:0/908009411 conn(0x7fbe0c0682c0 msgr2=0x7fbe0c0ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 shutdown_connections 2024-08-17T02:26:56.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.743+0000 7fbe1147c700 1 -- 172.21.15.19:0/908009411 wait complete. 2024-08-17T02:26:56.833 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:26:56.833 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:26:56.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:56.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.943+0000 7f2395ab4700 1 Processor -- start 2024-08-17T02:26:56.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f2395ab4700 1 -- start start 2024-08-17T02:26:56.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f2395ab4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23900686a0 0x7f2390068b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f2395ab4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f23900ad810 0x7f23900adc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f2395ab4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2390069050 con 0x7f2390153020 2024-08-17T02:26:56.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f2395ab4700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2390156a00 con 0x7f23900ad810 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f2395ab4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2390155b30 con 0x7f23900686a0 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f2394ab2700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2390153020 0x7f23900b1d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39612/0 (socket says 172.21.15.19:39612) 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f2394ab2700 1 -- 172.21.15.19:0/594343725 learned_addr learned my addr 172.21.15.19:0/594343725 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f2387fff700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23900686a0 0x7f2390068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23952b3700 1 --2- 172.21.15.19:0/594343725 >> v2:172.21.15.119:3300/0 conn(0x7f23900ad810 0x7f23900adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007075478 0 0) 0x7f2390069050 con 0x7f2390153020 2024-08-17T02:26:56.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2378003570 con 0x7f2390153020 2024-08-17T02:26:56.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1679603883 0 0) 0x7f2378003570 con 0x7f2390153020 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23900686a0 msgr2=0x7f2390068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23900686a0 0x7f2390068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 >> v2:172.21.15.119:3300/0 conn(0x7f23900ad810 msgr2=0x7f23900adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 --2- 172.21.15.19:0/594343725 >> v2:172.21.15.119:3300/0 conn(0x7f23900ad810 0x7f23900adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2390155df0 con 0x7f2390153020 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f238c001470 con 0x7f2390153020 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 >> v1:172.21.15.19:6789/0 conn(0x7f2390153020 legacy=0x7f23900b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2378003a60 0x7f2378003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23900686a0 0x7f2378004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2378004d50 0x7f23780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390156a00 con 0x7f2378004d50 2024-08-17T02:26:56.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390155b30 con 0x7f2378003a60 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.947+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237800ba60 con 0x7f23900686a0 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23952b3700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2378004d50 0x7f23780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2394ab2700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2378003a60 0x7f2378003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2387fff700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23900686a0 0x7f2378004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23952b3700 1 -- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23900686a0 msgr2=0x7f2378004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23952b3700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23900686a0 0x7f2378004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23952b3700 1 -- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2378003a60 msgr2=0x7f2378003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23952b3700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2378003a60 0x7f2378003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23952b3700 1 -- 172.21.15.19:0/594343725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378003570 con 0x7f2378004d50 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23952b3700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2378004d50 0x7f23780051c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f238800f3c0 tx=0x7f238800c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befcc5038de4d041 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800a0d0 con 0x7f2378004d50 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2388010040 con 0x7f2378004d50 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23877fe700 1 -- 172.21.15.19:0/594343725 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238800fbb0 con 0x7f2378004d50 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2395ab4700 1 -- 172.21.15.19:0/594343725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2378004d50 msgr2=0x7f23780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2395ab4700 1 --2- 172.21.15.19:0/594343725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2378004d50 0x7f23780051c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f238800f3c0 tx=0x7f238800c040 comp rx=0 tx=0).stop 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f23952b3700 1 -- 172.21.15.19:0/594343725 reap_dead start 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2395ab4700 1 -- 172.21.15.19:0/594343725 shutdown_connections 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2395ab4700 1 -- 172.21.15.19:0/594343725 >> 172.21.15.19:0/594343725 conn(0x7f239006d870 msgr2=0x7f239006dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2395ab4700 1 -- 172.21.15.19:0/594343725 shutdown_connections 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2395ab4700 1 -- 172.21.15.19:0/594343725 wait complete. 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2395ab4700 1 Processor -- start 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.951+0000 7f2395ab4700 1 -- start start 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2395ab4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f239014ce20 0x7f239014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2395ab4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239014e450 0x7f23901653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2395ab4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23901658e0 0x7f23900adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2395ab4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239014d1f0 con 0x7f239014e450 2024-08-17T02:26:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2395ab4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900a5450 con 0x7f239014ce20 2024-08-17T02:26:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2395ab4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900a56a0 con 0x7f23901658e0 2024-08-17T02:26:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2387fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239014e450 0x7f23901653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2387fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239014e450 0x7f23901653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59696/0 (socket says 172.21.15.19:59696) 2024-08-17T02:26:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2387fff700 1 -- 172.21.15.19:0/525589572 learned_addr learned my addr 172.21.15.19:0/525589572 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2394ab2700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f239014ce20 0x7f239014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f23952b3700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23901658e0 0x7f23900adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2387fff700 1 -- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23901658e0 msgr2=0x7f23900adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2387fff700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23901658e0 0x7f23900adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2387fff700 1 -- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f239014ce20 msgr2=0x7f239014df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2387fff700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f239014ce20 0x7f239014df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2387fff700 1 -- 172.21.15.19:0/525589572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900a5980 con 0x7f239014e450 2024-08-17T02:26:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2387fff700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239014e450 0x7f23901653a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2380006ac0 tx=0x7f23800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2384ff9700 1 -- 172.21.15.19:0/525589572 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238000f940 con 0x7f239014e450 2024-08-17T02:26:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2384ff9700 1 -- 172.21.15.19:0/525589572 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238000faa0 con 0x7f239014e450 2024-08-17T02:26:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23900a5c60 con 0x7f239014e450 2024-08-17T02:26:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2384ff9700 1 -- 172.21.15.19:0/525589572 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238000fe20 con 0x7f239014e450 2024-08-17T02:26:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23900a6220 con 0x7f239014e450 2024-08-17T02:26:56.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.955+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23900638f0 con 0x7f239014e450 2024-08-17T02:26:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.959+0000 7f2384ff9700 1 -- 172.21.15.19:0/525589572 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2380014750 con 0x7f239014e450 2024-08-17T02:26:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.959+0000 7f2384ff9700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f237c060860 0x7f237c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.959+0000 7f2384ff9700 1 -- 172.21.15.19:0/525589572 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f238007f260 con 0x7f239014e450 2024-08-17T02:26:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.959+0000 7f2394ab2700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f237c060860 0x7f237c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.959+0000 7f2394ab2700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f237c060860 0x7f237c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f238c001c40 tx=0x7f2390156b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:56.967+0000 7f2384ff9700 1 -- 172.21.15.19:0/525589572 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f238004f610 con 0x7f239014e450 2024-08-17T02:26:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.135+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f239014d330 con 0x7f239014e450 2024-08-17T02:26:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.135+0000 7f2384ff9700 1 -- 172.21.15.19:0/525589572 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f2380052c30 con 0x7f239014e450 2024-08-17T02:26:57.142 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:57.142 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:57.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f237c060860 msgr2=0x7f237c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f237c060860 0x7f237c062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f238c001c40 tx=0x7f2390156b40 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239014e450 msgr2=0x7f23901653a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239014e450 0x7f23901653a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2380006ac0 tx=0x7f23800091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 shutdown_connections 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f237c060860 0x7f237c062d10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23901658e0 0x7f23900adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239014e450 0x7f23901653a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 --2- 172.21.15.19:0/525589572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f239014ce20 0x7f239014df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 >> 172.21.15.19:0/525589572 conn(0x7f239006d870 msgr2=0x7f23900b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 shutdown_connections 2024-08-17T02:26:57.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.139+0000 7f2395ab4700 1 -- 172.21.15.19:0/525589572 wait complete. 2024-08-17T02:26:57.157 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:27.555224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:27.958499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:57.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:57.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.263+0000 7fec96885700 1 Processor -- start 2024-08-17T02:26:57.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.263+0000 7fec96885700 1 -- start start 2024-08-17T02:26:57.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec90158ea0 0x7fec90159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec900aa900 con 0x7fec900af540 2024-08-17T02:26:57.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec900af130 con 0x7fec900a9860 2024-08-17T02:26:57.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec900af980 con 0x7fec90158ea0 2024-08-17T02:26:57.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec95082700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fec900a9860 0x7fec900aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:44358/0 (socket says 172.21.15.19:44358) 2024-08-17T02:26:57.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec95082700 1 -- 172.21.15.19:0/3951734611 learned_addr learned my addr 172.21.15.19:0/3951734611 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:57.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec95883700 1 --2- 172.21.15.19:0/3951734611 >> v2:172.21.15.19:3300/0 conn(0x7fec90158ea0 0x7fec90159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec94881700 1 -- 172.21.15.19:0/3951734611 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485042458 0 0) 0x7fec900af130 con 0x7fec900a9860 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec95883700 1 -- 172.21.15.19:0/3951734611 >> v1:172.21.15.119:6789/0 conn(0x7fec900a9860 legacy=0x7fec900aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec95883700 1 -- 172.21.15.19:0/3951734611 >> v1:172.21.15.19:6789/0 conn(0x7fec900af540 legacy=0x7fec900686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec95883700 1 -- 172.21.15.19:0/3951734611 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec900a9cf0 con 0x7fec90158ea0 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec95883700 1 --2- 172.21.15.19:0/3951734611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 0x7fec90159270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0098e0 tx=0x7fec8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d77acc422087f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec94881700 1 -- 172.21.15.19:0/3951734611 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c009e80 con 0x7fec90158ea0 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec94881700 1 -- 172.21.15.19:0/3951734611 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c00b760 con 0x7fec90158ea0 2024-08-17T02:26:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec94881700 1 -- 172.21.15.19:0/3951734611 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00bae0 con 0x7fec90158ea0 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 -- 172.21.15.19:0/3951734611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 msgr2=0x7fec90159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 --2- 172.21.15.19:0/3951734611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 0x7fec90159270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0098e0 tx=0x7fec8c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 -- 172.21.15.19:0/3951734611 shutdown_connections 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 --2- 172.21.15.19:0/3951734611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 0x7fec90159270 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 -- 172.21.15.19:0/3951734611 >> 172.21.15.19:0/3951734611 conn(0x7fec9006e350 msgr2=0x7fec9006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.267+0000 7fec96885700 1 -- 172.21.15.19:0/3951734611 shutdown_connections 2024-08-17T02:26:57.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 -- 172.21.15.19:0/3951734611 wait complete. 2024-08-17T02:26:57.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 Processor -- start 2024-08-17T02:26:57.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 -- start start 2024-08-17T02:26:57.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec900a9860 0x7fec90157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec900af540 0x7fec9015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 0x7fec90140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec900c23f0 con 0x7fec90158ea0 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec901556f0 con 0x7fec900af540 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec901559d0 con 0x7fec900a9860 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96084700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 0x7fec90140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96084700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 0x7fec90140f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59720/0 (socket says 172.21.15.19:59720) 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96084700 1 -- 172.21.15.19:0/897360571 learned_addr learned my addr 172.21.15.19:0/897360571 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec95082700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec900af540 0x7fec9015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec95883700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec900a9860 0x7fec90157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96084700 1 -- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec900a9860 msgr2=0x7fec90157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96084700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec900a9860 0x7fec90157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96084700 1 -- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec900af540 msgr2=0x7fec9015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96084700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec900af540 0x7fec9015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96084700 1 -- 172.21.15.19:0/897360571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c009420 con 0x7fec90158ea0 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96084700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 0x7fec90140f30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec8800cb90 tx=0x7fec88001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec85ffb700 1 -- 172.21.15.19:0/897360571 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800a7a0 con 0x7fec90158ea0 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec85ffb700 1 -- 172.21.15.19:0/897360571 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8800a920 con 0x7fec90158ea0 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec90155cb0 con 0x7fec90158ea0 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec85ffb700 1 -- 172.21.15.19:0/897360571 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800ace0 con 0x7fec90158ea0 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.271+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec90156040 con 0x7fec90158ea0 2024-08-17T02:26:57.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.275+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec900638f0 con 0x7fec90158ea0 2024-08-17T02:26:57.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.275+0000 7fec85ffb700 1 -- 172.21.15.19:0/897360571 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fec88003030 con 0x7fec90158ea0 2024-08-17T02:26:57.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.275+0000 7fec85ffb700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec74060860 0x7fec74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.275+0000 7fec85ffb700 1 -- 172.21.15.19:0/897360571 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec8807cd40 con 0x7fec90158ea0 2024-08-17T02:26:57.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.275+0000 7fec95883700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec74060860 0x7fec74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.279+0000 7fec95883700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec74060860 0x7fec74062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0030c0 tx=0x7fec8c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.283+0000 7fec85ffb700 1 -- 172.21.15.19:0/897360571 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fec8804d190 con 0x7fec90158ea0 2024-08-17T02:26:57.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec90066f40 con 0x7fec90158ea0 2024-08-17T02:26:57.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec85ffb700 1 -- 172.21.15.19:0/897360571 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec880507b0 con 0x7fec90158ea0 2024-08-17T02:26:57.451 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec74060860 msgr2=0x7fec74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec74060860 0x7fec74062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0030c0 tx=0x7fec8c016000 comp rx=0 tx=0).stop 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 msgr2=0x7fec90140f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 0x7fec90140f30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fec8800cb90 tx=0x7fec88001820 comp rx=0 tx=0).stop 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 shutdown_connections 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec74060860 0x7fec74062d10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec90158ea0 0x7fec90140f30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec900af540 0x7fec9015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 --2- 172.21.15.19:0/897360571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec900a9860 0x7fec90157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 >> 172.21.15.19:0/897360571 conn(0x7fec9006e350 msgr2=0x7fec90069940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 shutdown_connections 2024-08-17T02:26:57.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.447+0000 7fec96885700 1 -- 172.21.15.19:0/897360571 wait complete. 2024-08-17T02:26:57.465 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.571+0000 7f0c37c2b700 1 Processor -- start 2024-08-17T02:26:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.571+0000 7f0c37c2b700 1 -- start start 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.571+0000 7f0c37c2b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300cc840 0x7f0c300ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.571+0000 7f0c37c2b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c300b5750 0x7f0c300b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.571+0000 7f0c37c2b700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c300cd150 con 0x7f0c300b2210 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.571+0000 7f0c37c2b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c300b2b80 con 0x7f0c300b5750 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.571+0000 7f0c37c2b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300af570 con 0x7f0c300cc840 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.571+0000 7f0c361c8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c300b5750 0x7f0c300b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c361c8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c300b5750 0x7f0c300b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59724/0 (socket says 172.21.15.19:59724) 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c361c8700 1 -- 172.21.15.19:0/1932016710 learned_addr learned my addr 172.21.15.19:0/1932016710 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c359c7700 1 --2- 172.21.15.19:0/1932016710 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300cc840 0x7f0c300ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c361c8700 1 -- 172.21.15.19:0/1932016710 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300cc840 msgr2=0x7f0c300ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c361c8700 1 --2- 172.21.15.19:0/1932016710 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300cc840 0x7f0c300ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c361c8700 1 -- 172.21.15.19:0/1932016710 >> v1:172.21.15.119:6789/0 conn(0x7f0c300b2210 legacy=0x7f0c300b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c361c8700 1 -- 172.21.15.19:0/1932016710 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c30159ce0 con 0x7f0c300b5750 2024-08-17T02:26:57.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c361c8700 1 --2- 172.21.15.19:0/1932016710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 0x7f0c300b2640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009f20 tx=0x7f0c28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f05c506ebbab13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c349c5700 1 -- 172.21.15.19:0/1932016710 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800e070 con 0x7f0c300b5750 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c349c5700 1 -- 172.21.15.19:0/1932016710 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800ba80 con 0x7f0c300b5750 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c349c5700 1 -- 172.21.15.19:0/1932016710 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c280092e0 con 0x7f0c300b5750 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c37c2b700 1 -- 172.21.15.19:0/1932016710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 msgr2=0x7f0c300b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c37c2b700 1 --2- 172.21.15.19:0/1932016710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 0x7f0c300b2640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009f20 tx=0x7f0c28009840 comp rx=0 tx=0).stop 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c37c2b700 1 -- 172.21.15.19:0/1932016710 shutdown_connections 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c37c2b700 1 --2- 172.21.15.19:0/1932016710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 0x7f0c300b2640 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c37c2b700 1 --2- 172.21.15.19:0/1932016710 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300cc840 0x7f0c300ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c37c2b700 1 -- 172.21.15.19:0/1932016710 >> 172.21.15.19:0/1932016710 conn(0x7f0c300682c0 msgr2=0x7f0c300686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c37c2b700 1 -- 172.21.15.19:0/1932016710 shutdown_connections 2024-08-17T02:26:57.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.575+0000 7f0c37c2b700 1 -- 172.21.15.19:0/1932016710 wait complete. 2024-08-17T02:26:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 Processor -- start 2024-08-17T02:26:57.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 -- start start 2024-08-17T02:26:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300b2210 0x7f0c300ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 0x7f0c30152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c300cc840 0x7f0c3015bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3015ca30 con 0x7f0c300b5750 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c30152f60 con 0x7f0c300cc840 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3015c240 con 0x7f0c300b2210 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c351c6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 0x7f0c30152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c351c6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 0x7f0c30152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59736/0 (socket says 172.21.15.19:59736) 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c351c6700 1 -- 172.21.15.19:0/2961212682 learned_addr learned my addr 172.21.15.19:0/2961212682 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c359c7700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300b2210 0x7f0c300ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c361c8700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c300cc840 0x7f0c3015bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c351c6700 1 -- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300b2210 msgr2=0x7f0c300ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c351c6700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300b2210 0x7f0c300ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c351c6700 1 -- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c300cc840 msgr2=0x7f0c3015bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c351c6700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c300cc840 0x7f0c3015bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c351c6700 1 -- 172.21.15.19:0/2961212682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28009ae0 con 0x7f0c300b5750 2024-08-17T02:26:57.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c351c6700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 0x7f0c30152a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c5c0 tx=0x7f0c2400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c21ffb700 1 -- 172.21.15.19:0/2961212682 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24011590 con 0x7f0c300b5750 2024-08-17T02:26:57.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c21ffb700 1 -- 172.21.15.19:0/2961212682 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24011710 con 0x7f0c300b5750 2024-08-17T02:26:57.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c21ffb700 1 -- 172.21.15.19:0/2961212682 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24011ad0 con 0x7f0c300b5750 2024-08-17T02:26:57.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3015b070 con 0x7f0c300b5750 2024-08-17T02:26:57.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.579+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3015c750 con 0x7f0c300b5750 2024-08-17T02:26:57.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.583+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c300645c0 con 0x7f0c300b5750 2024-08-17T02:26:57.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.583+0000 7f0c21ffb700 1 -- 172.21.15.19:0/2961212682 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0c2401b3b0 con 0x7f0c300b5750 2024-08-17T02:26:57.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.583+0000 7f0c21ffb700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c14060860 0x7f0c14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.583+0000 7f0c21ffb700 1 -- 172.21.15.19:0/2961212682 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c2407c060 con 0x7f0c300b5750 2024-08-17T02:26:57.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.583+0000 7f0c359c7700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c14060860 0x7f0c14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.583+0000 7f0c359c7700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c14060860 0x7f0c14062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c006fd0 tx=0x7f0c2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.591+0000 7f0c21ffb700 1 -- 172.21.15.19:0/2961212682 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0c2404c4b0 con 0x7f0c300b5750 2024-08-17T02:26:57.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.751+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c300b1570 con 0x7f0c300b5750 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.751+0000 7f0c21ffb700 1 -- 172.21.15.19:0/2961212682 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c240170a0 con 0x7f0c300b5750 2024-08-17T02:26:57.757 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c14060860 msgr2=0x7f0c14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c14060860 0x7f0c14062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c006fd0 tx=0x7f0c2c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 msgr2=0x7f0c30152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 0x7f0c30152a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c5c0 tx=0x7f0c2400c8d0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 shutdown_connections 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c14060860 0x7f0c14062d10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c300cc840 0x7f0c3015bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c300b5750 0x7f0c30152a20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 --2- 172.21.15.19:0/2961212682 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c300b2210 0x7f0c300ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 >> 172.21.15.19:0/2961212682 conn(0x7f0c300682c0 msgr2=0x7f0c30159440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 shutdown_connections 2024-08-17T02:26:57.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.755+0000 7f0c37c2b700 1 -- 172.21.15.19:0/2961212682 wait complete. 2024-08-17T02:26:57.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:57.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9afffb700 1 Processor -- start 2024-08-17T02:26:57.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9afffb700 1 -- start start 2024-08-17T02:26:57.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9afffb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9a8146f40 0x7fe9a806e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9afffb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a80b0010 con 0x7fe9a80a9520 2024-08-17T02:26:57.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9afffb700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a80af440 con 0x7fe9a815dcc0 2024-08-17T02:26:57.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9afffb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a80af6e0 con 0x7fe9a8146f40 2024-08-17T02:26:57.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9add97700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9a8146f40 0x7fe9a806e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9add97700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9a8146f40 0x7fe9a806e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59744/0 (socket says 172.21.15.19:59744) 2024-08-17T02:26:57.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9ae598700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe9a80a9520 0x7fe9a80b04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39634/0 (socket says 172.21.15.19:39634) 2024-08-17T02:26:57.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9add97700 1 -- 172.21.15.19:0/849785450 learned_addr learned my addr 172.21.15.19:0/849785450 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:57.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9add97700 1 -- 172.21.15.19:0/849785450 >> v1:172.21.15.119:6789/0 conn(0x7fe9a815dcc0 legacy=0x7fe9a80a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9add97700 1 -- 172.21.15.19:0/849785450 >> v1:172.21.15.19:6789/0 conn(0x7fe9a80a9520 legacy=0x7fe9a80b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9acd95700 1 -- 172.21.15.19:0/849785450 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380386240 0 0) 0x7fe9a80af440 con 0x7fe9a815dcc0 2024-08-17T02:26:57.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9add97700 1 -- 172.21.15.19:0/849785450 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a80af9c0 con 0x7fe9a8146f40 2024-08-17T02:26:57.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9add97700 1 --2- 172.21.15.19:0/849785450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 0x7fe9a806e540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe9980099b0 tx=0x7fe998009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5860a07ffe114640 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.875+0000 7fe9acd95700 1 -- 172.21.15.19:0/849785450 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800b860 con 0x7fe9a8146f40 2024-08-17T02:26:57.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.879+0000 7fe9acd95700 1 -- 172.21.15.19:0/849785450 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99800b9c0 con 0x7fe9a8146f40 2024-08-17T02:26:57.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.879+0000 7fe9acd95700 1 -- 172.21.15.19:0/849785450 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800bd60 con 0x7fe9a8146f40 2024-08-17T02:26:57.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.879+0000 7fe9afffb700 1 -- 172.21.15.19:0/849785450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 msgr2=0x7fe9a806e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.879+0000 7fe9afffb700 1 --2- 172.21.15.19:0/849785450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 0x7fe9a806e540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe9980099b0 tx=0x7fe998009250 comp rx=0 tx=0).stop 2024-08-17T02:26:57.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.879+0000 7fe9afffb700 1 -- 172.21.15.19:0/849785450 shutdown_connections 2024-08-17T02:26:57.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.879+0000 7fe9afffb700 1 --2- 172.21.15.19:0/849785450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 0x7fe9a806e540 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.879+0000 7fe9afffb700 1 -- 172.21.15.19:0/849785450 >> 172.21.15.19:0/849785450 conn(0x7fe9a8066e00 msgr2=0x7fe9a8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.879+0000 7fe9afffb700 1 -- 172.21.15.19:0/849785450 shutdown_connections 2024-08-17T02:26:57.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.879+0000 7fe9afffb700 1 -- 172.21.15.19:0/849785450 wait complete. 2024-08-17T02:26:57.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9afffb700 1 Processor -- start 2024-08-17T02:26:57.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9afffb700 1 -- start start 2024-08-17T02:26:57.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9afffb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9a80a9520 0x7fe9a8159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9afffb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 0x7fe9a8098790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9afffb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9a815dcc0 0x7fe9a8098cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9afffb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8099530 con 0x7fe9a8146f40 2024-08-17T02:26:57.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9afffb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8099810 con 0x7fe9a815dcc0 2024-08-17T02:26:57.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9afffb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8099af0 con 0x7fe9a80a9520 2024-08-17T02:26:57.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ad596700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 0x7fe9a8098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ad596700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 0x7fe9a8098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59754/0 (socket says 172.21.15.19:59754) 2024-08-17T02:26:57.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ad596700 1 -- 172.21.15.19:0/451550037 learned_addr learned my addr 172.21.15.19:0/451550037 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:57.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9add97700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9a80a9520 0x7fe9a8159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ae598700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9a815dcc0 0x7fe9a8098cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ad596700 1 -- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9a80a9520 msgr2=0x7fe9a8159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ad596700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9a80a9520 0x7fe9a8159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ad596700 1 -- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9a815dcc0 msgr2=0x7fe9a8098cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ad596700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9a815dcc0 0x7fe9a8098cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ad596700 1 -- 172.21.15.19:0/451550037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980094f0 con 0x7fe9a8146f40 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9ad596700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 0x7fe9a8098790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00c910 tx=0x7fe99c001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.883+0000 7fe9a5ffb700 1 -- 172.21.15.19:0/451550037 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c012630 con 0x7fe9a8146f40 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.887+0000 7fe9a5ffb700 1 -- 172.21.15.19:0/451550037 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c0127b0 con 0x7fe9a8146f40 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.887+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a8099dd0 con 0x7fe9a8146f40 2024-08-17T02:26:57.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.887+0000 7fe9a5ffb700 1 -- 172.21.15.19:0/451550037 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c012b70 con 0x7fe9a8146f40 2024-08-17T02:26:57.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.887+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a8099210 con 0x7fe9a8146f40 2024-08-17T02:26:57.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.887+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a80aaf30 con 0x7fe9a8146f40 2024-08-17T02:26:57.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.887+0000 7fe9a5ffb700 1 -- 172.21.15.19:0/451550037 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe99c003030 con 0x7fe9a8146f40 2024-08-17T02:26:57.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.887+0000 7fe9a5ffb700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe994060860 0x7fe994062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.887+0000 7fe9a5ffb700 1 -- 172.21.15.19:0/451550037 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe99c07cb10 con 0x7fe9a8146f40 2024-08-17T02:26:57.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.887+0000 7fe9add97700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe994060860 0x7fe994062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.891+0000 7fe9add97700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe994060860 0x7fe994062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe9980099b0 tx=0x7fe998017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:57.895+0000 7fe9a5ffb700 1 -- 172.21.15.19:0/451550037 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe99c04cf60 con 0x7fe9a8146f40 2024-08-17T02:26:58.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.055+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe9a80645c0 con 0x7fe9a8146f40 2024-08-17T02:26:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.055+0000 7fe9a5ffb700 1 -- 172.21.15.19:0/451550037 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe99c050580 con 0x7fe9a8146f40 2024-08-17T02:26:58.060 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-08-17T02:26:58.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe994060860 msgr2=0x7fe994062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe994060860 0x7fe994062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe9980099b0 tx=0x7fe998017000 comp rx=0 tx=0).stop 2024-08-17T02:26:58.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 msgr2=0x7fe9a8098790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 0x7fe9a8098790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00c910 tx=0x7fe99c001700 comp rx=0 tx=0).stop 2024-08-17T02:26:58.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 shutdown_connections 2024-08-17T02:26:58.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe994060860 0x7fe994062d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9a815dcc0 0x7fe9a8098cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9a8146f40 0x7fe9a8098790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 --2- 172.21.15.19:0/451550037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9a80a9520 0x7fe9a8159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 >> 172.21.15.19:0/451550037 conn(0x7fe9a8066e00 msgr2=0x7fe9a8142cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 shutdown_connections 2024-08-17T02:26:58.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.059+0000 7fe9afffb700 1 -- 172.21.15.19:0/451550037 wait complete. 2024-08-17T02:26:58.075 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:26:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.179+0000 7f74cbadd700 1 Processor -- start 2024-08-17T02:26:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.179+0000 7f74cbadd700 1 -- start start 2024-08-17T02:26:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74c4159240 0x7f74c40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c40c6c80 0x7f74c406ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f74c4159610 0x7f74c40686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40c7dc0 con 0x7f74c4159240 2024-08-17T02:26:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40c71b0 con 0x7f74c4159610 2024-08-17T02:26:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40c7490 con 0x7f74c40c6c80 2024-08-17T02:26:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74c9879700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74c4159240 0x7f74c40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74c9879700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74c4159240 0x7f74c40af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58356/0 (socket says 172.21.15.19:58356) 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74c9879700 1 -- 172.21.15.19:0/2972087955 learned_addr learned my addr 172.21.15.19:0/2972087955 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74c9078700 1 --2- 172.21.15.19:0/2972087955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c40c6c80 0x7f74c406ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74ca07a700 1 --2- 172.21.15.19:0/2972087955 >> v2:172.21.15.119:3300/0 conn(0x7f74c4159610 0x7f74c40686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74ca07a700 1 -- 172.21.15.19:0/2972087955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c40c6c80 msgr2=0x7f74c406ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74ca07a700 1 --2- 172.21.15.19:0/2972087955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c40c6c80 0x7f74c406ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74ca07a700 1 -- 172.21.15.19:0/2972087955 >> v2:172.21.15.19:3300/0 conn(0x7f74c4159240 msgr2=0x7f74c40af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74ca07a700 1 --2- 172.21.15.19:0/2972087955 >> v2:172.21.15.19:3300/0 conn(0x7f74c4159240 0x7f74c40af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74ca07a700 1 -- 172.21.15.19:0/2972087955 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c40c7770 con 0x7f74c4159610 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74c9879700 1 --2- 172.21.15.19:0/2972087955 >> v2:172.21.15.19:3300/0 conn(0x7f74c4159240 0x7f74c40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74ca07a700 1 --2- 172.21.15.19:0/2972087955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c4159610 0x7f74c40686a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74c4159a90 tx=0x7f74bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c837db2ff55249bd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74c8877700 1 -- 172.21.15.19:0/2972087955 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00e070 con 0x7f74c4159610 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74c8877700 1 -- 172.21.15.19:0/2972087955 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc00bab0 con 0x7f74c4159610 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74c8877700 1 -- 172.21.15.19:0/2972087955 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc00be70 con 0x7f74c4159610 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 -- 172.21.15.19:0/2972087955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c4159610 msgr2=0x7f74c40686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 --2- 172.21.15.19:0/2972087955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c4159610 0x7f74c40686a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74c4159a90 tx=0x7f74bc009780 comp rx=0 tx=0).stop 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 -- 172.21.15.19:0/2972087955 shutdown_connections 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 --2- 172.21.15.19:0/2972087955 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c4159610 0x7f74c40686a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 --2- 172.21.15.19:0/2972087955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c40c6c80 0x7f74c406ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 --2- 172.21.15.19:0/2972087955 >> v2:172.21.15.19:3300/0 conn(0x7f74c4159240 0x7f74c40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 -- 172.21.15.19:0/2972087955 >> 172.21.15.19:0/2972087955 conn(0x7f74c40c9c20 msgr2=0x7f74c406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 -- 172.21.15.19:0/2972087955 shutdown_connections 2024-08-17T02:26:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.183+0000 7f74cbadd700 1 -- 172.21.15.19:0/2972087955 wait complete. 2024-08-17T02:26:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74cbadd700 1 Processor -- start 2024-08-17T02:26:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74cbadd700 1 -- start start 2024-08-17T02:26:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74cbadd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74c40c6c80 0x7f74c40abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74cbadd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c4159240 0x7f74c416c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74cbadd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c4159610 0x7f74c416ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74cbadd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c413ff50 con 0x7f74c40c6c80 2024-08-17T02:26:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74cbadd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40ac550 con 0x7f74c4159240 2024-08-17T02:26:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74cbadd700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c40ac830 con 0x7f74c4159610 2024-08-17T02:26:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74c9879700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74c40c6c80 0x7f74c40abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74c9879700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74c40c6c80 0x7f74c40abec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58366/0 (socket says 172.21.15.19:58366) 2024-08-17T02:26:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74c9879700 1 -- 172.21.15.19:0/3206198829 learned_addr learned my addr 172.21.15.19:0/3206198829 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:58.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74ca07a700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c4159610 0x7f74c416ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74c9078700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c4159240 0x7f74c416c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74c9879700 1 -- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c4159610 msgr2=0x7f74c416ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74c9879700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c4159610 0x7f74c416ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74c9879700 1 -- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c4159240 msgr2=0x7f74c416c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74c9879700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c4159240 0x7f74c416c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.187+0000 7f74c9879700 1 -- 172.21.15.19:0/3206198829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80094f0 con 0x7f74c40c6c80 2024-08-17T02:26:58.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.191+0000 7f74c9879700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74c40c6c80 0x7f74c40abec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f74b800ec50 tx=0x7f74b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.191+0000 7f74b5ffb700 1 -- 172.21.15.19:0/3206198829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800c850 con 0x7f74c40c6c80 2024-08-17T02:26:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.191+0000 7f74b5ffb700 1 -- 172.21.15.19:0/3206198829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b800c9b0 con 0x7f74c40c6c80 2024-08-17T02:26:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.191+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74bc009a20 con 0x7f74c40c6c80 2024-08-17T02:26:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.191+0000 7f74b5ffb700 1 -- 172.21.15.19:0/3206198829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800cd30 con 0x7f74c40c6c80 2024-08-17T02:26:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.191+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c40acdf0 con 0x7f74c40c6c80 2024-08-17T02:26:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.191+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c40645c0 con 0x7f74c40c6c80 2024-08-17T02:26:58.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.191+0000 7f74b5ffb700 1 -- 172.21.15.19:0/3206198829 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f74b8013680 con 0x7f74c40c6c80 2024-08-17T02:26:58.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.195+0000 7f74b5ffb700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f74a8060860 0x7f74a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.195+0000 7f74b5ffb700 1 -- 172.21.15.19:0/3206198829 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74b807ce90 con 0x7f74c40c6c80 2024-08-17T02:26:58.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.195+0000 7f74c9078700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f74a8060860 0x7f74a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.195+0000 7f74c9078700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f74a8060860 0x7f74a8062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f74c4063bd0 tx=0x7f74c00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.203+0000 7f74b5ffb700 1 -- 172.21.15.19:0/3206198829 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f74b804d240 con 0x7f74c40c6c80 2024-08-17T02:26:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.423+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f74c41581c0 con 0x7f74c40c6c80 2024-08-17T02:26:58.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.863+0000 7f74b5ffb700 1 -- 172.21.15.19:0/3206198829 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7f74b8050860 con 0x7f74c40c6c80 2024-08-17T02:26:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f74a8060860 msgr2=0x7f74a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f74a8060860 0x7f74a8062d10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f74c4063bd0 tx=0x7f74c00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74c40c6c80 msgr2=0x7f74c40abec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74c40c6c80 0x7f74c40abec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f74b800ec50 tx=0x7f74b8009250 comp rx=0 tx=0).stop 2024-08-17T02:26:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 shutdown_connections 2024-08-17T02:26:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f74a8060860 0x7f74a8062d10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c4159610 0x7f74c416ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c4159240 0x7f74c416c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 --2- 172.21.15.19:0/3206198829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74c40c6c80 0x7f74c40abec0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 >> 172.21.15.19:0/3206198829 conn(0x7f74c40c9c20 msgr2=0x7f74c40c1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 shutdown_connections 2024-08-17T02:26:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:58.867+0000 7f74cbadd700 1 -- 172.21.15.19:0/3206198829 wait complete. 2024-08-17T02:26:58.893 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:26:59.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.011+0000 7f03f49f6700 1 Processor -- start 2024-08-17T02:26:59.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.011+0000 7f03f49f6700 1 -- start start 2024-08-17T02:26:59.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.011+0000 7f03f49f6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f0142660 0x7f03f0142a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.011+0000 7f03f49f6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03f00ae510 0x7f03f00ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.011+0000 7f03f49f6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00b1180 con 0x7f03f00c82e0 2024-08-17T02:26:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.011+0000 7f03f49f6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00c9310 con 0x7f03f00ae510 2024-08-17T02:26:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.011+0000 7f03f49f6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00aee80 con 0x7f03f0142660 2024-08-17T02:26:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03e7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03f00ae510 0x7f03f00ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03ef59e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f03f00c82e0 0x7f03f00c8760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54222/0 (socket says 172.21.15.19:54222) 2024-08-17T02:26:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03ef59e700 1 -- 172.21.15.19:0/3172967497 learned_addr learned my addr 172.21.15.19:0/3172967497 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:26:59.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03eed9d700 1 --2- 172.21.15.19:0/3172967497 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f0142660 0x7f03f0142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03ee59c700 1 -- 172.21.15.19:0/3172967497 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873403414 0 0) 0x7f03f00b1180 con 0x7f03f00c82e0 2024-08-17T02:26:59.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03e7fff700 1 -- 172.21.15.19:0/3172967497 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f0142660 msgr2=0x7f03f0142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03e7fff700 1 --2- 172.21.15.19:0/3172967497 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f0142660 0x7f03f0142a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03e7fff700 1 -- 172.21.15.19:0/3172967497 >> v1:172.21.15.19:6789/0 conn(0x7f03f00c82e0 legacy=0x7f03f00c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03e7fff700 1 -- 172.21.15.19:0/3172967497 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00b0890 con 0x7f03f00ae510 2024-08-17T02:26:59.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03e7fff700 1 --2- 172.21.15.19:0/3172967497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f00ae510 0x7f03f00ae940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f03d80098e0 tx=0x7f03d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea22af2c6dae2aaa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03ee59c700 1 -- 172.21.15.19:0/3172967497 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800b640 con 0x7f03f00ae510 2024-08-17T02:26:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03ee59c700 1 -- 172.21.15.19:0/3172967497 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d800b7a0 con 0x7f03f00ae510 2024-08-17T02:26:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03ee59c700 1 -- 172.21.15.19:0/3172967497 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800bb40 con 0x7f03f00ae510 2024-08-17T02:26:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 -- 172.21.15.19:0/3172967497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f00ae510 msgr2=0x7f03f00ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 --2- 172.21.15.19:0/3172967497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f00ae510 0x7f03f00ae940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f03d80098e0 tx=0x7f03d80091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 -- 172.21.15.19:0/3172967497 shutdown_connections 2024-08-17T02:26:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 --2- 172.21.15.19:0/3172967497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f00ae510 0x7f03f00ae940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 --2- 172.21.15.19:0/3172967497 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f0142660 0x7f03f0142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 -- 172.21.15.19:0/3172967497 >> 172.21.15.19:0/3172967497 conn(0x7f03f00c9830 msgr2=0x7f03f00c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 -- 172.21.15.19:0/3172967497 shutdown_connections 2024-08-17T02:26:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 -- 172.21.15.19:0/3172967497 wait complete. 2024-08-17T02:26:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 Processor -- start 2024-08-17T02:26:59.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.015+0000 7f03f49f6700 1 -- start start 2024-08-17T02:26:59.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03f49f6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f00ae510 0x7f03f00c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03f49f6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f00c82e0 0x7f03f00c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03f49f6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f0142660 0x7f03f0168d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03f49f6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c2bf0 con 0x7f03f0142660 2024-08-17T02:26:59.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03f49f6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c5960 con 0x7f03f00ae510 2024-08-17T02:26:59.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03f49f6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c53a0 con 0x7f03f00c82e0 2024-08-17T02:26:59.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03ef59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f0142660 0x7f03f0168d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03e7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f00c82e0 0x7f03f00c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03eed9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f00ae510 0x7f03f00c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03e7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f00c82e0 0x7f03f00c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:44722/0 (socket says 172.21.15.19:44722) 2024-08-17T02:26:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03e7fff700 1 -- 172.21.15.19:0/2950304263 learned_addr learned my addr 172.21.15.19:0/2950304263 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03ef59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f0142660 0x7f03f0168d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58394/0 (socket says 172.21.15.19:58394) 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03eed9d700 1 -- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f00c82e0 msgr2=0x7f03f00c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03eed9d700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f00c82e0 0x7f03f00c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03eed9d700 1 -- 172.21.15.19:0/2950304263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f0142660 msgr2=0x7f03f0168d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03eed9d700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f0142660 0x7f03f0168d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03eed9d700 1 -- 172.21.15.19:0/2950304263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8009420 con 0x7f03f00ae510 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03e7fff700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f00c82e0 0x7f03f00c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03eed9d700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f00ae510 0x7f03f00c3010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03e000e900 tx=0x7f03e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03e6ffd700 1 -- 172.21.15.19:0/2950304263 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0013680 con 0x7f03f00ae510 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03e6ffd700 1 -- 172.21.15.19:0/2950304263 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e00137e0 con 0x7f03f00ae510 2024-08-17T02:26:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f00c5680 con 0x7f03f00ae510 2024-08-17T02:26:59.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03e6ffd700 1 -- 172.21.15.19:0/2950304263 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0013b80 con 0x7f03f00ae510 2024-08-17T02:26:59.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.019+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00c6d30 con 0x7f03f00ae510 2024-08-17T02:26:59.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.023+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00c2d30 con 0x7f03f00ae510 2024-08-17T02:26:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.023+0000 7f03e6ffd700 1 -- 172.21.15.19:0/2950304263 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f03e00123d0 con 0x7f03f00ae510 2024-08-17T02:26:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.023+0000 7f03e6ffd700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f03d0060860 0x7f03d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.023+0000 7f03e6ffd700 1 -- 172.21.15.19:0/2950304263 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03e007cc30 con 0x7f03f00ae510 2024-08-17T02:26:59.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.023+0000 7f03e7fff700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f03d0060860 0x7f03d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.023+0000 7f03e7fff700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f03d0060860 0x7f03d0062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f03f00c7360 tx=0x7f03d8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.031+0000 7f03e6ffd700 1 -- 172.21.15.19:0/2950304263 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f03f00c2d30 con 0x7f03f00ae510 2024-08-17T02:26:59.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.199+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f03f00c2d30 con 0x7f03f00ae510 2024-08-17T02:26:59.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.207+0000 7f03e6ffd700 1 -- 172.21.15.19:0/2950304263 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f03f00c2d30 con 0x7f03f00ae510 2024-08-17T02:26:59.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f03d0060860 msgr2=0x7f03d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f03d0060860 0x7f03d0062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f03f00c7360 tx=0x7f03d8017000 comp rx=0 tx=0).stop 2024-08-17T02:26:59.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f00ae510 msgr2=0x7f03f00c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f00ae510 0x7f03f00c3010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03e000e900 tx=0x7f03e00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 shutdown_connections 2024-08-17T02:26:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f03d0060860 0x7f03d0062d10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03f0142660 0x7f03f0168d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f00c82e0 0x7f03f00c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 --2- 172.21.15.19:0/2950304263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f00ae510 0x7f03f00c3010 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 >> 172.21.15.19:0/2950304263 conn(0x7f03f00c9830 msgr2=0x7f03f00cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 shutdown_connections 2024-08-17T02:26:59.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.211+0000 7f03f49f6700 1 -- 172.21.15.19:0/2950304263 wait complete. 2024-08-17T02:26:59.229 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:26:59.230 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:59.248 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:59.269 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:26:59.270 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-08-17T02:26:59.270 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:59.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:59.316 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:59.317 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:26:59.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:59.317 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:26:59.350 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-08-17T02:26:59.350 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:59.350 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:59.376 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:59.376 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:26:59.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:59.376 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:26:59.434 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-08-17T02:26:59.434 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:59.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:59.450 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:59.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:26:59.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:59.452 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:26:59.501 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-08-17T02:26:59.501 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:59.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:59.517 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:26:59.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:26:59.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:59.519 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:26:59.567 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:26:59.568 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:59.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bfc8c6700 1 Processor -- start 2024-08-17T02:26:59.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bfc8c6700 1 -- start start 2024-08-17T02:26:59.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bfc8c6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4bf815b240 0x7f4bf806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bfc8c6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151740 0x7f4bf806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bfc8c6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf815a920 con 0x7f4bf8151370 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bfc8c6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf806c2f0 con 0x7f4bf815b240 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bfc8c6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf806b430 con 0x7f4bf8151740 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4bf815b240 0x7f4bf806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4bf815b240 0x7f4bf806a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58410/0 (socket says 172.21.15.19:58410) 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf659c700 1 -- 172.21.15.19:0/1491912850 learned_addr learned my addr 172.21.15.19:0/1491912850 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:59.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf759e700 1 --2- 172.21.15.19:0/1491912850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151740 0x7f4bf806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf5d9b700 1 -- 172.21.15.19:0/1491912850 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555938671 0 0) 0x7f4be8001110 con 0x7f4bf8151370 2024-08-17T02:26:59.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf659c700 1 -- 172.21.15.19:0/1491912850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151740 msgr2=0x7f4bf806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf659c700 1 --2- 172.21.15.19:0/1491912850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151740 0x7f4bf806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf659c700 1 -- 172.21.15.19:0/1491912850 >> v1:172.21.15.119:6789/0 conn(0x7f4bf8151370 legacy=0x7f4bf815ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf659c700 1 -- 172.21.15.19:0/1491912850 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf806c780 con 0x7f4bf815b240 2024-08-17T02:26:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf659c700 1 --2- 172.21.15.19:0/1491912850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 0x7f4bf806a9b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009f20 tx=0x7f4bec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c526b593cc3ee34 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf5d9b700 1 -- 172.21.15.19:0/1491912850 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec00e070 con 0x7f4bf815b240 2024-08-17T02:26:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf5d9b700 1 -- 172.21.15.19:0/1491912850 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec00b9d0 con 0x7f4bf815b240 2024-08-17T02:26:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.679+0000 7f4bf5d9b700 1 -- 172.21.15.19:0/1491912850 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0092e0 con 0x7f4bf815b240 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/1491912850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 msgr2=0x7f4bf806a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 --2- 172.21.15.19:0/1491912850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 0x7f4bf806a9b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009f20 tx=0x7f4bec009840 comp rx=0 tx=0).stop 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/1491912850 shutdown_connections 2024-08-17T02:26:59.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 --2- 172.21.15.19:0/1491912850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151740 0x7f4bf806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 --2- 172.21.15.19:0/1491912850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 0x7f4bf806a9b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/1491912850 >> 172.21.15.19:0/1491912850 conn(0x7f4bf806cc40 msgr2=0x7f4bf806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/1491912850 shutdown_connections 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/1491912850 wait complete. 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 Processor -- start 2024-08-17T02:26:59.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.683+0000 7f4bfc8c6700 1 -- start start 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bfc8c6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151370 0x7f4bf814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bfc8c6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf8151740 0x7f4bf815a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bfc8c6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 0x7f4bf80c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bfc8c6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80c2cd0 con 0x7f4bf815b240 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bfc8c6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80c3570 con 0x7f4bf8151740 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bfc8c6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf814f140 con 0x7f4bf8151370 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf759e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 0x7f4bf80c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf8151740 0x7f4bf815a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf6d9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151370 0x7f4bf814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf759e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 0x7f4bf80c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58418/0 (socket says 172.21.15.19:58418) 2024-08-17T02:26:59.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf759e700 1 -- 172.21.15.19:0/284940517 learned_addr learned my addr 172.21.15.19:0/284940517 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf759e700 1 -- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151370 msgr2=0x7f4bf814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf759e700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151370 0x7f4bf814ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf759e700 1 -- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf8151740 msgr2=0x7f4bf815a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf759e700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf8151740 0x7f4bf815a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf759e700 1 -- 172.21.15.19:0/284940517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009ae0 con 0x7f4bf815b240 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf6d9d700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151370 0x7f4bf814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bf759e700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 0x7f4bf80c3a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000ea80 tx=0x7f4bf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bdeffd700 1 -- 172.21.15.19:0/284940517 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00096b0 con 0x7f4bf815b240 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bdeffd700 1 -- 172.21.15.19:0/284940517 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf000c850 con 0x7f4bf815b240 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf8159b90 con 0x7f4bf815b240 2024-08-17T02:26:59.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bdeffd700 1 -- 172.21.15.19:0/284940517 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000cc10 con 0x7f4bf815b240 2024-08-17T02:26:59.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf80c3200 con 0x7f4bf815b240 2024-08-17T02:26:59.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.687+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf80c3700 con 0x7f4bf815b240 2024-08-17T02:26:59.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.691+0000 7f4bdeffd700 1 -- 172.21.15.19:0/284940517 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4bf0013470 con 0x7f4bf815b240 2024-08-17T02:26:59.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.691+0000 7f4bdeffd700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4be4060860 0x7f4be4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.691+0000 7f4bdeffd700 1 -- 172.21.15.19:0/284940517 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4bf007cd80 con 0x7f4bf815b240 2024-08-17T02:26:59.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.691+0000 7f4bf6d9d700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4be4060860 0x7f4be4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.691+0000 7f4bf6d9d700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4be4060860 0x7f4be4062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4be8001d80 tx=0x7f4be8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.699+0000 7f4bdeffd700 1 -- 172.21.15.19:0/284940517 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4bf004d130 con 0x7f4bf815b240 2024-08-17T02:26:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.903+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bf80638f0 con 0x7f4bf815b240 2024-08-17T02:26:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.903+0000 7f4bdeffd700 1 -- 172.21.15.19:0/284940517 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f4bf0050750 con 0x7f4bf815b240 2024-08-17T02:26:59.909 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:26:59.909 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/903872793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":903872793},{"type":"v1","addr":"172.21.15.19:6833","nonce":903872793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3217936958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3217936958},{"type":"v1","addr":"172.21.15.19:6835","nonce":3217936958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/183789327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":183789327},{"type":"v1","addr":"172.21.15.119:6837","nonce":183789327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:28.987569+0000","modified":"2024-08-17T02:26:31.636583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4be4060860 msgr2=0x7f4be4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4be4060860 0x7f4be4062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4be8001d80 tx=0x7f4be8009040 comp rx=0 tx=0).stop 2024-08-17T02:26:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 msgr2=0x7f4bf80c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 0x7f4bf80c3a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000ea80 tx=0x7f4bf00091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 shutdown_connections 2024-08-17T02:26:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4be4060860 0x7f4be4062d10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf815b240 0x7f4bf80c3a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf8151740 0x7f4bf815a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 --2- 172.21.15.19:0/284940517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bf8151370 0x7f4bf814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 >> 172.21.15.19:0/284940517 conn(0x7f4bf806cc40 msgr2=0x7f4bf80b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 shutdown_connections 2024-08-17T02:26:59.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:26:59.907+0000 7f4bfc8c6700 1 -- 172.21.15.19:0/284940517 wait complete. 2024-08-17T02:26:59.913 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-08-17T02:26:59.924 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:00.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd7159700 1 Processor -- start 2024-08-17T02:27:00.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd7159700 1 -- start start 2024-08-17T02:27:00.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd7159700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7bd015d5b0 0x7f7bd00d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd7159700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd00cf190 con 0x7f7bd00d0010 2024-08-17T02:27:00.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd7159700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd00d09a0 con 0x7f7bd0159040 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd7159700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd015d9f0 con 0x7f7bd015d5b0 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd6958700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7bd015d5b0 0x7f7bd00d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd6958700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7bd015d5b0 0x7f7bd00d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58430/0 (socket says 172.21.15.19:58430) 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd6958700 1 -- 172.21.15.19:0/1703974337 learned_addr learned my addr 172.21.15.19:0/1703974337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd5956700 1 --1- 172.21.15.19:0/1703974337 >> v1:172.21.15.19:6789/0 conn(0x7f7bd00d0010 0x7f7bd015cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54224/0 (socket says 172.21.15.19:54224) 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd6958700 1 -- 172.21.15.19:0/1703974337 >> v1:172.21.15.119:6789/0 conn(0x7f7bd0159040 legacy=0x7f7bd00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd6958700 1 -- 172.21.15.19:0/1703974337 >> v1:172.21.15.19:6789/0 conn(0x7f7bd00d0010 legacy=0x7f7bd015cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd5155700 1 -- 172.21.15.19:0/1703974337 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4311396 0 0) 0x7f7bd00cf190 con 0x7f7bd00d0010 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd6958700 1 -- 172.21.15.19:0/1703974337 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd00ce5e0 con 0x7f7bd015d5b0 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.023+0000 7f7bd6958700 1 --2- 172.21.15.19:0/1703974337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd015d5b0 0x7f7bd00d0460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009f20 tx=0x7f7bc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66955a731476afb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd5155700 1 -- 172.21.15.19:0/1703974337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc800e070 con 0x7f7bd015d5b0 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd5155700 1 -- 172.21.15.19:0/1703974337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc800ba80 con 0x7f7bd015d5b0 2024-08-17T02:27:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd5155700 1 -- 172.21.15.19:0/1703974337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc80092e0 con 0x7f7bd015d5b0 2024-08-17T02:27:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd7159700 1 -- 172.21.15.19:0/1703974337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd015d5b0 msgr2=0x7f7bd00d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd7159700 1 --2- 172.21.15.19:0/1703974337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd015d5b0 0x7f7bd00d0460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009f20 tx=0x7f7bc8009840 comp rx=0 tx=0).stop 2024-08-17T02:27:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd7159700 1 -- 172.21.15.19:0/1703974337 shutdown_connections 2024-08-17T02:27:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd7159700 1 --2- 172.21.15.19:0/1703974337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd015d5b0 0x7f7bd00d0460 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd7159700 1 -- 172.21.15.19:0/1703974337 >> 172.21.15.19:0/1703974337 conn(0x7f7bd0068250 msgr2=0x7f7bd0068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd7159700 1 -- 172.21.15.19:0/1703974337 shutdown_connections 2024-08-17T02:27:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd7159700 1 -- 172.21.15.19:0/1703974337 wait complete. 2024-08-17T02:27:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd7159700 1 Processor -- start 2024-08-17T02:27:00.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.027+0000 7f7bd7159700 1 -- start start 2024-08-17T02:27:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd7159700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd00d0010 0x7f7bd0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd7159700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd0159040 0x7f7bd00afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd7159700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd015d5b0 0x7f7bd01436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd7159700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd00b13b0 con 0x7f7bd00d0010 2024-08-17T02:27:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd7159700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd00a6c40 con 0x7f7bd0159040 2024-08-17T02:27:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd7159700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd00b0520 con 0x7f7bd015d5b0 2024-08-17T02:27:00.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6157700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd00d0010 0x7f7bd0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6157700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd00d0010 0x7f7bd0068850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58442/0 (socket says 172.21.15.19:58442) 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6157700 1 -- 172.21.15.19:0/1308450168 learned_addr learned my addr 172.21.15.19:0/1308450168 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd5956700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd0159040 0x7f7bd00afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6958700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd015d5b0 0x7f7bd01436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6157700 1 -- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd015d5b0 msgr2=0x7f7bd01436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6157700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd015d5b0 0x7f7bd01436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6157700 1 -- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd0159040 msgr2=0x7f7bd00afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6157700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd0159040 0x7f7bd00afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6157700 1 -- 172.21.15.19:0/1308450168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8009ae0 con 0x7f7bd00d0010 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd6157700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd00d0010 0x7f7bd0068850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00c4e0 tx=0x7f7bcc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bc67fc700 1 -- 172.21.15.19:0/1308450168 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc011590 con 0x7f7bd00d0010 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bc67fc700 1 -- 172.21.15.19:0/1308450168 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc011710 con 0x7f7bd00d0010 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd00b0800 con 0x7f7bd00d0010 2024-08-17T02:27:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bc67fc700 1 -- 172.21.15.19:0/1308450168 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc011ad0 con 0x7f7bd00d0010 2024-08-17T02:27:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd00b1020 con 0x7f7bd00d0010 2024-08-17T02:27:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.031+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd00b3480 con 0x7f7bd00d0010 2024-08-17T02:27:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.035+0000 7f7bc67fc700 1 -- 172.21.15.19:0/1308450168 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7bcc01b3b0 con 0x7f7bd00d0010 2024-08-17T02:27:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.035+0000 7f7bc67fc700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7bb4060860 0x7f7bb4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.035+0000 7f7bc67fc700 1 -- 172.21.15.19:0/1308450168 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7bcc07c100 con 0x7f7bd00d0010 2024-08-17T02:27:00.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.035+0000 7f7bd5956700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7bb4060860 0x7f7bb4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.035+0000 7f7bd5956700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7bb4060860 0x7f7bb4062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0007fd0 tx=0x7f7bc0007db0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.043+0000 7f7bc67fc700 1 -- 172.21.15.19:0/1308450168 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7bcc04c550 con 0x7f7bd00d0010 2024-08-17T02:27:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.203+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bd00cfdf0 con 0x7f7bd00d0010 2024-08-17T02:27:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bc67fc700 1 -- 172.21.15.19:0/1308450168 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f7bcc04fb70 con 0x7f7bd00d0010 2024-08-17T02:27:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:00.211 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7bb4060860 msgr2=0x7f7bb4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7bb4060860 0x7f7bb4062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0007fd0 tx=0x7f7bc0007db0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd00d0010 msgr2=0x7f7bd0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd00d0010 0x7f7bd0068850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00c4e0 tx=0x7f7bcc00c8a0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 shutdown_connections 2024-08-17T02:27:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7bb4060860 0x7f7bb4062d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd015d5b0 0x7f7bd01436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd0159040 0x7f7bd00afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 --2- 172.21.15.19:0/1308450168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bd00d0010 0x7f7bd0068850 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 >> 172.21.15.19:0/1308450168 conn(0x7f7bd0068250 msgr2=0x7f7bd0152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 shutdown_connections 2024-08-17T02:27:00.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.207+0000 7f7bd7159700 1 -- 172.21.15.19:0/1308450168 wait complete. 2024-08-17T02:27:00.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:27.555224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:27.958499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:00.226 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:00.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.339+0000 7f26ff59e700 1 Processor -- start 2024-08-17T02:27:00.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.339+0000 7f26ff59e700 1 -- start start 2024-08-17T02:27:00.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.339+0000 7f26ff59e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f27000b0390 0x7f27000cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.339+0000 7f26ff59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 0x7f270015d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.339+0000 7f26ff59e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27000cc350 con 0x7f270015d750 2024-08-17T02:27:00.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.339+0000 7f26ff59e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27000ca760 con 0x7f27000b0390 2024-08-17T02:27:00.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.339+0000 7f26ff59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27000cd3f0 con 0x7f270015cda0 2024-08-17T02:27:00.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.339+0000 7f26fe59c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f27000b0390 0x7f27000cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fdd9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 0x7f270015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fed9d700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f270015d750 0x7f2700159760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:58868/0 (socket says 172.21.15.19:58868) 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fed9d700 1 -- 172.21.15.19:0/483111626 learned_addr learned my addr 172.21.15.19:0/483111626 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fd59a700 1 -- 172.21.15.19:0/483111626 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483410999 0 0) 0x7f27000cc350 con 0x7f270015d750 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fd59a700 1 -- 172.21.15.19:0/483111626 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26ec003570 con 0x7f270015d750 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fdd9b700 1 -- 172.21.15.19:0/483111626 >> v2:172.21.15.119:3300/0 conn(0x7f27000b0390 msgr2=0x7f27000cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fdd9b700 1 --2- 172.21.15.19:0/483111626 >> v2:172.21.15.119:3300/0 conn(0x7f27000b0390 0x7f27000cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fdd9b700 1 -- 172.21.15.19:0/483111626 >> v1:172.21.15.119:6789/0 conn(0x7f270015d750 legacy=0x7f2700159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fdd9b700 1 -- 172.21.15.19:0/483111626 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27000cc630 con 0x7f270015cda0 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fe59c700 1 --2- 172.21.15.19:0/483111626 >> v2:172.21.15.119:3300/0 conn(0x7f27000b0390 0x7f27000cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fdd9b700 1 --2- 172.21.15.19:0/483111626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 0x7f270015d210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f26f00098e0 tx=0x7f26f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80461513f10d6141 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fd59a700 1 -- 172.21.15.19:0/483111626 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011630 con 0x7f270015cda0 2024-08-17T02:27:00.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fd59a700 1 -- 172.21.15.19:0/483111626 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f0011790 con 0x7f270015cda0 2024-08-17T02:27:00.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26fd59a700 1 -- 172.21.15.19:0/483111626 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011b30 con 0x7f270015cda0 2024-08-17T02:27:00.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26ff59e700 1 -- 172.21.15.19:0/483111626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 msgr2=0x7f270015d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26ff59e700 1 --2- 172.21.15.19:0/483111626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 0x7f270015d210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f26f00098e0 tx=0x7f26f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26ff59e700 1 -- 172.21.15.19:0/483111626 shutdown_connections 2024-08-17T02:27:00.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26ff59e700 1 --2- 172.21.15.19:0/483111626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 0x7f270015d210 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26ff59e700 1 --2- 172.21.15.19:0/483111626 >> v2:172.21.15.119:3300/0 conn(0x7f27000b0390 0x7f27000cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26ff59e700 1 -- 172.21.15.19:0/483111626 >> 172.21.15.19:0/483111626 conn(0x7f27000cdee0 msgr2=0x7f27000ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26ff59e700 1 -- 172.21.15.19:0/483111626 shutdown_connections 2024-08-17T02:27:00.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.343+0000 7f26ff59e700 1 -- 172.21.15.19:0/483111626 wait complete. 2024-08-17T02:27:00.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 Processor -- start 2024-08-17T02:27:00.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 -- start start 2024-08-17T02:27:00.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27000b0390 0x7f27000b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 0x7f27001458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f270015d750 0x7f270015b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27000b2830 con 0x7f270015d750 2024-08-17T02:27:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2700169810 con 0x7f27000b0390 2024-08-17T02:27:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2700169af0 con 0x7f270015cda0 2024-08-17T02:27:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f270015d750 0x7f270015b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f270015d750 0x7f270015b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58456/0 (socket says 172.21.15.19:58456) 2024-08-17T02:27:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fed9d700 1 -- 172.21.15.19:0/138064030 learned_addr learned my addr 172.21.15.19:0/138064030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fdd9b700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 0x7f27001458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fe59c700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27000b0390 0x7f27000b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fed9d700 1 -- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 msgr2=0x7f27001458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fed9d700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 0x7f27001458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fed9d700 1 -- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27000b0390 msgr2=0x7f27000b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fed9d700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27000b0390 0x7f27000b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fed9d700 1 -- 172.21.15.19:0/138064030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e8009420 con 0x7f270015d750 2024-08-17T02:27:00.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26fed9d700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f270015d750 0x7f270015b120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f26f800cb90 tx=0x7f26f80019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26f67fc700 1 -- 172.21.15.19:0/138064030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800a7e0 con 0x7f270015d750 2024-08-17T02:27:00.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f0009420 con 0x7f270015d750 2024-08-17T02:27:00.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26f67fc700 1 -- 172.21.15.19:0/138064030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f800a960 con 0x7f270015d750 2024-08-17T02:27:00.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26f67fc700 1 -- 172.21.15.19:0/138064030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800ad20 con 0x7f270015d750 2024-08-17T02:27:00.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.347+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270016a0b0 con 0x7f270015d750 2024-08-17T02:27:00.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.351+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27000638f0 con 0x7f270015d750 2024-08-17T02:27:00.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.351+0000 7f26f67fc700 1 -- 172.21.15.19:0/138064030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f26f8007300 con 0x7f270015d750 2024-08-17T02:27:00.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.351+0000 7f26f67fc700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e0060860 0x7f26e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.351+0000 7f26f67fc700 1 -- 172.21.15.19:0/138064030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26f807ce00 con 0x7f270015d750 2024-08-17T02:27:00.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.351+0000 7f26fe59c700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e0060860 0x7f26e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.351+0000 7f26fe59c700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e0060860 0x7f26e0062d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2700166fb0 tx=0x7f26e80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.359+0000 7f26f67fc700 1 -- 172.21.15.19:0/138064030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f26f804d250 con 0x7f270015d750 2024-08-17T02:27:00.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.519+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27000ca320 con 0x7f270015d750 2024-08-17T02:27:00.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.519+0000 7f26f67fc700 1 -- 172.21.15.19:0/138064030 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26f8050870 con 0x7f270015d750 2024-08-17T02:27:00.526 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:27:00.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e0060860 msgr2=0x7f26e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e0060860 0x7f26e0062d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2700166fb0 tx=0x7f26e80091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f270015d750 msgr2=0x7f270015b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f270015d750 0x7f270015b120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f26f800cb90 tx=0x7f26f80019c0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 shutdown_connections 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e0060860 0x7f26e0062d10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f270015d750 0x7f270015b120 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f270015cda0 0x7f27001458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 --2- 172.21.15.19:0/138064030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27000b0390 0x7f27000b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 >> 172.21.15.19:0/138064030 conn(0x7f27000cdee0 msgr2=0x7f2700156720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 shutdown_connections 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.523+0000 7f26ff59e700 1 -- 172.21.15.19:0/138064030 wait complete. 2024-08-17T02:27:00.540 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.647+0000 7f1ac20ff700 1 Processor -- start 2024-08-17T02:27:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.647+0000 7f1ac20ff700 1 -- start start 2024-08-17T02:27:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1abc067510 0x7f1abc0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1abc159480 0x7f1abc0cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1abc0ce210 con 0x7f1abc1590b0 2024-08-17T02:27:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1abc0cba00 con 0x7f1abc159480 2024-08-17T02:27:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1abc0cdc90 con 0x7f1abc067510 2024-08-17T02:27:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac18fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1abc159480 0x7f1abc0cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac18fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1abc159480 0x7f1abc0cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58462/0 (socket says 172.21.15.19:58462) 2024-08-17T02:27:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac18fe700 1 -- 172.21.15.19:0/1140301580 learned_addr learned my addr 172.21.15.19:0/1140301580 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:00.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac08fc700 1 --2- 172.21.15.19:0/1140301580 >> v2:172.21.15.119:3300/0 conn(0x7f1abc067510 0x7f1abc0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac18fe700 1 -- 172.21.15.19:0/1140301580 >> v2:172.21.15.119:3300/0 conn(0x7f1abc067510 msgr2=0x7f1abc0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac18fe700 1 --2- 172.21.15.19:0/1140301580 >> v2:172.21.15.119:3300/0 conn(0x7f1abc067510 0x7f1abc0ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac18fe700 1 -- 172.21.15.19:0/1140301580 >> v1:172.21.15.119:6789/0 conn(0x7f1abc1590b0 legacy=0x7f1abc066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac18fe700 1 -- 172.21.15.19:0/1140301580 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc0cb440 con 0x7f1abc159480 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac18fe700 1 --2- 172.21.15.19:0/1140301580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 0x7f1abc0cebe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1abc067c20 tx=0x7f1ab4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6caa0412693de68 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1aaffff700 1 -- 172.21.15.19:0/1140301580 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab400e070 con 0x7f1abc159480 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1aaffff700 1 -- 172.21.15.19:0/1140301580 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab400ba20 con 0x7f1abc159480 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1aaffff700 1 -- 172.21.15.19:0/1140301580 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40092e0 con 0x7f1abc159480 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 -- 172.21.15.19:0/1140301580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 msgr2=0x7f1abc0cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 --2- 172.21.15.19:0/1140301580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 0x7f1abc0cebe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1abc067c20 tx=0x7f1ab4009840 comp rx=0 tx=0).stop 2024-08-17T02:27:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 -- 172.21.15.19:0/1140301580 shutdown_connections 2024-08-17T02:27:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 --2- 172.21.15.19:0/1140301580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 0x7f1abc0cebe0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 --2- 172.21.15.19:0/1140301580 >> v2:172.21.15.119:3300/0 conn(0x7f1abc067510 0x7f1abc0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 -- 172.21.15.19:0/1140301580 >> 172.21.15.19:0/1140301580 conn(0x7f1abc0d0b90 msgr2=0x7f1abc0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 -- 172.21.15.19:0/1140301580 shutdown_connections 2024-08-17T02:27:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.651+0000 7f1ac20ff700 1 -- 172.21.15.19:0/1140301580 wait complete. 2024-08-17T02:27:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac20ff700 1 Processor -- start 2024-08-17T02:27:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac20ff700 1 -- start start 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac20ff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1abc067510 0x7f1abc153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac20ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1abc1590b0 0x7f1abc150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac20ff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 0x7f1abc1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac20ff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc16d8f0 con 0x7f1abc159480 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac20ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc153590 con 0x7f1abc1590b0 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac20ff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc16cc70 con 0x7f1abc067510 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac18fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 0x7f1abc1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac18fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 0x7f1abc1537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58478/0 (socket says 172.21.15.19:58478) 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac08fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1abc1590b0 0x7f1abc150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac10fd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1abc067510 0x7f1abc153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac18fe700 1 -- 172.21.15.19:0/2575589327 learned_addr learned my addr 172.21.15.19:0/2575589327 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac18fe700 1 -- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1abc067510 msgr2=0x7f1abc153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac18fe700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1abc067510 0x7f1abc153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac18fe700 1 -- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1abc1590b0 msgr2=0x7f1abc150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac18fe700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1abc1590b0 0x7f1abc150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac18fe700 1 -- 172.21.15.19:0/2575589327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4009ae0 con 0x7f1abc159480 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1ac18fe700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 0x7f1abc1537a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009880 tx=0x7f1ab4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.655+0000 7f1aad7fa700 1 -- 172.21.15.19:0/2575589327 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4008a80 con 0x7f1abc159480 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.659+0000 7f1aad7fa700 1 -- 172.21.15.19:0/2575589327 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4008be0 con 0x7f1abc159480 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.659+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc16cf50 con 0x7f1abc159480 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.659+0000 7f1aad7fa700 1 -- 172.21.15.19:0/2575589327 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4025460 con 0x7f1abc159480 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.659+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc16d510 con 0x7f1abc159480 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.659+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc064330 con 0x7f1abc159480 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.659+0000 7f1aad7fa700 1 -- 172.21.15.19:0/2575589327 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1ab4003040 con 0x7f1abc159480 2024-08-17T02:27:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.659+0000 7f1aad7fa700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1aa0060890 0x7f1aa0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.659+0000 7f1aad7fa700 1 -- 172.21.15.19:0/2575589327 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ab407e6b0 con 0x7f1abc159480 2024-08-17T02:27:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.659+0000 7f1ac10fd700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1aa0060890 0x7f1aa0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.663+0000 7f1ac10fd700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1aa0060890 0x7f1aa0062d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0003aa0 tx=0x7f1ab0000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.667+0000 7f1aad7fa700 1 -- 172.21.15.19:0/2575589327 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1ab404eb00 con 0x7f1abc159480 2024-08-17T02:27:00.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.831+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1abc070cf0 con 0x7f1abc159480 2024-08-17T02:27:00.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.831+0000 7f1aad7fa700 1 -- 172.21.15.19:0/2575589327 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ab4009940 con 0x7f1abc159480 2024-08-17T02:27:00.836 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:27:00.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1aa0060890 msgr2=0x7f1aa0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1aa0060890 0x7f1aa0062d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0003aa0 tx=0x7f1ab0000bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 msgr2=0x7f1abc1537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 0x7f1abc1537a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009880 tx=0x7f1ab4018000 comp rx=0 tx=0).stop 2024-08-17T02:27:00.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 shutdown_connections 2024-08-17T02:27:00.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1aa0060890 0x7f1aa0062d40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1abc159480 0x7f1abc1537a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1abc1590b0 0x7f1abc150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 --2- 172.21.15.19:0/2575589327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1abc067510 0x7f1abc153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 >> 172.21.15.19:0/2575589327 conn(0x7f1abc0d0b90 msgr2=0x7f1abc0cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 shutdown_connections 2024-08-17T02:27:00.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.835+0000 7f1ac20ff700 1 -- 172.21.15.19:0/2575589327 wait complete. 2024-08-17T02:27:00.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.959+0000 7f26fc839700 1 Processor -- start 2024-08-17T02:27:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.959+0000 7f26fc839700 1 -- start start 2024-08-17T02:27:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813f680 0x7f26f80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26f80ad6c0 0x7f26f806e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f80b0810 con 0x7f26f813fa50 2024-08-17T02:27:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f80afc70 con 0x7f26f80ad6c0 2024-08-17T02:27:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f80af060 con 0x7f26f813f680 2024-08-17T02:27:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f659c700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f26f813fa50 0x7f26f80b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:58880/0 (socket says 172.21.15.19:58880) 2024-08-17T02:27:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f659c700 1 -- 172.21.15.19:0/2266095188 learned_addr learned my addr 172.21.15.19:0/2266095188 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f759e700 1 --2- 172.21.15.19:0/2266095188 >> v2:172.21.15.119:3300/0 conn(0x7f26f80ad6c0 0x7f26f806e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f6d9d700 1 --2- 172.21.15.19:0/2266095188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813f680 0x7f26f80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f5d9b700 1 -- 172.21.15.19:0/2266095188 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865422114 0 0) 0x7f26f80b0810 con 0x7f26f813fa50 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f5d9b700 1 -- 172.21.15.19:0/2266095188 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d8003570 con 0x7f26f813fa50 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f759e700 1 -- 172.21.15.19:0/2266095188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813f680 msgr2=0x7f26f80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f759e700 1 --2- 172.21.15.19:0/2266095188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813f680 0x7f26f80aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f759e700 1 -- 172.21.15.19:0/2266095188 >> v1:172.21.15.119:6789/0 conn(0x7f26f813fa50 legacy=0x7f26f80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f759e700 1 -- 172.21.15.19:0/2266095188 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80af340 con 0x7f26f80ad6c0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f759e700 1 --2- 172.21.15.19:0/2266095188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26f80ad6c0 0x7f26f806e010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f26e80098e0 tx=0x7f26e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79611612c45ddf3e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f5d9b700 1 -- 172.21.15.19:0/2266095188 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8011630 con 0x7f26f80ad6c0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f5d9b700 1 -- 172.21.15.19:0/2266095188 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e8011790 con 0x7f26f80ad6c0 2024-08-17T02:27:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26f5d9b700 1 -- 172.21.15.19:0/2266095188 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8011b30 con 0x7f26f80ad6c0 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 -- 172.21.15.19:0/2266095188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26f80ad6c0 msgr2=0x7f26f806e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 --2- 172.21.15.19:0/2266095188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26f80ad6c0 0x7f26f806e010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f26e80098e0 tx=0x7f26e80091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 -- 172.21.15.19:0/2266095188 shutdown_connections 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 --2- 172.21.15.19:0/2266095188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26f80ad6c0 0x7f26f806e010 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 --2- 172.21.15.19:0/2266095188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813f680 0x7f26f80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 -- 172.21.15.19:0/2266095188 >> 172.21.15.19:0/2266095188 conn(0x7f26f80678a0 msgr2=0x7f26f8067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 -- 172.21.15.19:0/2266095188 shutdown_connections 2024-08-17T02:27:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.963+0000 7f26fc839700 1 -- 172.21.15.19:0/2266095188 wait complete. 2024-08-17T02:27:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26fc839700 1 Processor -- start 2024-08-17T02:27:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26fc839700 1 -- start start 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26fc839700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26f80ad6c0 0x7f26f81350a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26fc839700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26f813f680 0x7f26f81336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26fc839700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813fa50 0x7f26f814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26fc839700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f8134000 con 0x7f26f80ad6c0 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26fc839700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f81342e0 con 0x7f26f813f680 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26fc839700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f81345c0 con 0x7f26f813fa50 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f6d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26f80ad6c0 0x7f26f81350a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f6d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26f80ad6c0 0x7f26f81350a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58484/0 (socket says 172.21.15.19:58484) 2024-08-17T02:27:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f659c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26f813f680 0x7f26f81336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f6d9d700 1 -- 172.21.15.19:0/2833120547 learned_addr learned my addr 172.21.15.19:0/2833120547 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f759e700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813fa50 0x7f26f814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f6d9d700 1 -- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813fa50 msgr2=0x7f26f814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f6d9d700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813fa50 0x7f26f814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f6d9d700 1 -- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26f813f680 msgr2=0x7f26f81336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f6d9d700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26f813f680 0x7f26f81336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f6d9d700 1 -- 172.21.15.19:0/2833120547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e8009420 con 0x7f26f80ad6c0 2024-08-17T02:27:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.967+0000 7f26f6d9d700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26f80ad6c0 0x7f26f81350a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f26f000ec80 tx=0x7f26f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.971+0000 7f26eeffd700 1 -- 172.21.15.19:0/2833120547 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000c850 con 0x7f26f80ad6c0 2024-08-17T02:27:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.971+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f81348a0 con 0x7f26f80ad6c0 2024-08-17T02:27:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.971+0000 7f26eeffd700 1 -- 172.21.15.19:0/2833120547 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f000c9b0 con 0x7f26f80ad6c0 2024-08-17T02:27:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.971+0000 7f26eeffd700 1 -- 172.21.15.19:0/2833120547 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f000cd50 con 0x7f26f80ad6c0 2024-08-17T02:27:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.971+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f8133be0 con 0x7f26f80ad6c0 2024-08-17T02:27:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.971+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f8134d20 con 0x7f26f80ad6c0 2024-08-17T02:27:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.971+0000 7f26eeffd700 1 -- 172.21.15.19:0/2833120547 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f26f0013680 con 0x7f26f80ad6c0 2024-08-17T02:27:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.975+0000 7f26eeffd700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26dc060860 0x7f26dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.975+0000 7f26eeffd700 1 -- 172.21.15.19:0/2833120547 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26f007cf60 con 0x7f26f80ad6c0 2024-08-17T02:27:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.975+0000 7f26f659c700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26dc060860 0x7f26dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.975+0000 7f26f659c700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26dc060860 0x7f26dc062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f26f8068890 tx=0x7f26e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:00.983+0000 7f26eeffd700 1 -- 172.21.15.19:0/2833120547 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f26f004d310 con 0x7f26f80ad6c0 2024-08-17T02:27:01.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.139+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26f8064330 con 0x7f26f80ad6c0 2024-08-17T02:27:01.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.139+0000 7f26eeffd700 1 -- 172.21.15.19:0/2833120547 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26f0050930 con 0x7f26f80ad6c0 2024-08-17T02:27:01.145 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-08-17T02:27:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26dc060860 msgr2=0x7f26dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26dc060860 0x7f26dc062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f26f8068890 tx=0x7f26e0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26f80ad6c0 msgr2=0x7f26f81350a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26f80ad6c0 0x7f26f81350a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f26f000ec80 tx=0x7f26f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 shutdown_connections 2024-08-17T02:27:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26dc060860 0x7f26dc062d10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26f813fa50 0x7f26f814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26f813f680 0x7f26f81336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 --2- 172.21.15.19:0/2833120547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26f80ad6c0 0x7f26f81350a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 >> 172.21.15.19:0/2833120547 conn(0x7f26f80678a0 msgr2=0x7f26f8067c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 shutdown_connections 2024-08-17T02:27:01.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.143+0000 7f26fc839700 1 -- 172.21.15.19:0/2833120547 wait complete. 2024-08-17T02:27:01.160 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:01.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d35686700 1 Processor -- start 2024-08-17T02:27:01.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d35686700 1 -- start start 2024-08-17T02:27:01.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d35686700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d300cb560 0x7f4d30161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d35686700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d300cbaa0 con 0x7f4d300b14a0 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d35686700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d30157630 con 0x7f4d30154900 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d35686700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30068790 con 0x7f4d300cb560 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d2f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4d300b14a0 0x7f4d300cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54238/0 (socket says 172.21.15.19:54238) 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d2f7fe700 1 -- 172.21.15.19:0/1279512325 learned_addr learned my addr 172.21.15.19:0/1279512325 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d34e85700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d300cb560 0x7f4d30161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015700443 0 0) 0x7f4d300cbaa0 con 0x7f4d300b14a0 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.259+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d18003570 con 0x7f4d300b14a0 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2945095961 0 0) 0x7f4d18003570 con 0x7f4d300b14a0 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d300cb560 msgr2=0x7f4d30161ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d300cb560 0x7f4d30161ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 >> v1:172.21.15.119:6789/0 conn(0x7f4d30154900 legacy=0x7f4d300b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30157910 con 0x7f4d300b14a0 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f4d24001470 con 0x7f4d300b14a0 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 >> v1:172.21.15.19:6789/0 conn(0x7f4d300b14a0 legacy=0x7f4d300cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18003a90 0x7f4d18003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d18004810 0x7f4d18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d300cb560 0x7f4d180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30068790 con 0x7f4d18003a90 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1800bb10 con 0x7f4d18004810 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1800bcd0 con 0x7f4d300cb560 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2ffff700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18003a90 0x7f4d18003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d34e85700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d300cb560 0x7f4d180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2f7fe700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d18004810 0x7f4d18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2f7fe700 1 -- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d300cb560 msgr2=0x7f4d180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2f7fe700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d300cb560 0x7f4d180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2f7fe700 1 -- 172.21.15.19:0/1279512325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18003a90 msgr2=0x7f4d18003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2f7fe700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18003a90 0x7f4d18003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2f7fe700 1 -- 172.21.15.19:0/1279512325 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18003570 con 0x7f4d18004810 2024-08-17T02:27:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2ffff700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18003a90 0x7f4d18003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2f7fe700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d18004810 0x7f4d18004c80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c390 tx=0x7f4d24001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d685f42c8eaec6e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400cc60 con 0x7f4d18004810 2024-08-17T02:27:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400cdc0 con 0x7f4d18004810 2024-08-17T02:27:01.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d2effd700 1 -- 172.21.15.19:0/1279512325 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24005b70 con 0x7f4d18004810 2024-08-17T02:27:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d35686700 1 -- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d18004810 msgr2=0x7f4d18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d35686700 1 --2- 172.21.15.19:0/1279512325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d18004810 0x7f4d18004c80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c390 tx=0x7f4d24001e70 comp rx=0 tx=0).stop 2024-08-17T02:27:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d34e85700 1 -- 172.21.15.19:0/1279512325 reap_dead start 2024-08-17T02:27:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d35686700 1 -- 172.21.15.19:0/1279512325 shutdown_connections 2024-08-17T02:27:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d35686700 1 -- 172.21.15.19:0/1279512325 >> 172.21.15.19:0/1279512325 conn(0x7f4d300678d0 msgr2=0x7f4d30067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d35686700 1 -- 172.21.15.19:0/1279512325 shutdown_connections 2024-08-17T02:27:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.263+0000 7f4d35686700 1 -- 172.21.15.19:0/1279512325 wait complete. 2024-08-17T02:27:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d35686700 1 Processor -- start 2024-08-17T02:27:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d35686700 1 -- start start 2024-08-17T02:27:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d35686700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18004810 0x7f4d300a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d35686700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d30168ad0 0x7f4d3014f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d35686700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d3014fe40 0x7f4d300af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d35686700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d301502b0 con 0x7f4d18004810 2024-08-17T02:27:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d35686700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300aef70 con 0x7f4d30168ad0 2024-08-17T02:27:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d35686700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300af250 con 0x7f4d3014fe40 2024-08-17T02:27:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18004810 0x7f4d300a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2f7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d30168ad0 0x7f4d3014f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d34e85700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d3014fe40 0x7f4d300af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18004810 0x7f4d300a6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58510/0 (socket says 172.21.15.19:58510) 2024-08-17T02:27:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2ffff700 1 -- 172.21.15.19:0/3508049963 learned_addr learned my addr 172.21.15.19:0/3508049963 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2ffff700 1 -- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d3014fe40 msgr2=0x7f4d300af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2ffff700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d3014fe40 0x7f4d300af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2ffff700 1 -- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d30168ad0 msgr2=0x7f4d3014f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2ffff700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d30168ad0 0x7f4d3014f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2ffff700 1 -- 172.21.15.19:0/3508049963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30169300 con 0x7f4d18004810 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2f7fe700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d30168ad0 0x7f4d3014f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.267+0000 7f4d2ffff700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18004810 0x7f4d300a6100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000fc00 tx=0x7f4d20009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.271+0000 7f4d17fff700 1 -- 172.21.15.19:0/3508049963 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2000d850 con 0x7f4d18004810 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.271+0000 7f4d17fff700 1 -- 172.21.15.19:0/3508049963 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2000d9b0 con 0x7f4d18004810 2024-08-17T02:27:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.271+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d301695e0 con 0x7f4d18004810 2024-08-17T02:27:01.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.271+0000 7f4d17fff700 1 -- 172.21.15.19:0/3508049963 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2000dd30 con 0x7f4d18004810 2024-08-17T02:27:01.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.271+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d30168f20 con 0x7f4d18004810 2024-08-17T02:27:01.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.271+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d300643a0 con 0x7f4d18004810 2024-08-17T02:27:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.271+0000 7f4d17fff700 1 -- 172.21.15.19:0/3508049963 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4d20013600 con 0x7f4d18004810 2024-08-17T02:27:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.271+0000 7f4d17fff700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4d1c060890 0x7f4d1c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.271+0000 7f4d17fff700 1 -- 172.21.15.19:0/3508049963 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d2007cea0 con 0x7f4d18004810 2024-08-17T02:27:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.275+0000 7f4d2f7fe700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4d1c060890 0x7f4d1c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.275+0000 7f4d2f7fe700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4d1c060890 0x7f4d1c062d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4d300a5c10 tx=0x7f4d24015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.279+0000 7f4d17fff700 1 -- 172.21.15.19:0/3508049963 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4d2004d2f0 con 0x7f4d18004810 2024-08-17T02:27:01.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d300a5c40 con 0x7f4d18004810 2024-08-17T02:27:01.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d17fff700 1 -- 172.21.15.19:0/3508049963 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f4d20050910 con 0x7f4d18004810 2024-08-17T02:27:01.483 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:01.483 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/903872793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":903872793},{"type":"v1","addr":"172.21.15.19:6833","nonce":903872793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3217936958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3217936958},{"type":"v1","addr":"172.21.15.19:6835","nonce":3217936958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/183789327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":183789327},{"type":"v1","addr":"172.21.15.119:6837","nonce":183789327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:28.987569+0000","modified":"2024-08-17T02:26:31.636583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4d1c060890 msgr2=0x7f4d1c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4d1c060890 0x7f4d1c062d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4d300a5c10 tx=0x7f4d24015000 comp rx=0 tx=0).stop 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18004810 msgr2=0x7f4d300a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18004810 0x7f4d300a6100 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000fc00 tx=0x7f4d20009040 comp rx=0 tx=0).stop 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 shutdown_connections 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4d1c060890 0x7f4d1c062d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d3014fe40 0x7f4d300af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d30168ad0 0x7f4d3014f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 --2- 172.21.15.19:0/3508049963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d18004810 0x7f4d300a6100 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 >> 172.21.15.19:0/3508049963 conn(0x7f4d300678d0 msgr2=0x7f4d3006de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 shutdown_connections 2024-08-17T02:27:01.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.479+0000 7f4d35686700 1 -- 172.21.15.19:0/3508049963 wait complete. 2024-08-17T02:27:01.487 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-08-17T02:27:01.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e759e700 1 Processor -- start 2024-08-17T02:27:01.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e759e700 1 -- start start 2024-08-17T02:27:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 0x7f89e80cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e759e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e80cf190 con 0x7f89e815d5b0 2024-08-17T02:27:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e759e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e80ce5e0 con 0x7f89e80d0010 2024-08-17T02:27:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80ce860 con 0x7f89e8159040 2024-08-17T02:27:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e6d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f89e815d5b0 0x7f89e815aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54242/0 (socket says 172.21.15.19:54242) 2024-08-17T02:27:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e6d9d700 1 -- 172.21.15.19:0/921009842 learned_addr learned my addr 172.21.15.19:0/921009842 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:01.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e659c700 1 --2- 172.21.15.19:0/921009842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 0x7f89e80cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e559a700 1 -- 172.21.15.19:0/921009842 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193242221 0 0) 0x7f89e80cf190 con 0x7f89e815d5b0 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e559a700 1 -- 172.21.15.19:0/921009842 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c8003570 con 0x7f89e815d5b0 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e559a700 1 -- 172.21.15.19:0/921009842 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147779787 0 0) 0x7f89e80ce5e0 con 0x7f89e80d0010 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e659c700 1 -- 172.21.15.19:0/921009842 >> v1:172.21.15.119:6789/0 conn(0x7f89e80d0010 legacy=0x7f89e815cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e659c700 1 -- 172.21.15.19:0/921009842 >> v1:172.21.15.19:6789/0 conn(0x7f89e815d5b0 legacy=0x7f89e815aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e659c700 1 -- 172.21.15.19:0/921009842 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80ceb40 con 0x7f89e8159040 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e659c700 1 --2- 172.21.15.19:0/921009842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 0x7f89e80cf620 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009e90 tx=0x7f89e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3103513adf0f39 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e559a700 1 -- 172.21.15.19:0/921009842 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e000e070 con 0x7f89e8159040 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e559a700 1 -- 172.21.15.19:0/921009842 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e000bc30 con 0x7f89e8159040 2024-08-17T02:27:01.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.603+0000 7f89e559a700 1 -- 172.21.15.19:0/921009842 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0012430 con 0x7f89e8159040 2024-08-17T02:27:01.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 -- 172.21.15.19:0/921009842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 msgr2=0x7f89e80cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 --2- 172.21.15.19:0/921009842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 0x7f89e80cf620 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009e90 tx=0x7f89e0009780 comp rx=0 tx=0).stop 2024-08-17T02:27:01.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 -- 172.21.15.19:0/921009842 shutdown_connections 2024-08-17T02:27:01.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 --2- 172.21.15.19:0/921009842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 0x7f89e80cf620 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 -- 172.21.15.19:0/921009842 >> 172.21.15.19:0/921009842 conn(0x7f89e8068250 msgr2=0x7f89e8068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 -- 172.21.15.19:0/921009842 shutdown_connections 2024-08-17T02:27:01.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 -- 172.21.15.19:0/921009842 wait complete. 2024-08-17T02:27:01.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 Processor -- start 2024-08-17T02:27:01.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 -- start start 2024-08-17T02:27:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80d0010 0x7f89e806e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 0x7f89e80b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e815d5b0 0x7f89e8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8171d10 con 0x7f89e80d0010 2024-08-17T02:27:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80b25b0 con 0x7f89e815d5b0 2024-08-17T02:27:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8171090 con 0x7f89e8159040 2024-08-17T02:27:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80d0010 0x7f89e806e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80d0010 0x7f89e806e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58514/0 (socket says 172.21.15.19:58514) 2024-08-17T02:27:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e659c700 1 -- 172.21.15.19:0/3502932462 learned_addr learned my addr 172.21.15.19:0/3502932462 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e6d9d700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e815d5b0 0x7f89e8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.607+0000 7f89e5d9b700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 0x7f89e80b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e659c700 1 -- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 msgr2=0x7f89e80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e659c700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 0x7f89e80b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e659c700 1 -- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e815d5b0 msgr2=0x7f89e8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e659c700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e815d5b0 0x7f89e8156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e659c700 1 -- 172.21.15.19:0/3502932462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e0009a20 con 0x7f89e80d0010 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e6d9d700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e815d5b0 0x7f89e8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e659c700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80d0010 0x7f89e806e5d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f89e00099f0 tx=0x7f89e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89de7fc700 1 -- 172.21.15.19:0/3502932462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0012e60 con 0x7f89e80d0010 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89de7fc700 1 -- 172.21.15.19:0/3502932462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e001b420 con 0x7f89e80d0010 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89de7fc700 1 -- 172.21.15.19:0/3502932462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e001b7e0 con 0x7f89e80d0010 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e8171370 con 0x7f89e80d0010 2024-08-17T02:27:01.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e8171930 con 0x7f89e80d0010 2024-08-17T02:27:01.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89de7fc700 1 -- 172.21.15.19:0/3502932462 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f89e001bb90 con 0x7f89e80d0010 2024-08-17T02:27:01.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e80643a0 con 0x7f89e80d0010 2024-08-17T02:27:01.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.611+0000 7f89de7fc700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f89cc060860 0x7f89cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.615+0000 7f89de7fc700 1 -- 172.21.15.19:0/3502932462 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89e007e710 con 0x7f89e80d0010 2024-08-17T02:27:01.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.615+0000 7f89e5d9b700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f89cc060860 0x7f89cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.615+0000 7f89e5d9b700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f89cc060860 0x7f89cc062d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f89e8153e70 tx=0x7f89d0007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.619+0000 7f89de7fc700 1 -- 172.21.15.19:0/3502932462 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f89e004eb60 con 0x7f89e80d0010 2024-08-17T02:27:01.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.783+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89e80b3480 con 0x7f89e80d0010 2024-08-17T02:27:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.787+0000 7f89de7fc700 1 -- 172.21.15.19:0/3502932462 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f89e0052180 con 0x7f89e80d0010 2024-08-17T02:27:01.792 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:01.792 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.787+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f89cc060860 msgr2=0x7f89cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.787+0000 7f89e759e700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f89cc060860 0x7f89cc062d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f89e8153e70 tx=0x7f89d0007d30 comp rx=0 tx=0).stop 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80d0010 msgr2=0x7f89e806e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80d0010 0x7f89e806e5d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f89e00099f0 tx=0x7f89e0019000 comp rx=0 tx=0).stop 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 shutdown_connections 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f89cc060860 0x7f89cc062d10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89e815d5b0 0x7f89e8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89e8159040 0x7f89e80b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 --2- 172.21.15.19:0/3502932462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89e80d0010 0x7f89e806e5d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 >> 172.21.15.19:0/3502932462 conn(0x7f89e8068250 msgr2=0x7f89e8068620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 shutdown_connections 2024-08-17T02:27:01.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.791+0000 7f89e759e700 1 -- 172.21.15.19:0/3502932462 wait complete. 2024-08-17T02:27:01.807 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:27:01.807 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:01.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.911+0000 7fa22d3cb700 1 Processor -- start 2024-08-17T02:27:01.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.911+0000 7fa22d3cb700 1 -- start start 2024-08-17T02:27:01.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.911+0000 7fa22d3cb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2280d0010 0x7fa2280d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.911+0000 7fa22d3cb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa22815cea0 0x7fa22815d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.911+0000 7fa22d3cb700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280cf190 con 0x7fa228159040 2024-08-17T02:27:01.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.911+0000 7fa22d3cb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280d09a0 con 0x7fa22815cea0 2024-08-17T02:27:01.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.911+0000 7fa22d3cb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280ce5e0 con 0x7fa2280d0010 2024-08-17T02:27:01.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22cbca700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa22815cea0 0x7fa22815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22cbca700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa22815cea0 0x7fa22815d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58526/0 (socket says 172.21.15.19:58526) 2024-08-17T02:27:01.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22cbca700 1 -- 172.21.15.19:0/1652467327 learned_addr learned my addr 172.21.15.19:0/1652467327 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:01.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa2277fe700 1 --2- 172.21.15.19:0/1652467327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2280d0010 0x7fa2280d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa226ffd700 1 -- 172.21.15.19:0/1652467327 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110962684 0 0) 0x7fa2280cf190 con 0x7fa228159040 2024-08-17T02:27:01.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa226ffd700 1 -- 172.21.15.19:0/1652467327 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa210003570 con 0x7fa228159040 2024-08-17T02:27:01.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22cbca700 1 -- 172.21.15.19:0/1652467327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2280d0010 msgr2=0x7fa2280d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22cbca700 1 --2- 172.21.15.19:0/1652467327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2280d0010 0x7fa2280d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22cbca700 1 -- 172.21.15.19:0/1652467327 >> v1:172.21.15.119:6789/0 conn(0x7fa228159040 legacy=0x7fa2280cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22cbca700 1 -- 172.21.15.19:0/1652467327 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280ce860 con 0x7fa22815cea0 2024-08-17T02:27:01.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa2277fe700 1 --2- 172.21.15.19:0/1652467327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2280d0010 0x7fa2280d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22cbca700 1 --2- 172.21.15.19:0/1652467327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa22815cea0 0x7fa22815d320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa2200099b0 tx=0x7fa220009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9e1fad2feb4fa9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa226ffd700 1 -- 172.21.15.19:0/1652467327 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000b680 con 0x7fa22815cea0 2024-08-17T02:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa226ffd700 1 -- 172.21.15.19:0/1652467327 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000b7e0 con 0x7fa22815cea0 2024-08-17T02:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa226ffd700 1 -- 172.21.15.19:0/1652467327 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000bba0 con 0x7fa22815cea0 2024-08-17T02:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22d3cb700 1 -- 172.21.15.19:0/1652467327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa22815cea0 msgr2=0x7fa22815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22d3cb700 1 --2- 172.21.15.19:0/1652467327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa22815cea0 0x7fa22815d320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa2200099b0 tx=0x7fa220009250 comp rx=0 tx=0).stop 2024-08-17T02:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22d3cb700 1 -- 172.21.15.19:0/1652467327 shutdown_connections 2024-08-17T02:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22d3cb700 1 --2- 172.21.15.19:0/1652467327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa22815cea0 0x7fa22815d320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22d3cb700 1 --2- 172.21.15.19:0/1652467327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2280d0010 0x7fa2280d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22d3cb700 1 -- 172.21.15.19:0/1652467327 >> 172.21.15.19:0/1652467327 conn(0x7fa228068250 msgr2=0x7fa228068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22d3cb700 1 -- 172.21.15.19:0/1652467327 shutdown_connections 2024-08-17T02:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.915+0000 7fa22d3cb700 1 -- 172.21.15.19:0/1652467327 wait complete. 2024-08-17T02:27:01.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 Processor -- start 2024-08-17T02:27:01.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 -- start start 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2280d0010 0x7fa2280b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa228159040 0x7fa228155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa22815cea0 0x7fa228152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22816da40 con 0x7fa2280d0010 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22816cc80 con 0x7fa22815cea0 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22816cf60 con 0x7fa228159040 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa227fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2280d0010 0x7fa2280b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa227fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2280d0010 0x7fa2280b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58540/0 (socket says 172.21.15.19:58540) 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa227fff700 1 -- 172.21.15.19:0/3748138668 learned_addr learned my addr 172.21.15.19:0/3748138668 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22cbca700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa22815cea0 0x7fa228152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa2277fe700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa228159040 0x7fa228155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa227fff700 1 -- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa228159040 msgr2=0x7fa228155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa227fff700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa228159040 0x7fa228155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa227fff700 1 -- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa22815cea0 msgr2=0x7fa228152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa227fff700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa22815cea0 0x7fa228152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa227fff700 1 -- 172.21.15.19:0/3748138668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c009420 con 0x7fa2280d0010 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa227fff700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2280d0010 0x7fa2280b2050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c900 tx=0x7fa218002780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa20ffff700 1 -- 172.21.15.19:0/3748138668 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218012630 con 0x7fa2280d0010 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa20ffff700 1 -- 172.21.15.19:0/3748138668 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218012790 con 0x7fa2280d0010 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2200094f0 con 0x7fa2280d0010 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa20ffff700 1 -- 172.21.15.19:0/3748138668 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218012b50 con 0x7fa2280d0010 2024-08-17T02:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.919+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22816d520 con 0x7fa2280d0010 2024-08-17T02:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.923+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22816d740 con 0x7fa2280d0010 2024-08-17T02:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.923+0000 7fa20ffff700 1 -- 172.21.15.19:0/3748138668 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa21801b400 con 0x7fa2280d0010 2024-08-17T02:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.923+0000 7fa20ffff700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa214060860 0x7fa214062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.923+0000 7fa20ffff700 1 -- 172.21.15.19:0/3748138668 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa21807cea0 con 0x7fa2280d0010 2024-08-17T02:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.923+0000 7fa2277fe700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa214060860 0x7fa214062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.923+0000 7fa2277fe700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa214060860 0x7fa214062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa228063d90 tx=0x7fa21c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:01.931+0000 7fa20ffff700 1 -- 172.21.15.19:0/3748138668 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa21804d2f0 con 0x7fa2280d0010 2024-08-17T02:27:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.131+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2280643a0 con 0x7fa2280d0010 2024-08-17T02:27:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.131+0000 7fa20ffff700 1 -- 172.21.15.19:0/3748138668 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fa218016090 con 0x7fa2280d0010 2024-08-17T02:27:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:02.137 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/903872793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":903872793},{"type":"v1","addr":"172.21.15.19:6833","nonce":903872793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3217936958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3217936958},{"type":"v1","addr":"172.21.15.19:6835","nonce":3217936958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/183789327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":183789327},{"type":"v1","addr":"172.21.15.119:6837","nonce":183789327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:28.987569+0000","modified":"2024-08-17T02:26:31.636583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa214060860 msgr2=0x7fa214062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa214060860 0x7fa214062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa228063d90 tx=0x7fa21c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2280d0010 msgr2=0x7fa2280b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2280d0010 0x7fa2280b2050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c900 tx=0x7fa218002780 comp rx=0 tx=0).stop 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 shutdown_connections 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa214060860 0x7fa214062d10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa22815cea0 0x7fa228152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa228159040 0x7fa228155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 --2- 172.21.15.19:0/3748138668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2280d0010 0x7fa2280b2050 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 >> 172.21.15.19:0/3748138668 conn(0x7fa228068250 msgr2=0x7fa2280aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 shutdown_connections 2024-08-17T02:27:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.135+0000 7fa22d3cb700 1 -- 172.21.15.19:0/3748138668 wait complete. 2024-08-17T02:27:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-08-17T02:27:02.152 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:02.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f4236349700 1 Processor -- start 2024-08-17T02:27:02.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f4236349700 1 -- start start 2024-08-17T02:27:02.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f4236349700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4230155e00 0x7f4230159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f4236349700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4230069640 con 0x7f42301561d0 2024-08-17T02:27:02.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f4236349700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4230069920 con 0x7f4230069180 2024-08-17T02:27:02.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f4236349700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423015aa20 con 0x7f4230155e00 2024-08-17T02:27:02.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f42301561d0 0x7f42300b09b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54254/0 (socket says 172.21.15.19:54254) 2024-08-17T02:27:02.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422f7fe700 1 -- 172.21.15.19:0/3720916261 learned_addr learned my addr 172.21.15.19:0/3720916261 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:02.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422ffff700 1 --2- 172.21.15.19:0/3720916261 >> v2:172.21.15.119:3300/0 conn(0x7f4230155e00 0x7f4230159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422effd700 1 -- 172.21.15.19:0/3720916261 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439763854 0 0) 0x7f4230069640 con 0x7f42301561d0 2024-08-17T02:27:02.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422effd700 1 -- 172.21.15.19:0/3720916261 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4210005780 con 0x7f42301561d0 2024-08-17T02:27:02.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422ffff700 1 -- 172.21.15.19:0/3720916261 >> v1:172.21.15.119:6789/0 conn(0x7f4230069180 legacy=0x7f42300cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422ffff700 1 -- 172.21.15.19:0/3720916261 >> v1:172.21.15.19:6789/0 conn(0x7f42301561d0 legacy=0x7f42300b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422ffff700 1 -- 172.21.15.19:0/3720916261 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4230069c00 con 0x7f4230155e00 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422ffff700 1 --2- 172.21.15.19:0/3720916261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230155e00 0x7f4230159b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42200098e0 tx=0x7f42200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=241826d2cadbe79 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.255+0000 7f422effd700 1 -- 172.21.15.19:0/3720916261 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000b640 con 0x7f4230155e00 2024-08-17T02:27:02.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f422effd700 1 -- 172.21.15.19:0/3720916261 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422000b7a0 con 0x7f4230155e00 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f422effd700 1 -- 172.21.15.19:0/3720916261 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000bb40 con 0x7f4230155e00 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 -- 172.21.15.19:0/3720916261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230155e00 msgr2=0x7f4230159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 --2- 172.21.15.19:0/3720916261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230155e00 0x7f4230159b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f42200098e0 tx=0x7f42200091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 -- 172.21.15.19:0/3720916261 shutdown_connections 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 --2- 172.21.15.19:0/3720916261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230155e00 0x7f4230159b30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 -- 172.21.15.19:0/3720916261 >> 172.21.15.19:0/3720916261 conn(0x7f423006e3b0 msgr2=0x7f42300aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 -- 172.21.15.19:0/3720916261 shutdown_connections 2024-08-17T02:27:02.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 -- 172.21.15.19:0/3720916261 wait complete. 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 Processor -- start 2024-08-17T02:27:02.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 -- start start 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230069180 0x7f42300a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4230155e00 0x7f4230154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42301561d0 0x7f42300ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300aa3a0 con 0x7f4230155e00 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42300aa680 con 0x7f4230069180 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.259+0000 7f4236349700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42300aa960 con 0x7f42301561d0 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4230155e00 0x7f4230154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4230155e00 0x7f4230154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58544/0 (socket says 172.21.15.19:58544) 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422f7fe700 1 -- 172.21.15.19:0/496545606 learned_addr learned my addr 172.21.15.19:0/496545606 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422ffff700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230069180 0x7f42300a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f42348e6700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42301561d0 0x7f42300ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422f7fe700 1 -- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42301561d0 msgr2=0x7f42300ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422f7fe700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42301561d0 0x7f42300ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422f7fe700 1 -- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230069180 msgr2=0x7f42300a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422f7fe700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230069180 0x7f42300a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422f7fe700 1 -- 172.21.15.19:0/496545606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4220009420 con 0x7f4230155e00 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422ffff700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230069180 0x7f42300a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f422f7fe700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4230155e00 0x7f4230154ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f421800cc70 tx=0x7f4218001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f4227fff700 1 -- 172.21.15.19:0/496545606 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800a830 con 0x7f4230155e00 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f4227fff700 1 -- 172.21.15.19:0/496545606 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421800a9b0 con 0x7f4230155e00 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f4227fff700 1 -- 172.21.15.19:0/496545606 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800ad70 con 0x7f4230155e00 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42300aac40 con 0x7f4230155e00 2024-08-17T02:27:02.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4230155010 con 0x7f4230155e00 2024-08-17T02:27:02.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42300645c0 con 0x7f4230155e00 2024-08-17T02:27:02.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.263+0000 7f4227fff700 1 -- 172.21.15.19:0/496545606 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4218007300 con 0x7f4230155e00 2024-08-17T02:27:02.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.267+0000 7f4227fff700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4214060860 0x7f4214062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.267+0000 7f4227fff700 1 -- 172.21.15.19:0/496545606 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f421807cef0 con 0x7f4230155e00 2024-08-17T02:27:02.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.267+0000 7f422ffff700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4214060860 0x7f4214062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.267+0000 7f422ffff700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4214060860 0x7f4214062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f42200093f0 tx=0x7f4220017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.271+0000 7f4227fff700 1 -- 172.21.15.19:0/496545606 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f421804d3c0 con 0x7f4230155e00 2024-08-17T02:27:02.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.479+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42300af9e0 con 0x7f4230155e00 2024-08-17T02:27:02.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.479+0000 7f4227fff700 1 -- 172.21.15.19:0/496545606 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f42180509e0 con 0x7f4230155e00 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/903872793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":903872793},{"type":"v1","addr":"172.21.15.19:6833","nonce":903872793}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/3217936958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":3217936958},{"type":"v1","addr":"172.21.15.19:6835","nonce":3217936958}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/183789327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":183789327},{"type":"v1","addr":"172.21.15.119:6837","nonce":183789327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:28.987569+0000","modified":"2024-08-17T02:26:31.636583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34157":{"gid":34157,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/480680634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":480680634},{"type":"v1","addr":"172.21.15.119:6835","nonce":480680634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4214060860 msgr2=0x7f4214062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4214060860 0x7f4214062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f42200093f0 tx=0x7f4220017000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4230155e00 msgr2=0x7f4230154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4230155e00 0x7f4230154ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f421800cc70 tx=0x7f4218001a40 comp rx=0 tx=0).stop 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 shutdown_connections 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f4214060860 0x7f4214062d10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42301561d0 0x7f42300ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4230155e00 0x7f4230154ad0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 --2- 172.21.15.19:0/496545606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4230069180 0x7f42300a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 >> 172.21.15.19:0/496545606 conn(0x7f423006e3b0 msgr2=0x7f42300cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 shutdown_connections 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.483+0000 7f4236349700 1 -- 172.21.15.19:0/496545606 wait complete. 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-08-17T02:27:02.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:02.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971892700 1 Processor -- start 2024-08-17T02:27:02.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971892700 1 -- start start 2024-08-17T02:27:02.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971892700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 0x7f796c0af880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971892700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f796c0b36c0 0x7f796c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971892700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0cbfa0 con 0x7f796c0afdc0 2024-08-17T02:27:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971892700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c0b08f0 con 0x7f796c0b36c0 2024-08-17T02:27:02.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971892700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0b0330 con 0x7f796c156da0 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971091700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f796c0b36c0 0x7f796c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7970890700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 0x7f796c0af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971091700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f796c0b36c0 0x7f796c0cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58558/0 (socket says 172.21.15.19:58558) 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971091700 1 -- 172.21.15.19:0/230510027 learned_addr learned my addr 172.21.15.19:0/230510027 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971091700 1 -- 172.21.15.19:0/230510027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 msgr2=0x7f796c0af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971091700 1 --2- 172.21.15.19:0/230510027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 0x7f796c0af880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971091700 1 -- 172.21.15.19:0/230510027 >> v1:172.21.15.119:6789/0 conn(0x7f796c0afdc0 legacy=0x7f796c0b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971091700 1 -- 172.21.15.19:0/230510027 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0b0610 con 0x7f796c0b36c0 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.599+0000 7f7971091700 1 --2- 172.21.15.19:0/230510027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0b36c0 0x7f796c0cc430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f795c0099b0 tx=0x7f795c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9beec8be43ed030 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f796b7fe700 1 -- 172.21.15.19:0/230510027 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c009ea0 con 0x7f796c0b36c0 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f796b7fe700 1 -- 172.21.15.19:0/230510027 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c00b860 con 0x7f796c0b36c0 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f796b7fe700 1 -- 172.21.15.19:0/230510027 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00bc00 con 0x7f796c0b36c0 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 -- 172.21.15.19:0/230510027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0b36c0 msgr2=0x7f796c0cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 --2- 172.21.15.19:0/230510027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0b36c0 0x7f796c0cc430 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f795c0099b0 tx=0x7f795c009250 comp rx=0 tx=0).stop 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 -- 172.21.15.19:0/230510027 shutdown_connections 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 --2- 172.21.15.19:0/230510027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0b36c0 0x7f796c0cc430 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 --2- 172.21.15.19:0/230510027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 0x7f796c0af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 -- 172.21.15.19:0/230510027 >> 172.21.15.19:0/230510027 conn(0x7f796c0ce970 msgr2=0x7f796c06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 -- 172.21.15.19:0/230510027 shutdown_connections 2024-08-17T02:27:02.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 -- 172.21.15.19:0/230510027 wait complete. 2024-08-17T02:27:02.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 Processor -- start 2024-08-17T02:27:02.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 -- start start 2024-08-17T02:27:02.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0afdc0 0x7f796c167960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f796c0b36c0 0x7f796c14ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 0x7f796c14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c167ea0 con 0x7f796c0afdc0 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c14f320 con 0x7f796c0b36c0 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.603+0000 7f7971892700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c14dd40 con 0x7f796c156da0 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7970890700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0afdc0 0x7f796c167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7970890700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0afdc0 0x7f796c167960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58568/0 (socket says 172.21.15.19:58568) 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7970890700 1 -- 172.21.15.19:0/3001434001 learned_addr learned my addr 172.21.15.19:0/3001434001 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f796bfff700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f796c0b36c0 0x7f796c14ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7971091700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 0x7f796c14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7970890700 1 -- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 msgr2=0x7f796c14c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7970890700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 0x7f796c14c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7970890700 1 -- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f796c0b36c0 msgr2=0x7f796c14ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7970890700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f796c0b36c0 0x7f796c14ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7970890700 1 -- 172.21.15.19:0/3001434001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c0094f0 con 0x7f796c0afdc0 2024-08-17T02:27:02.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7971091700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 0x7f796c14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:02.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7970890700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0afdc0 0x7f796c167960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7964009e70 tx=0x7f796400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7968ff9700 1 -- 172.21.15.19:0/3001434001 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400cbd0 con 0x7f796c0afdc0 2024-08-17T02:27:02.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7968ff9700 1 -- 172.21.15.19:0/3001434001 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796400f040 con 0x7f796c0afdc0 2024-08-17T02:27:02.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c14e020 con 0x7f796c0afdc0 2024-08-17T02:27:02.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7968ff9700 1 -- 172.21.15.19:0/3001434001 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964014480 con 0x7f796c0afdc0 2024-08-17T02:27:02.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c14e5e0 con 0x7f796c0afdc0 2024-08-17T02:27:02.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c0638f0 con 0x7f796c0afdc0 2024-08-17T02:27:02.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.607+0000 7f7968ff9700 1 -- 172.21.15.19:0/3001434001 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7964014830 con 0x7f796c0afdc0 2024-08-17T02:27:02.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.611+0000 7f7968ff9700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7958060860 0x7f7958062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.611+0000 7f7968ff9700 1 -- 172.21.15.19:0/3001434001 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f796407d5a0 con 0x7f796c0afdc0 2024-08-17T02:27:02.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.611+0000 7f796bfff700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7958060860 0x7f7958062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.611+0000 7f796bfff700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7958060860 0x7f7958062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f796c0ae7b0 tx=0x7f7960009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.615+0000 7f7968ff9700 1 -- 172.21.15.19:0/3001434001 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f796404daa0 con 0x7f796c0afdc0 2024-08-17T02:27:02.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.783+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f796c0b0f80 con 0x7f796c0afdc0 2024-08-17T02:27:02.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.783+0000 7f7968ff9700 1 -- 172.21.15.19:0/3001434001 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f79640510c0 con 0x7f796c0afdc0 2024-08-17T02:27:02.789 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:02.789 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:26:30.627888+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:27.555224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:27.958499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7958060860 msgr2=0x7f7958062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7958060860 0x7f7958062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f796c0ae7b0 tx=0x7f7960009040 comp rx=0 tx=0).stop 2024-08-17T02:27:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0afdc0 msgr2=0x7f796c167960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0afdc0 0x7f796c167960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7964009e70 tx=0x7f796400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 shutdown_connections 2024-08-17T02:27:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7958060860 0x7f7958062d10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f796c156da0 0x7f796c14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f796c0b36c0 0x7f796c14ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 --2- 172.21.15.19:0/3001434001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796c0afdc0 0x7f796c167960 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 >> 172.21.15.19:0/3001434001 conn(0x7f796c0ce970 msgr2=0x7f796c155830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 shutdown_connections 2024-08-17T02:27:02.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.787+0000 7f7971892700 1 -- 172.21.15.19:0/3001434001 wait complete. 2024-08-17T02:27:02.803 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:27:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.911+0000 7f131a43a700 1 Processor -- start 2024-08-17T02:27:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.911+0000 7f131a43a700 1 -- start start 2024-08-17T02:27:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1314153a70 0x7f1314159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1314153e40 0x7f131406e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1314157810 con 0x7f131415a180 2024-08-17T02:27:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1314157dd0 con 0x7f1314153e40 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131415a700 con 0x7f1314153a70 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f13189d7700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f131415a180 0x7f13140a9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54264/0 (socket says 172.21.15.19:54264) 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f13189d7700 1 -- 172.21.15.19:0/1831383839 learned_addr learned my addr 172.21.15.19:0/1831383839 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f13137fe700 1 --2- 172.21.15.19:0/1831383839 >> v2:172.21.15.19:3300/0 conn(0x7f1314153e40 0x7f131406e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f1313fff700 1 --2- 172.21.15.19:0/1831383839 >> v2:172.21.15.119:3300/0 conn(0x7f1314153a70 0x7f1314159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f1312ffd700 1 -- 172.21.15.19:0/1831383839 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133604775 0 0) 0x7f1314157810 con 0x7f131415a180 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f1312ffd700 1 -- 172.21.15.19:0/1831383839 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12fc003570 con 0x7f131415a180 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f13137fe700 1 -- 172.21.15.19:0/1831383839 >> v2:172.21.15.119:3300/0 conn(0x7f1314153a70 msgr2=0x7f1314159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f13137fe700 1 --2- 172.21.15.19:0/1831383839 >> v2:172.21.15.119:3300/0 conn(0x7f1314153a70 0x7f1314159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f13137fe700 1 -- 172.21.15.19:0/1831383839 >> v1:172.21.15.19:6789/0 conn(0x7f131415a180 legacy=0x7f13140a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f13137fe700 1 -- 172.21.15.19:0/1831383839 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131415a9e0 con 0x7f1314153e40 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f13137fe700 1 --2- 172.21.15.19:0/1831383839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1314153e40 0x7f131406e2b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f131406b4c0 tx=0x7f13040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57bd45593768caf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f1312ffd700 1 -- 172.21.15.19:0/1831383839 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304009a80 con 0x7f1314153e40 2024-08-17T02:27:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f1312ffd700 1 -- 172.21.15.19:0/1831383839 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304009be0 con 0x7f1314153e40 2024-08-17T02:27:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f1312ffd700 1 -- 172.21.15.19:0/1831383839 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304017410 con 0x7f1314153e40 2024-08-17T02:27:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 -- 172.21.15.19:0/1831383839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1314153e40 msgr2=0x7f131406e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 --2- 172.21.15.19:0/1831383839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1314153e40 0x7f131406e2b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f131406b4c0 tx=0x7f13040091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 -- 172.21.15.19:0/1831383839 shutdown_connections 2024-08-17T02:27:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 --2- 172.21.15.19:0/1831383839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1314153e40 0x7f131406e2b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 --2- 172.21.15.19:0/1831383839 >> v2:172.21.15.119:3300/0 conn(0x7f1314153a70 0x7f1314159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 -- 172.21.15.19:0/1831383839 >> 172.21.15.19:0/1831383839 conn(0x7f1314067810 msgr2=0x7f1314067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 -- 172.21.15.19:0/1831383839 shutdown_connections 2024-08-17T02:27:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.915+0000 7f131a43a700 1 -- 172.21.15.19:0/1831383839 wait complete. 2024-08-17T02:27:02.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f131a43a700 1 Processor -- start 2024-08-17T02:27:02.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f131a43a700 1 -- start start 2024-08-17T02:27:02.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f131a43a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1314153a70 0x7f1314147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f131a43a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1314153e40 0x7f131414e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f131a43a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f131415a180 0x7f131414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f131a43a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13141529c0 con 0x7f131415a180 2024-08-17T02:27:02.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f131a43a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314151db0 con 0x7f1314153e40 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f131a43a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1314152090 con 0x7f1314153a70 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f13189d7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f131415a180 0x7f131414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f13189d7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f131415a180 0x7f131414ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58592/0 (socket says 172.21.15.19:58592) 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f13189d7700 1 -- 172.21.15.19:0/3899727734 learned_addr learned my addr 172.21.15.19:0/3899727734 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f1313fff700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1314153a70 0x7f1314147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f13137fe700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1314153e40 0x7f131414e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f13189d7700 1 -- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1314153a70 msgr2=0x7f1314147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f13189d7700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1314153a70 0x7f1314147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f13189d7700 1 -- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1314153e40 msgr2=0x7f131414e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f13189d7700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1314153e40 0x7f131414e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.919+0000 7f13189d7700 1 -- 172.21.15.19:0/3899727734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130400f610 con 0x7f131415a180 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.923+0000 7f13189d7700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f131415a180 0x7f131414ea90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f130c001460 tx=0x7f130c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.923+0000 7f12fbfff700 1 -- 172.21.15.19:0/3899727734 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c00ce80 con 0x7f131415a180 2024-08-17T02:27:02.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.923+0000 7f12fbfff700 1 -- 172.21.15.19:0/3899727734 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c00ab70 con 0x7f131415a180 2024-08-17T02:27:02.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.923+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1314152370 con 0x7f131415a180 2024-08-17T02:27:02.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.923+0000 7f12fbfff700 1 -- 172.21.15.19:0/3899727734 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0070f0 con 0x7f131415a180 2024-08-17T02:27:02.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.923+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13141479a0 con 0x7f131415a180 2024-08-17T02:27:02.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.923+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1314152b30 con 0x7f131415a180 2024-08-17T02:27:02.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.923+0000 7f12fbfff700 1 -- 172.21.15.19:0/3899727734 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f130c007520 con 0x7f131415a180 2024-08-17T02:27:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.927+0000 7f12fbfff700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1300060860 0x7f1300062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.927+0000 7f12fbfff700 1 -- 172.21.15.19:0/3899727734 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f130c07d120 con 0x7f131415a180 2024-08-17T02:27:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.927+0000 7f1313fff700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1300060860 0x7f1300062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.927+0000 7f1313fff700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1300060860 0x7f1300062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1314150f90 tx=0x7f1308008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:02.931+0000 7f12fbfff700 1 -- 172.21.15.19:0/3899727734 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f130c04d550 con 0x7f131415a180 2024-08-17T02:27:03.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.139+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13140645c0 con 0x7f131415a180 2024-08-17T02:27:03.147 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-08-17T02:27:03.143+0000 7fcb8c4f8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:27:03.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.151+0000 7f12fbfff700 1 -- 172.21.15.19:0/3899727734 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f130c050b70 con 0x7f131415a180 2024-08-17T02:27:03.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1300060860 msgr2=0x7f1300062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1300060860 0x7f1300062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1314150f90 tx=0x7f1308008040 comp rx=0 tx=0).stop 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f131415a180 msgr2=0x7f131414ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f131415a180 0x7f131414ea90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f130c001460 tx=0x7f130c001ae0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 shutdown_connections 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1300060860 0x7f1300062d10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f131415a180 0x7f131414ea90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1314153e40 0x7f131414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 --2- 172.21.15.19:0/3899727734 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1314153a70 0x7f1314147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 >> 172.21.15.19:0/3899727734 conn(0x7f1314067810 msgr2=0x7f131406e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 shutdown_connections 2024-08-17T02:27:03.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.155+0000 7f131a43a700 1 -- 172.21.15.19:0/3899727734 wait complete. 2024-08-17T02:27:03.160 INFO:tasks.ceph.mds.d.smithi119.stderr: -2215> 2024-08-17T02:26:33.081+0000 7f97f57f6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:03.160 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:27:03.171 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:27:03.185 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2024-08-17T02:27:03.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e2213700 1 Processor -- start 2024-08-17T02:27:03.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e2213700 1 -- start start 2024-08-17T02:27:03.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e2213700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51dc13fa50 0x7f51dc0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e2213700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 0x7f51dc06e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e2213700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc0b0810 con 0x7f51dc13f680 2024-08-17T02:27:03.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e2213700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc0afc70 con 0x7f51dc13fa50 2024-08-17T02:27:03.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e2213700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0af060 con 0x7f51dc0ad6c0 2024-08-17T02:27:03.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e0a10700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51dc13fa50 0x7f51dc0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e0a10700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51dc13fa50 0x7f51dc0aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58608/0 (socket says 172.21.15.19:58608) 2024-08-17T02:27:03.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e0a10700 1 -- 172.21.15.19:0/2958494437 learned_addr learned my addr 172.21.15.19:0/2958494437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e1211700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f51dc13f680 0x7f51dc0b0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54274/0 (socket says 172.21.15.19:54274) 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e1a12700 1 --2- 172.21.15.19:0/2958494437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 0x7f51dc06e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e0a10700 1 -- 172.21.15.19:0/2958494437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 msgr2=0x7f51dc06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e0a10700 1 --2- 172.21.15.19:0/2958494437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 0x7f51dc06e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e0a10700 1 -- 172.21.15.19:0/2958494437 >> v1:172.21.15.19:6789/0 conn(0x7f51dc13f680 legacy=0x7f51dc0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51e0a10700 1 -- 172.21.15.19:0/2958494437 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc0af340 con 0x7f51dc13fa50 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.275+0000 7f51cffff700 1 -- 172.21.15.19:0/2958494437 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901431036 0 0) 0x7f51dc0b0810 con 0x7f51dc13f680 2024-08-17T02:27:03.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e0a10700 1 --2- 172.21.15.19:0/2958494437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 0x7f51dc0aea80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f51d00099b0 tx=0x7f51d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fb47f8787849d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51cffff700 1 -- 172.21.15.19:0/2958494437 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000b860 con 0x7f51dc13fa50 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51cffff700 1 -- 172.21.15.19:0/2958494437 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000b9c0 con 0x7f51dc13fa50 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51cffff700 1 -- 172.21.15.19:0/2958494437 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000bd60 con 0x7f51dc13fa50 2024-08-17T02:27:03.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 -- 172.21.15.19:0/2958494437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 msgr2=0x7f51dc0aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 --2- 172.21.15.19:0/2958494437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 0x7f51dc0aea80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f51d00099b0 tx=0x7f51d0009250 comp rx=0 tx=0).stop 2024-08-17T02:27:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 -- 172.21.15.19:0/2958494437 shutdown_connections 2024-08-17T02:27:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 --2- 172.21.15.19:0/2958494437 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 0x7f51dc06e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 --2- 172.21.15.19:0/2958494437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 0x7f51dc0aea80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 -- 172.21.15.19:0/2958494437 >> 172.21.15.19:0/2958494437 conn(0x7f51dc0678a0 msgr2=0x7f51dc067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 -- 172.21.15.19:0/2958494437 shutdown_connections 2024-08-17T02:27:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 -- 172.21.15.19:0/2958494437 wait complete. 2024-08-17T02:27:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 Processor -- start 2024-08-17T02:27:03.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.279+0000 7f51e2213700 1 -- start start 2024-08-17T02:27:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e2213700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 0x7f51dc1514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e2213700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc13f680 0x7f51dc151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e2213700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 0x7f51dc155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e2213700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc151b80 con 0x7f51dc13fa50 2024-08-17T02:27:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e2213700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc1574b0 con 0x7f51dc13f680 2024-08-17T02:27:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e2213700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc158e80 con 0x7f51dc0ad6c0 2024-08-17T02:27:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1a12700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 0x7f51dc155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1a12700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 0x7f51dc155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58618/0 (socket says 172.21.15.19:58618) 2024-08-17T02:27:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1a12700 1 -- 172.21.15.19:0/2034780711 learned_addr learned my addr 172.21.15.19:0/2034780711 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1211700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 0x7f51dc1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e0a10700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc13f680 0x7f51dc151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1a12700 1 -- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 msgr2=0x7f51dc1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1a12700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 0x7f51dc1514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1a12700 1 -- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc13f680 msgr2=0x7f51dc151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1a12700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc13f680 0x7f51dc151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1a12700 1 -- 172.21.15.19:0/2034780711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d00094f0 con 0x7f51dc13fa50 2024-08-17T02:27:03.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e1a12700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 0x7f51dc155470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009fa0 tx=0x7f51d4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51cd7fa700 1 -- 172.21.15.19:0/2034780711 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400ebc0 con 0x7f51dc13fa50 2024-08-17T02:27:03.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51cd7fa700 1 -- 172.21.15.19:0/2034780711 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400ed20 con 0x7f51dc13fa50 2024-08-17T02:27:03.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc159160 con 0x7f51dc13fa50 2024-08-17T02:27:03.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51cd7fa700 1 -- 172.21.15.19:0/2034780711 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4014670 con 0x7f51dc13fa50 2024-08-17T02:27:03.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc14f9a0 con 0x7f51dc13fa50 2024-08-17T02:27:03.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.283+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc064330 con 0x7f51dc13fa50 2024-08-17T02:27:03.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.287+0000 7f51cd7fa700 1 -- 172.21.15.19:0/2034780711 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f51d40149e0 con 0x7f51dc13fa50 2024-08-17T02:27:03.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.287+0000 7f51cd7fa700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f51c0060860 0x7f51c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.287+0000 7f51cd7fa700 1 -- 172.21.15.19:0/2034780711 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f51d407d270 con 0x7f51dc13fa50 2024-08-17T02:27:03.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.287+0000 7f51e1211700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f51c0060860 0x7f51c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.287+0000 7f51e1211700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f51c0060860 0x7f51c0062d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f51d8007b30 tx=0x7f51d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.291+0000 7f51cd7fa700 1 -- 172.21.15.19:0/2034780711 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f51d404d670 con 0x7f51dc13fa50 2024-08-17T02:27:03.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:03.491+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f51dc06ed70 con 0x7f51dc13fa50 2024-08-17T02:27:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.151+0000 7f51cd7fa700 1 -- 172.21.15.19:0/2034780711 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f51d4050c90 con 0x7f51dc13fa50 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f51c0060860 msgr2=0x7f51c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f51c0060860 0x7f51c0062d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f51d8007b30 tx=0x7f51d8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 msgr2=0x7f51dc155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 0x7f51dc155470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009fa0 tx=0x7f51d4009900 comp rx=0 tx=0).stop 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 shutdown_connections 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f51c0060860 0x7f51c0062d10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51dc13fa50 0x7f51dc155470 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51dc13f680 0x7f51dc151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 --2- 172.21.15.19:0/2034780711 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51dc0ad6c0 0x7f51dc1514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 >> 172.21.15.19:0/2034780711 conn(0x7f51dc0678a0 msgr2=0x7f51dc13cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 shutdown_connections 2024-08-17T02:27:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.155+0000 7f51e2213700 1 -- 172.21.15.19:0/2034780711 wait complete. 2024-08-17T02:27:04.177 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:27:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.295+0000 7ff65a622700 1 Processor -- start 2024-08-17T02:27:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.295+0000 7ff65a622700 1 -- start start 2024-08-17T02:27:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff6540c3290 0x7ff6540c3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff65415d100 0x7ff65415d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6540c4850 con 0x7ff65415dac0 2024-08-17T02:27:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6540cdef0 con 0x7ff65415d100 2024-08-17T02:27:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65415df20 con 0x7ff6540c3290 2024-08-17T02:27:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff6537fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff65415d100 0x7ff65415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff658bbf700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff65415dac0 0x7ff6540c89b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54278/0 (socket says 172.21.15.19:54278) 2024-08-17T02:27:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff658bbf700 1 -- 172.21.15.19:0/2311197596 learned_addr learned my addr 172.21.15.19:0/2311197596 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff653fff700 1 --2- 172.21.15.19:0/2311197596 >> v2:172.21.15.119:3300/0 conn(0x7ff6540c3290 0x7ff6540c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff6537fe700 1 -- 172.21.15.19:0/2311197596 >> v2:172.21.15.119:3300/0 conn(0x7ff6540c3290 msgr2=0x7ff6540c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff6537fe700 1 --2- 172.21.15.19:0/2311197596 >> v2:172.21.15.119:3300/0 conn(0x7ff6540c3290 0x7ff6540c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff6537fe700 1 -- 172.21.15.19:0/2311197596 >> v1:172.21.15.19:6789/0 conn(0x7ff65415dac0 legacy=0x7ff6540c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff6537fe700 1 -- 172.21.15.19:0/2311197596 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6540c3c40 con 0x7ff65415d100 2024-08-17T02:27:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff6537fe700 1 --2- 172.21.15.19:0/2311197596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415d100 0x7ff65415d580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff654070520 tx=0x7ff63c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ed201445f78088 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff652ffd700 1 -- 172.21.15.19:0/2311197596 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c011630 con 0x7ff65415d100 2024-08-17T02:27:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff652ffd700 1 -- 172.21.15.19:0/2311197596 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c011790 con 0x7ff65415d100 2024-08-17T02:27:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff652ffd700 1 -- 172.21.15.19:0/2311197596 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c011b30 con 0x7ff65415d100 2024-08-17T02:27:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 -- 172.21.15.19:0/2311197596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415d100 msgr2=0x7ff65415d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 --2- 172.21.15.19:0/2311197596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415d100 0x7ff65415d580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff654070520 tx=0x7ff63c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 -- 172.21.15.19:0/2311197596 shutdown_connections 2024-08-17T02:27:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 --2- 172.21.15.19:0/2311197596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415d100 0x7ff65415d580 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 --2- 172.21.15.19:0/2311197596 >> v2:172.21.15.119:3300/0 conn(0x7ff6540c3290 0x7ff6540c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.299+0000 7ff65a622700 1 -- 172.21.15.19:0/2311197596 >> 172.21.15.19:0/2311197596 conn(0x7ff6540cab00 msgr2=0x7ff6540caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:04.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 -- 172.21.15.19:0/2311197596 shutdown_connections 2024-08-17T02:27:04.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 -- 172.21.15.19:0/2311197596 wait complete. 2024-08-17T02:27:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 Processor -- start 2024-08-17T02:27:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 -- start start 2024-08-17T02:27:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6540c3290 0x7ff654158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff65415d100 0x7ff65415ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415dac0 0x7ff65415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540c5db0 con 0x7ff65415dac0 2024-08-17T02:27:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540c51e0 con 0x7ff65415d100 2024-08-17T02:27:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff65a622700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540c5480 con 0x7ff6540c3290 2024-08-17T02:27:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff658bbf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415dac0 0x7ff65415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.303+0000 7ff6537fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff65415d100 0x7ff65415ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff653fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6540c3290 0x7ff654158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff658bbf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415dac0 0x7ff65415b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58638/0 (socket says 172.21.15.19:58638) 2024-08-17T02:27:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff658bbf700 1 -- 172.21.15.19:0/1965270257 learned_addr learned my addr 172.21.15.19:0/1965270257 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff6537fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff65415d100 0x7ff65415ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:56724/0 (socket says 172.21.15.19:56724) 2024-08-17T02:27:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff653fff700 1 -- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff65415d100 msgr2=0x7ff65415ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff653fff700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff65415d100 0x7ff65415ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff653fff700 1 -- 172.21.15.19:0/1965270257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415dac0 msgr2=0x7ff65415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff653fff700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415dac0 0x7ff65415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff653fff700 1 -- 172.21.15.19:0/1965270257 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c009420 con 0x7ff6540c3290 2024-08-17T02:27:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff658bbf700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415dac0 0x7ff65415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff653fff700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6540c3290 0x7ff654158c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e9d0 tx=0x7ff6440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff64bfff700 1 -- 172.21.15.19:0/1965270257 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644013680 con 0x7ff6540c3290 2024-08-17T02:27:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff64bfff700 1 -- 172.21.15.19:0/1965270257 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff644013800 con 0x7ff6540c3290 2024-08-17T02:27:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6540c5760 con 0x7ff6540c3290 2024-08-17T02:27:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff64bfff700 1 -- 172.21.15.19:0/1965270257 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644013bc0 con 0x7ff6540c3290 2024-08-17T02:27:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6541591d0 con 0x7ff6540c3290 2024-08-17T02:27:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6540638f0 con 0x7ff6540c3290 2024-08-17T02:27:04.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.307+0000 7ff64bfff700 1 -- 172.21.15.19:0/1965270257 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff64400c490 con 0x7ff6540c3290 2024-08-17T02:27:04.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.311+0000 7ff64bfff700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff634060860 0x7ff634062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:04.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.311+0000 7ff64bfff700 1 -- 172.21.15.19:0/1965270257 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7ff64407cc30 con 0x7ff6540c3290 2024-08-17T02:27:04.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.311+0000 7ff6537fe700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff634060860 0x7ff634062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:04.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.311+0000 7ff6537fe700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff634060860 0x7ff634062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0093f0 tx=0x7ff63c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.319+0000 7ff64bfff700 1 -- 172.21.15.19:0/1965270257 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff64404cf90 con 0x7ff6540c3290 2024-08-17T02:27:04.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:04.499+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff654071380 con 0x7ff6540c3290 2024-08-17T02:27:05.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.159+0000 7ff64bfff700 1 -- 172.21.15.19:0/1965270257 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff6440505b0 con 0x7ff6540c3290 2024-08-17T02:27:05.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff634060860 msgr2=0x7ff634062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff634060860 0x7ff634062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0093f0 tx=0x7ff63c017000 comp rx=0 tx=0).stop 2024-08-17T02:27:05.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6540c3290 msgr2=0x7ff654158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6540c3290 0x7ff654158c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e9d0 tx=0x7ff6440091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 shutdown_connections 2024-08-17T02:27:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff634060860 0x7ff634062d10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff65415dac0 0x7ff65415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff65415d100 0x7ff65415ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 --2- 172.21.15.19:0/1965270257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff6540c3290 0x7ff654158c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 >> 172.21.15.19:0/1965270257 conn(0x7ff6540cab00 msgr2=0x7ff6540c88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 shutdown_connections 2024-08-17T02:27:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.163+0000 7ff65a622700 1 -- 172.21.15.19:0/1965270257 wait complete. 2024-08-17T02:27:05.170 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:27:05.182 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:27:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.291+0000 7fb1c56c1700 1 Processor -- start 2024-08-17T02:27:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.291+0000 7fb1c56c1700 1 -- start start 2024-08-17T02:27:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1c56c1700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb1c00ae250 0x7fb1c00ae620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1c56c1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1c01599d0 0x7fb1c0159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1c56c1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00cbc60 0x7fb1c00cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1c56c1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c015a320 con 0x7fb1c01599d0 2024-08-17T02:27:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1c56c1700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c00cb7d0 con 0x7fb1c00ae250 2024-08-17T02:27:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1c56c1700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00af590 con 0x7fb1c00cbc60 2024-08-17T02:27:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1c01599d0 0x7fb1c0159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1c01599d0 0x7fb1c0159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58650/0 (socket says 172.21.15.19:58650) 2024-08-17T02:27:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1c4ec0700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00cbc60 0x7fb1c00cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bf7fe700 1 -- 172.21.15.19:0/1060986700 learned_addr learned my addr 172.21.15.19:0/1060986700 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:05.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bffff700 1 --2- 172.21.15.19:0/1060986700 >> v2:172.21.15.119:3300/0 conn(0x7fb1c00ae250 0x7fb1c00ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bf7fe700 1 -- 172.21.15.19:0/1060986700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00cbc60 msgr2=0x7fb1c00cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bf7fe700 1 --2- 172.21.15.19:0/1060986700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00cbc60 0x7fb1c00cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bf7fe700 1 -- 172.21.15.19:0/1060986700 >> v2:172.21.15.119:3300/0 conn(0x7fb1c00ae250 msgr2=0x7fb1c00ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bf7fe700 1 --2- 172.21.15.19:0/1060986700 >> v2:172.21.15.119:3300/0 conn(0x7fb1c00ae250 0x7fb1c00ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bf7fe700 1 -- 172.21.15.19:0/1060986700 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c015a500 con 0x7fb1c01599d0 2024-08-17T02:27:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1bf7fe700 1 --2- 172.21.15.19:0/1060986700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 0x7fb1c0159de0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb1c006d070 tx=0x7fb1b400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ae570148eba02b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1beffd700 1 -- 172.21.15.19:0/1060986700 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b400db40 con 0x7fb1c01599d0 2024-08-17T02:27:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1beffd700 1 -- 172.21.15.19:0/1060986700 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b400dca0 con 0x7fb1c01599d0 2024-08-17T02:27:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.295+0000 7fb1beffd700 1 -- 172.21.15.19:0/1060986700 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40196b0 con 0x7fb1c01599d0 2024-08-17T02:27:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 -- 172.21.15.19:0/1060986700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 msgr2=0x7fb1c0159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/1060986700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 0x7fb1c0159de0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb1c006d070 tx=0x7fb1b400b4f0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 -- 172.21.15.19:0/1060986700 shutdown_connections 2024-08-17T02:27:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/1060986700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 0x7fb1c0159de0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/1060986700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00cbc60 0x7fb1c00cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/1060986700 >> v2:172.21.15.119:3300/0 conn(0x7fb1c00ae250 0x7fb1c00ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 -- 172.21.15.19:0/1060986700 >> 172.21.15.19:0/1060986700 conn(0x7fb1c00a9d30 msgr2=0x7fb1c00ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:05.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 -- 172.21.15.19:0/1060986700 shutdown_connections 2024-08-17T02:27:05.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 -- 172.21.15.19:0/1060986700 wait complete. 2024-08-17T02:27:05.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 Processor -- start 2024-08-17T02:27:05.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.299+0000 7fb1c56c1700 1 -- start start 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c56c1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00ae250 0x7fb1c0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c56c1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c00cbc60 0x7fb1c0069bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c56c1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 0x7fb1c009a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c56c1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00969f0 con 0x7fb1c01599d0 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c56c1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c006a110 con 0x7fb1c00cbc60 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c56c1700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c0097530 con 0x7fb1c00ae250 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c4ec0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 0x7fb1c009a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c4ec0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 0x7fb1c009a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58656/0 (socket says 172.21.15.19:58656) 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c4ec0700 1 -- 172.21.15.19:0/4066154067 learned_addr learned my addr 172.21.15.19:0/4066154067 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1bf7fe700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c00cbc60 0x7fb1c0069bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1bffff700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00ae250 0x7fb1c0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c4ec0700 1 -- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00ae250 msgr2=0x7fb1c0067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c4ec0700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00ae250 0x7fb1c0067630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c4ec0700 1 -- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c00cbc60 msgr2=0x7fb1c0069bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c4ec0700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c00cbc60 0x7fb1c0069bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c4ec0700 1 -- 172.21.15.19:0/4066154067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b400b790 con 0x7fb1c01599d0 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c4ec0700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 0x7fb1c009a590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009e90 tx=0x7fb1b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1a7fff700 1 -- 172.21.15.19:0/4066154067 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800cc20 con 0x7fb1c01599d0 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1a7fff700 1 -- 172.21.15.19:0/4066154067 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800f040 con 0x7fb1c01599d0 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c009aad0 con 0x7fb1c01599d0 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1a7fff700 1 -- 172.21.15.19:0/4066154067 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8014480 con 0x7fb1c01599d0 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c0096ee0 con 0x7fb1c01599d0 2024-08-17T02:27:05.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.303+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c00976a0 con 0x7fb1c01599d0 2024-08-17T02:27:05.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.307+0000 7fb1a7fff700 1 -- 172.21.15.19:0/4066154067 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb1b8014830 con 0x7fb1c01599d0 2024-08-17T02:27:05.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.307+0000 7fb1a7fff700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb1ac060860 0x7fb1ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.307+0000 7fb1a7fff700 1 -- 172.21.15.19:0/4066154067 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fb1b807d480 con 0x7fb1c01599d0 2024-08-17T02:27:05.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.307+0000 7fb1bffff700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb1ac060860 0x7fb1ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.307+0000 7fb1bffff700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb1ac060860 0x7fb1ac062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009cb0 tx=0x7fb1b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:05.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.315+0000 7fb1a7fff700 1 -- 172.21.15.19:0/4066154067 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb1b80514c0 con 0x7fb1c01599d0 2024-08-17T02:27:05.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:05.479+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1c00644b0 con 0x7fb1c01599d0 2024-08-17T02:27:06.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.163+0000 7fb1a7fff700 1 -- 172.21.15.19:0/4066154067 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb1b8051050 con 0x7fb1c01599d0 2024-08-17T02:27:06.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb1ac060860 msgr2=0x7fb1ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb1ac060860 0x7fb1ac062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009cb0 tx=0x7fb1b0008040 comp rx=0 tx=0).stop 2024-08-17T02:27:06.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 msgr2=0x7fb1c009a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 0x7fb1c009a590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009e90 tx=0x7fb1b800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:06.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 shutdown_connections 2024-08-17T02:27:06.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb1ac060860 0x7fb1ac062d10 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009cb0 tx=0x7fb1b0008040 comp rx=0 tx=0).stop 2024-08-17T02:27:06.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1c01599d0 0x7fb1c009a590 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c00cbc60 0x7fb1c0069bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 --2- 172.21.15.19:0/4066154067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c00ae250 0x7fb1c0067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 >> 172.21.15.19:0/4066154067 conn(0x7fb1c00a9d30 msgr2=0x7fb1c0154980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.167+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 shutdown_connections 2024-08-17T02:27:06.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.171+0000 7fb1c56c1700 1 -- 172.21.15.19:0/4066154067 wait complete. 2024-08-17T02:27:06.176 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-08-17T02:27:06.190 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:27:06.190 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:27:06.190 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:27:06.190 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:06.190 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:27:06.190 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:27:06.191 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:27:06.191 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:06.191 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:27:06.191 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:27:06.191 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:27:06.191 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:06.191 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:27:06.191 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:27:06.192 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:27:06.192 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:27:06.202 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:27:06.202 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:27:06.204 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:27:06.204 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:27:06.204 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:27:06.204 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:27:06.205 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:27:06.205 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:27:06.247 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:27:06.248 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:06.249 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:27:06.249 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:06.250 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:27:06.250 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:06.251 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:27:06.251 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:06.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:27:06.321 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-08-17T02:27:06.327 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2024-08-17T02:27:06.328 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2024-08-17T02:27:06.340 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-08-17T02:27:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e2fa7700 1 Processor -- start 2024-08-17T02:27:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e2fa7700 1 -- start start 2024-08-17T02:27:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e2fa7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 0x7f47dc1557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e2fa7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc155e30 con 0x7f47dc1553e0 2024-08-17T02:27:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e2fa7700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc156110 con 0x7f47dc0686a0 2024-08-17T02:27:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e2fa7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc1563f0 con 0x7f47dc0af4d0 2024-08-17T02:27:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e1fa5700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f47dc1553e0 0x7f47dc0b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54304/0 (socket says 172.21.15.19:54304) 2024-08-17T02:27:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e1fa5700 1 -- 172.21.15.19:0/672393831 learned_addr learned my addr 172.21.15.19:0/672393831 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e17a4700 1 --2- 172.21.15.19:0/672393831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 0x7f47dc1557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e0fa3700 1 -- 172.21.15.19:0/672393831 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601651871 0 0) 0x7f47dc156110 con 0x7f47dc0686a0 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e0fa3700 1 -- 172.21.15.19:0/672393831 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c8003570 con 0x7f47dc0686a0 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e0fa3700 1 -- 172.21.15.19:0/672393831 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559190656 0 0) 0x7f47dc155e30 con 0x7f47dc1553e0 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e0fa3700 1 -- 172.21.15.19:0/672393831 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47dc156110 con 0x7f47dc1553e0 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e17a4700 1 -- 172.21.15.19:0/672393831 >> v1:172.21.15.119:6789/0 conn(0x7f47dc0686a0 legacy=0x7f47dc0abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e17a4700 1 -- 172.21.15.19:0/672393831 >> v1:172.21.15.19:6789/0 conn(0x7f47dc1553e0 legacy=0x7f47dc0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.367+0000 7f47e17a4700 1 -- 172.21.15.19:0/672393831 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc1566d0 con 0x7f47dc0af4d0 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e17a4700 1 --2- 172.21.15.19:0/672393831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 0x7f47dc1557b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009940 tx=0x7f47cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eec20de251471b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e0fa3700 1 -- 172.21.15.19:0/672393831 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc011630 con 0x7f47dc0af4d0 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e0fa3700 1 -- 172.21.15.19:0/672393831 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc011790 con 0x7f47dc0af4d0 2024-08-17T02:27:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e0fa3700 1 -- 172.21.15.19:0/672393831 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc011b30 con 0x7f47dc0af4d0 2024-08-17T02:27:06.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e2fa7700 1 -- 172.21.15.19:0/672393831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 msgr2=0x7f47dc1557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e2fa7700 1 --2- 172.21.15.19:0/672393831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 0x7f47dc1557b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009940 tx=0x7f47cc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e2fa7700 1 -- 172.21.15.19:0/672393831 shutdown_connections 2024-08-17T02:27:06.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e2fa7700 1 --2- 172.21.15.19:0/672393831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 0x7f47dc1557b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e2fa7700 1 -- 172.21.15.19:0/672393831 >> 172.21.15.19:0/672393831 conn(0x7f47dc06d800 msgr2=0x7f47dc06dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e2fa7700 1 -- 172.21.15.19:0/672393831 shutdown_connections 2024-08-17T02:27:06.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e2fa7700 1 -- 172.21.15.19:0/672393831 wait complete. 2024-08-17T02:27:06.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e2fa7700 1 Processor -- start 2024-08-17T02:27:06.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.371+0000 7f47e2fa7700 1 -- start start 2024-08-17T02:27:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e2fa7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc0686a0 0x7f47dc1588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e2fa7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 0x7f47dc1680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e2fa7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47dc1553e0 0x7f47dc14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e2fa7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0a5450 con 0x7f47dc0686a0 2024-08-17T02:27:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e2fa7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0a5730 con 0x7f47dc1553e0 2024-08-17T02:27:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e2fa7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc168630 con 0x7f47dc0af4d0 2024-08-17T02:27:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e1fa5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc0686a0 0x7f47dc1588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e1fa5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc0686a0 0x7f47dc1588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58676/0 (socket says 172.21.15.19:58676) 2024-08-17T02:27:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e1fa5700 1 -- 172.21.15.19:0/1629198141 learned_addr learned my addr 172.21.15.19:0/1629198141 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e17a4700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 0x7f47dc1680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e1fa5700 1 -- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 msgr2=0x7f47dc1680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e1fa5700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 0x7f47dc1680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e1fa5700 1 -- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47dc1553e0 msgr2=0x7f47dc14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e27a6700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47dc1553e0 0x7f47dc14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e1fa5700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47dc1553e0 0x7f47dc14e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e1fa5700 1 -- 172.21.15.19:0/1629198141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc009420 con 0x7f47dc0686a0 2024-08-17T02:27:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e27a6700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47dc1553e0 0x7f47dc14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e1fa5700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc0686a0 0x7f47dc1588e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e9d0 tx=0x7f47d8007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47d1ffb700 1 -- 172.21.15.19:0/1629198141 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800ee40 con 0x7f47dc0686a0 2024-08-17T02:27:06.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47d1ffb700 1 -- 172.21.15.19:0/1629198141 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8005b30 con 0x7f47dc0686a0 2024-08-17T02:27:06.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47d1ffb700 1 -- 172.21.15.19:0/1629198141 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80070f0 con 0x7f47dc0686a0 2024-08-17T02:27:06.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.375+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc168900 con 0x7f47dc0686a0 2024-08-17T02:27:06.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.379+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc168ec0 con 0x7f47dc0686a0 2024-08-17T02:27:06.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.383+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc0052b0 con 0x7f47dc0686a0 2024-08-17T02:27:06.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.387+0000 7f47d1ffb700 1 -- 172.21.15.19:0/1629198141 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f47d80074e0 con 0x7f47dc0686a0 2024-08-17T02:27:06.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.387+0000 7f47d1ffb700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47c0060930 0x7f47c0062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.387+0000 7f47d1ffb700 1 -- 172.21.15.19:0/1629198141 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f47d807eb00 con 0x7f47dc0686a0 2024-08-17T02:27:06.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.387+0000 7f47e17a4700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47c0060930 0x7f47c0062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.391+0000 7f47e17a4700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47c0060930 0x7f47c0062de0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0093f0 tx=0x7f47cc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.395+0000 7f47d1ffb700 1 -- 172.21.15.19:0/1629198141 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f47d804f3b0 con 0x7f47dc0686a0 2024-08-17T02:27:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:06.567+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f47bc005560 con 0x7f47dc0686a0 2024-08-17T02:27:07.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.187+0000 7f47d1ffb700 1 -- 172.21.15.19:0/1629198141 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f47d80529d0 con 0x7f47dc0686a0 2024-08-17T02:27:07.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.191+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47c0060930 msgr2=0x7f47c0062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.191+0000 7f47e2fa7700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47c0060930 0x7f47c0062de0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0093f0 tx=0x7f47cc017000 comp rx=0 tx=0).stop 2024-08-17T02:27:07.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.191+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc0686a0 msgr2=0x7f47dc1588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.191+0000 7f47e2fa7700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc0686a0 0x7f47dc1588e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e9d0 tx=0x7f47d8007e90 comp rx=0 tx=0).stop 2024-08-17T02:27:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.195+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 shutdown_connections 2024-08-17T02:27:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.195+0000 7f47e2fa7700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47c0060930 0x7f47c0062de0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.195+0000 7f47e2fa7700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47dc1553e0 0x7f47dc14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.195+0000 7f47e2fa7700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47dc0af4d0 0x7f47dc1680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.195+0000 7f47e2fa7700 1 --2- 172.21.15.19:0/1629198141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc0686a0 0x7f47dc1588e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.195+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 >> 172.21.15.19:0/1629198141 conn(0x7f47dc06d800 msgr2=0x7f47dc0abf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.195+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 shutdown_connections 2024-08-17T02:27:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.195+0000 7f47e2fa7700 1 -- 172.21.15.19:0/1629198141 wait complete. 2024-08-17T02:27:07.200 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-08-17T02:27:07.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:27:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.319+0000 7f71315e6700 1 Processor -- start 2024-08-17T02:27:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.319+0000 7f71315e6700 1 -- start start 2024-08-17T02:27:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f712c153320 0x7f712c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c15a190 0x7f712c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c15dbd0 con 0x7f712c0ccaa0 2024-08-17T02:27:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c0ce430 con 0x7f712c153320 2024-08-17T02:27:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c15d370 con 0x7f712c15a190 2024-08-17T02:27:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712b7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c15a190 0x7f712c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712b7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c15a190 0x7f712c15cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:44964/0 (socket says 172.21.15.19:44964) 2024-08-17T02:27:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712b7fe700 1 -- 172.21.15.19:0/1487775771 learned_addr learned my addr 172.21.15.19:0/1487775771 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712bfff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f712c153320 0x7f712c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712b7fe700 1 -- 172.21.15.19:0/1487775771 >> v2:172.21.15.119:3300/0 conn(0x7f712c153320 msgr2=0x7f712c1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712b7fe700 1 --2- 172.21.15.19:0/1487775771 >> v2:172.21.15.119:3300/0 conn(0x7f712c153320 0x7f712c1536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712b7fe700 1 -- 172.21.15.19:0/1487775771 >> v1:172.21.15.119:6789/0 conn(0x7f712c0ccaa0 legacy=0x7f712c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712b7fe700 1 -- 172.21.15.19:0/1487775771 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c15d610 con 0x7f712c15a190 2024-08-17T02:27:07.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712affd700 1 -- 172.21.15.19:0/1487775771 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895586782 0 0) 0x7f712c15dbd0 con 0x7f712c0ccaa0 2024-08-17T02:27:07.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712b7fe700 1 --2- 172.21.15.19:0/1487775771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c15a190 0x7f712c15cc60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7114009f20 tx=0x7f7114009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf82373afde9f9af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712affd700 1 -- 172.21.15.19:0/1487775771 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400e070 con 0x7f712c15a190 2024-08-17T02:27:07.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712affd700 1 -- 172.21.15.19:0/1487775771 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711400b9d0 con 0x7f712c15a190 2024-08-17T02:27:07.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f712affd700 1 -- 172.21.15.19:0/1487775771 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71140092e0 con 0x7f712c15a190 2024-08-17T02:27:07.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 -- 172.21.15.19:0/1487775771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c15a190 msgr2=0x7f712c15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 --2- 172.21.15.19:0/1487775771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c15a190 0x7f712c15cc60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7114009f20 tx=0x7f7114009840 comp rx=0 tx=0).stop 2024-08-17T02:27:07.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 -- 172.21.15.19:0/1487775771 shutdown_connections 2024-08-17T02:27:07.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 --2- 172.21.15.19:0/1487775771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c15a190 0x7f712c15cc60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 --2- 172.21.15.19:0/1487775771 >> v2:172.21.15.119:3300/0 conn(0x7f712c153320 0x7f712c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 -- 172.21.15.19:0/1487775771 >> 172.21.15.19:0/1487775771 conn(0x7f712c0d00a0 msgr2=0x7f712c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 -- 172.21.15.19:0/1487775771 shutdown_connections 2024-08-17T02:27:07.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.323+0000 7f71315e6700 1 -- 172.21.15.19:0/1487775771 wait complete. 2024-08-17T02:27:07.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f71315e6700 1 Processor -- start 2024-08-17T02:27:07.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f71315e6700 1 -- start start 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f71315e6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c0ccaa0 0x7f712c0ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f71315e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f712c153320 0x7f712c0c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f71315e6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f712c15a190 0x7f712c0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f71315e6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0c9350 con 0x7f712c153320 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f71315e6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c158bc0 con 0x7f712c15a190 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f71315e6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0c86d0 con 0x7f712c0ccaa0 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f712c153320 0x7f712c0c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f712c153320 0x7f712c0c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58684/0 (socket says 172.21.15.19:58684) 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712b7fe700 1 -- 172.21.15.19:0/572920805 learned_addr learned my addr 172.21.15.19:0/572920805 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712bfff700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c0ccaa0 0x7f712c0ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f7130de5700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f712c15a190 0x7f712c0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712b7fe700 1 -- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c0ccaa0 msgr2=0x7f712c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712b7fe700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c0ccaa0 0x7f712c0ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712b7fe700 1 -- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f712c15a190 msgr2=0x7f712c0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712b7fe700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f712c15a190 0x7f712c0c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712b7fe700 1 -- 172.21.15.19:0/572920805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009ae0 con 0x7f712c153320 2024-08-17T02:27:07.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f712b7fe700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f712c153320 0x7f712c0c7b60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ce570 tx=0x7f7114018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.327+0000 7f7123fff700 1 -- 172.21.15.19:0/572920805 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114007860 con 0x7f712c153320 2024-08-17T02:27:07.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.331+0000 7f7123fff700 1 -- 172.21.15.19:0/572920805 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71140079c0 con 0x7f712c153320 2024-08-17T02:27:07.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.331+0000 7f7123fff700 1 -- 172.21.15.19:0/572920805 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114007d80 con 0x7f712c153320 2024-08-17T02:27:07.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.331+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c0c89b0 con 0x7f712c153320 2024-08-17T02:27:07.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.331+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c0c8f70 con 0x7f712c153320 2024-08-17T02:27:07.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.331+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c0638f0 con 0x7f712c153320 2024-08-17T02:27:07.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.331+0000 7f7123fff700 1 -- 172.21.15.19:0/572920805 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7114003040 con 0x7f712c153320 2024-08-17T02:27:07.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.331+0000 7f7123fff700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f710c060860 0x7f710c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.331+0000 7f7123fff700 1 -- 172.21.15.19:0/572920805 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f711407e000 con 0x7f712c153320 2024-08-17T02:27:07.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.335+0000 7f712bfff700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f710c060860 0x7f710c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.335+0000 7f712bfff700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f710c060860 0x7f710c062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f711c009d20 tx=0x7f711c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.339+0000 7f7123fff700 1 -- 172.21.15.19:0/572920805 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f711404e850 con 0x7f712c153320 2024-08-17T02:27:07.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.563+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f712c0cde20 con 0x7f712c153320 2024-08-17T02:27:07.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.563+0000 7f7123fff700 1 -- 172.21.15.19:0/572920805 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7114051e70 con 0x7f712c153320 2024-08-17T02:27:07.570 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:07.570 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:27:07.570 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-08-17T02:27:07.570 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.570 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-08-17T02:27:07.570 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBmsTqgFBAAOCc/W/y5ACbhtPW7ZLxUow==", 2024-08-17T02:27:07.570 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBm5JtVHhAAMbDT3w/B4uNGt3TmC8IJbA==", 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-08-17T02:27:07.571 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBmsaTLFxAA0Eymepj447cXeSPRLhO8og==", 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBmsLceJBAADLw/M5zQ6mURSEplnKFe2w==", 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAaCsBm4oOFGxAAN2sqMKdl9o4RRUoUj8Qm8w==", 2024-08-17T02:27:07.573 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAdCsBmSZBdIRAAZTjzmDVqLZH37I6W1Qzimw==", 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.574 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAgCsBm1FsIJBAAawsul20jbbS9SljQCvXcBw==", 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-08-17T02:27:07.575 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAjCsBmglZMKBAAPVjEYoRcl9ugMp5/VyEt7g==", 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQApCsBmzJx3EBAAF/MJkuNrSQ2utKEpx+BS+w==", 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAsCsBmsaKmExAAD8ntQBy9sM9a2rCXmAR2+g==", 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAvCsBmixRnFxAAUMKYGYh9D0wNmbO8Q74Wkg==", 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.577 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAyCsBmyShpGRAA73boEmYCqOn5ehFJ+zYqgw==", 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBmO43SJhAAxpOvqiDeKys6AuR/VE1qBw==", 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBmyAN8LBAACo9oXCnD1D/T9secJCDHTQ==", 2024-08-17T02:27:07.579 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBmicJ+KRAA+tiwA/x7dWAU6QspLPxGHw==", 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-08-17T02:27:07.580 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBmAdnwMRAAj0WBwS1rtHYxb7w2xkVULw==", 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-08-17T02:27:07.581 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBma3pDBRAApRBVCbF+UvT+CbMyaVanrw==", 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA8CsBmRx0GGhAAGyYfJpBrpIymr+uffspFQQ==", 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA8CsBmNDcGGhAAxhOSk9jFdf9JtnrKLPeGZw==", 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA8CsBmglMGGhAAY7jt50jwAVq3Sv7sL1AOZQ==", 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA8CsBmQWoGGhAAKANlPhSBG25gzHjOXoT+eg==", 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA8CsBmu4YGGhAAIzO55NcKWWjgMFM/KFiKhA==", 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:27:07.584 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQA8CsBmy54GGhAA34qn47vwaXA3cR03mZswSw==", 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBmAQf0ERAA6IlHB7pw++p3D2Qq+V/grA==", 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.585 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAXCsBmuzf/DhAAJCJahs3RRlj4feLvV3Onwg==", 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-08-17T02:27:07.586 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f710c060860 msgr2=0x7f710c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f710c060860 0x7f710c062d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f711c009d20 tx=0x7f711c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f712c153320 msgr2=0x7f712c0c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f712c153320 0x7f712c0c7b60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ce570 tx=0x7f7114018000 comp rx=0 tx=0).stop 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 shutdown_connections 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f710c060860 0x7f710c062d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f712c15a190 0x7f712c0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f712c153320 0x7f712c0c7b60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 --2- 172.21.15.19:0/572920805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f712c0ccaa0 0x7f712c0ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 >> 172.21.15.19:0/572920805 conn(0x7f712c0d00a0 msgr2=0x7f712c15ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 shutdown_connections 2024-08-17T02:27:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.567+0000 7f71315e6700 1 -- 172.21.15.19:0/572920805 wait complete. 2024-08-17T02:27:07.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:27:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.691+0000 7f8d00a43700 1 Processor -- start 2024-08-17T02:27:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.691+0000 7f8d00a43700 1 -- start start 2024-08-17T02:27:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.691+0000 7f8d00a43700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8cfc06e140 0x7f8cfc06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.691+0000 7f8d00a43700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 0x7f8cfc156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.691+0000 7f8d00a43700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc156940 con 0x7f8cfc1556f0 2024-08-17T02:27:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.691+0000 7f8d00a43700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc155d30 con 0x7f8cfc06e140 2024-08-17T02:27:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.691+0000 7f8d00a43700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc156010 con 0x7f8cfc06aff0 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cfad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8cfc06e140 0x7f8cfc06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cfad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8cfc06e140 0x7f8cfc06e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58694/0 (socket says 172.21.15.19:58694) 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cfad9d700 1 -- 172.21.15.19:0/464278512 learned_addr learned my addr 172.21.15.19:0/464278512 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cfb59e700 1 --2- 172.21.15.19:0/464278512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 0x7f8cfc156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cfad9d700 1 -- 172.21.15.19:0/464278512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 msgr2=0x7f8cfc156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cf9d9b700 1 -- 172.21.15.19:0/464278512 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109665083 0 0) 0x7f8cfc156940 con 0x7f8cfc1556f0 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cfad9d700 1 --2- 172.21.15.19:0/464278512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 0x7f8cfc156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cfad9d700 1 -- 172.21.15.19:0/464278512 >> v1:172.21.15.119:6789/0 conn(0x7f8cfc1556f0 legacy=0x7f8cfc0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cfad9d700 1 -- 172.21.15.19:0/464278512 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc1562f0 con 0x7f8cfc06e140 2024-08-17T02:27:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cfad9d700 1 --2- 172.21.15.19:0/464278512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc06e140 0x7f8cfc06e510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00bc50 tx=0x7f8cec00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4470dbc78917eaf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cf9d9b700 1 -- 172.21.15.19:0/464278512 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec00dbf0 con 0x7f8cfc06e140 2024-08-17T02:27:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cf9d9b700 1 -- 172.21.15.19:0/464278512 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec00dd50 con 0x7f8cfc06e140 2024-08-17T02:27:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8cf9d9b700 1 -- 172.21.15.19:0/464278512 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0196b0 con 0x7f8cfc06e140 2024-08-17T02:27:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 -- 172.21.15.19:0/464278512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc06e140 msgr2=0x7f8cfc06e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 --2- 172.21.15.19:0/464278512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc06e140 0x7f8cfc06e510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00bc50 tx=0x7f8cec00b4f0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 -- 172.21.15.19:0/464278512 shutdown_connections 2024-08-17T02:27:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 --2- 172.21.15.19:0/464278512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 0x7f8cfc156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 --2- 172.21.15.19:0/464278512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc06e140 0x7f8cfc06e510 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 -- 172.21.15.19:0/464278512 >> 172.21.15.19:0/464278512 conn(0x7f8cfc0678d0 msgr2=0x7f8cfc067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 -- 172.21.15.19:0/464278512 shutdown_connections 2024-08-17T02:27:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 -- 172.21.15.19:0/464278512 wait complete. 2024-08-17T02:27:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 Processor -- start 2024-08-17T02:27:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.695+0000 7f8d00a43700 1 -- start start 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8d00a43700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 0x7f8cfc168d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8d00a43700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cfc1556f0 0x7f8cfc136f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8d00a43700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc135780 0x7f8cfc1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8d00a43700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc137880 con 0x7f8cfc135780 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8d00a43700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc137b60 con 0x7f8cfc1556f0 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8d00a43700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc137e40 con 0x7f8cfc06aff0 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfb59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc135780 0x7f8cfc1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfb59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc135780 0x7f8cfc1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58708/0 (socket says 172.21.15.19:58708) 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfad9d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 0x7f8cfc168d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfb59e700 1 -- 172.21.15.19:0/3919418398 learned_addr learned my addr 172.21.15.19:0/3919418398 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfa59c700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cfc1556f0 0x7f8cfc136f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfad9d700 1 -- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cfc1556f0 msgr2=0x7f8cfc136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfad9d700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cfc1556f0 0x7f8cfc136f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfad9d700 1 -- 172.21.15.19:0/3919418398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc135780 msgr2=0x7f8cfc1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfad9d700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc135780 0x7f8cfc1591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfad9d700 1 -- 172.21.15.19:0/3919418398 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec00b790 con 0x7f8cfc06aff0 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8cfad9d700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 0x7f8cfc168d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc06c630 tx=0x7f8cec01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8ce2ffd700 1 -- 172.21.15.19:0/3919418398 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec01ae50 con 0x7f8cfc06aff0 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8ce2ffd700 1 -- 172.21.15.19:0/3919418398 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec010680 con 0x7f8cfc06aff0 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc138120 con 0x7f8cfc06aff0 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8ce2ffd700 1 -- 172.21.15.19:0/3919418398 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec010a40 con 0x7f8cfc06aff0 2024-08-17T02:27:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc137490 con 0x7f8cfc06aff0 2024-08-17T02:27:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.699+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc1694c0 con 0x7f8cfc06aff0 2024-08-17T02:27:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.703+0000 7f8ce2ffd700 1 -- 172.21.15.19:0/3919418398 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8cec040980 con 0x7f8cfc06aff0 2024-08-17T02:27:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.703+0000 7f8ce2ffd700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ce8060860 0x7f8ce8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.703+0000 7f8ce2ffd700 1 -- 172.21.15.19:0/3919418398 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8cec014070 con 0x7f8cfc06aff0 2024-08-17T02:27:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.703+0000 7f8cfa59c700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ce8060860 0x7f8ce8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.703+0000 7f8cfa59c700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ce8060860 0x7f8ce8062d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc0afaf0 tx=0x7f8cf0007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.711+0000 7f8ce2ffd700 1 -- 172.21.15.19:0/3919418398 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8cec04efd0 con 0x7f8cfc06aff0 2024-08-17T02:27:07.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.939+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f8cfc0643a0 con 0x7f8cfc06aff0 2024-08-17T02:27:07.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.947+0000 7f8ce2ffd700 1 -- 172.21.15.19:0/3919418398 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8cec0525f0 con 0x7f8cfc06aff0 2024-08-17T02:27:07.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ce8060860 msgr2=0x7f8ce8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ce8060860 0x7f8ce8062d10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc0afaf0 tx=0x7f8cf0007ec0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 msgr2=0x7f8cfc168d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 0x7f8cfc168d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc06c630 tx=0x7f8cec01b000 comp rx=0 tx=0).stop 2024-08-17T02:27:07.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 shutdown_connections 2024-08-17T02:27:07.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8ce8060860 0x7f8ce8062d10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cfc135780 0x7f8cfc1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cfc1556f0 0x7f8cfc136f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 --2- 172.21.15.19:0/3919418398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8cfc06aff0 0x7f8cfc168d60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 >> 172.21.15.19:0/3919418398 conn(0x7f8cfc0678d0 msgr2=0x7f8cfc06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 shutdown_connections 2024-08-17T02:27:07.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:07.951+0000 7f8d00a43700 1 -- 172.21.15.19:0/3919418398 wait complete. 2024-08-17T02:27:07.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:27:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fafdb700 1 Processor -- start 2024-08-17T02:27:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fafdb700 1 -- start start 2024-08-17T02:27:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fafdb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f40b0d20 0x7f50f406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fafdb700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50f40b1800 0x7f50f4141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fafdb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f4141a00 con 0x7f50f406e450 2024-08-17T02:27:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fafdb700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f406e8a0 con 0x7f50f40b1800 2024-08-17T02:27:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fafdb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4140b10 con 0x7f50f40b0d20 2024-08-17T02:27:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f97d8700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f50f406e450 0x7f50f40b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50576/0 (socket says 172.21.15.19:50576) 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f97d8700 1 -- 172.21.15.19:0/4268756178 learned_addr learned my addr 172.21.15.19:0/4268756178 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fa7da700 1 --2- 172.21.15.19:0/4268756178 >> v2:172.21.15.119:3300/0 conn(0x7f50f40b1800 0x7f50f4141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411725353 0 0) 0x7f50f4141a00 con 0x7f50f406e450 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e0003570 con 0x7f50f406e450 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f9fd9700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f40b0d20 0x7f50f406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186370559 0 0) 0x7f50e0003570 con 0x7f50f406e450 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f40b0d20 msgr2=0x7f50f406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f40b0d20 0x7f50f406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 >> v2:172.21.15.119:3300/0 conn(0x7f50f40b1800 msgr2=0x7f50f4141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 --2- 172.21.15.19:0/4268756178 >> v2:172.21.15.119:3300/0 conn(0x7f50f40b1800 0x7f50f4141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4140df0 con 0x7f50f406e450 2024-08-17T02:27:08.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f50f0001470 con 0x7f50f406e450 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 >> v1:172.21.15.19:6789/0 conn(0x7f50f406e450 legacy=0x7f50f40b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e0003a60 0x7f50e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50e0004810 0x7f50e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50e00051c0 0x7f50e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f406e8a0 con 0x7f50e00051c0 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4140b10 con 0x7f50e0003a60 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e000bfa0 con 0x7f50e0004810 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fa7da700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50e00051c0 0x7f50e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f97d8700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50e0004810 0x7f50e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f9fd9700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e0003a60 0x7f50e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fa7da700 1 -- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50e0004810 msgr2=0x7f50e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fa7da700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50e0004810 0x7f50e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fa7da700 1 -- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e0003a60 msgr2=0x7f50e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fa7da700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e0003a60 0x7f50e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fa7da700 1 -- 172.21.15.19:0/4268756178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0003570 con 0x7f50e00051c0 2024-08-17T02:27:08.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50fa7da700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50e00051c0 0x7f50e000ba60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00e240 tx=0x7f50ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14873e33a3ecac18 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00eaf0 con 0x7f50e00051c0 2024-08-17T02:27:08.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec00f040 con 0x7f50e00051c0 2024-08-17T02:27:08.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.071+0000 7f50f8fd7700 1 -- 172.21.15.19:0/4268756178 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00eea0 con 0x7f50e00051c0 2024-08-17T02:27:08.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.075+0000 7f50fafdb700 1 -- 172.21.15.19:0/4268756178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50e00051c0 msgr2=0x7f50e000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.075+0000 7f50fafdb700 1 --2- 172.21.15.19:0/4268756178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50e00051c0 0x7f50e000ba60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00e240 tx=0x7f50ec00b040 comp rx=0 tx=0).stop 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.075+0000 7f50fa7da700 1 -- 172.21.15.19:0/4268756178 reap_dead start 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.075+0000 7f50fafdb700 1 -- 172.21.15.19:0/4268756178 shutdown_connections 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.075+0000 7f50fafdb700 1 -- 172.21.15.19:0/4268756178 >> 172.21.15.19:0/4268756178 conn(0x7f50f40678d0 msgr2=0x7f50f4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.075+0000 7f50fafdb700 1 -- 172.21.15.19:0/4268756178 shutdown_connections 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.075+0000 7f50fafdb700 1 -- 172.21.15.19:0/4268756178 wait complete. 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.075+0000 7f50fafdb700 1 Processor -- start 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.075+0000 7f50fafdb700 1 -- start start 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fafdb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e00051c0 0x7f50f40a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fafdb700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f415bb00 0x7f50f40acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fafdb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f415bf70 0x7f50f40a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fafdb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40a5e20 con 0x7f50f415bf70 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fafdb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40ad5a0 con 0x7f50e00051c0 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fafdb700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40a54f0 con 0x7f50f415bb00 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fa7da700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f415bf70 0x7f50f40a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fa7da700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f415bf70 0x7f50f40a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39426/0 (socket says 172.21.15.19:39426) 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fa7da700 1 -- 172.21.15.19:0/391840054 learned_addr learned my addr 172.21.15.19:0/391840054 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50f9fd9700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e00051c0 0x7f50f40a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50f97d8700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f415bb00 0x7f50f40acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fa7da700 1 -- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f415bb00 msgr2=0x7f50f40acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fa7da700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f415bb00 0x7f50f40acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fa7da700 1 -- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e00051c0 msgr2=0x7f50f40a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fa7da700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e00051c0 0x7f50f40a7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fa7da700 1 -- 172.21.15.19:0/391840054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f40a57d0 con 0x7f50f415bf70 2024-08-17T02:27:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50f97d8700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f415bb00 0x7f50f40acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50f9fd9700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e00051c0 0x7f50f40a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fa7da700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f415bf70 0x7f50f40a9fc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00afd0 tx=0x7f50ec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50e9ffb700 1 -- 172.21.15.19:0/391840054 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec00ee80 con 0x7f50f415bf70 2024-08-17T02:27:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50e9ffb700 1 -- 172.21.15.19:0/391840054 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec022070 con 0x7f50f415bf70 2024-08-17T02:27:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f40a5ab0 con 0x7f50f415bf70 2024-08-17T02:27:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50e9ffb700 1 -- 172.21.15.19:0/391840054 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec01e850 con 0x7f50f415bf70 2024-08-17T02:27:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.079+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f40ad010 con 0x7f50f415bf70 2024-08-17T02:27:08.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.083+0000 7f50e9ffb700 1 -- 172.21.15.19:0/391840054 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f50ec01ec40 con 0x7f50f415bf70 2024-08-17T02:27:08.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.083+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f40a5fd0 con 0x7f50f415bf70 2024-08-17T02:27:08.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.083+0000 7f50e9ffb700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f50d8060890 0x7f50d8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.083+0000 7f50e9ffb700 1 -- 172.21.15.19:0/391840054 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f50ec024070 con 0x7f50f415bf70 2024-08-17T02:27:08.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.083+0000 7f50f9fd9700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f50d8060890 0x7f50d8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.083+0000 7f50f9fd9700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f50d8060890 0x7f50d8062d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f50e4006fd0 tx=0x7f50e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.087+0000 7f50e9ffb700 1 -- 172.21.15.19:0/391840054 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f50f40a5fd0 con 0x7f50f415bf70 2024-08-17T02:27:08.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.319+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f50f40a5c40 con 0x7f50f415bf70 2024-08-17T02:27:08.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50e9ffb700 1 -- 172.21.15.19:0/391840054 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f50ec018020 con 0x7f50f415bf70 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f50d8060890 msgr2=0x7f50d8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f50d8060890 0x7f50d8062d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f50e4006fd0 tx=0x7f50e4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f415bf70 msgr2=0x7f50f40a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f415bf70 0x7f50f40a9fc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00afd0 tx=0x7f50ec01a000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 shutdown_connections 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f50d8060890 0x7f50d8062d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50f415bf70 0x7f50f40a9fc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f415bb00 0x7f50f40acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 --2- 172.21.15.19:0/391840054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50e00051c0 0x7f50f40a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 >> 172.21.15.19:0/391840054 conn(0x7f50f40678d0 msgr2=0x7f50f406a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 shutdown_connections 2024-08-17T02:27:08.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.327+0000 7f50fafdb700 1 -- 172.21.15.19:0/391840054 wait complete. 2024-08-17T02:27:08.348 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:27:08.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.451+0000 7faf20134700 1 Processor -- start 2024-08-17T02:27:08.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.451+0000 7faf20134700 1 -- start start 2024-08-17T02:27:08.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faf18155760 0x7faf180abf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155b30 0x7faf1806eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf180aa580 0x7faf1806f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf180c87d0 con 0x7faf180aa580 2024-08-17T02:27:08.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf180ac7d0 con 0x7faf18155760 2024-08-17T02:27:08.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf180acab0 con 0x7faf18155b30 2024-08-17T02:27:08.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1e6d1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf180aa580 0x7faf1806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1e6d1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faf180aa580 0x7faf1806f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39430/0 (socket says 172.21.15.19:39430) 2024-08-17T02:27:08.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1e6d1700 1 -- 172.21.15.19:0/244981554 learned_addr learned my addr 172.21.15.19:0/244981554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:08.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1d6cf700 1 --2- 172.21.15.19:0/244981554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155b30 0x7faf1806eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1ded0700 1 --2- 172.21.15.19:0/244981554 >> v2:172.21.15.119:3300/0 conn(0x7faf18155760 0x7faf180abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1e6d1700 1 -- 172.21.15.19:0/244981554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155b30 msgr2=0x7faf1806eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1e6d1700 1 --2- 172.21.15.19:0/244981554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155b30 0x7faf1806eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1e6d1700 1 -- 172.21.15.19:0/244981554 >> v2:172.21.15.119:3300/0 conn(0x7faf18155760 msgr2=0x7faf180abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1e6d1700 1 --2- 172.21.15.19:0/244981554 >> v2:172.21.15.119:3300/0 conn(0x7faf18155760 0x7faf180abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1e6d1700 1 -- 172.21.15.19:0/244981554 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf180acd90 con 0x7faf180aa580 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1d6cf700 1 --2- 172.21.15.19:0/244981554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155b30 0x7faf1806eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1e6d1700 1 --2- 172.21.15.19:0/244981554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf180aa580 0x7faf1806f080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faf1806c9d0 tx=0x7faf10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd89046c86e2302e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1cece700 1 -- 172.21.15.19:0/244981554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000e070 con 0x7faf180aa580 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1cece700 1 -- 172.21.15.19:0/244981554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1000b970 con 0x7faf180aa580 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf1cece700 1 -- 172.21.15.19:0/244981554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf100092e0 con 0x7faf180aa580 2024-08-17T02:27:08.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 -- 172.21.15.19:0/244981554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf180aa580 msgr2=0x7faf1806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 --2- 172.21.15.19:0/244981554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf180aa580 0x7faf1806f080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faf1806c9d0 tx=0x7faf10009840 comp rx=0 tx=0).stop 2024-08-17T02:27:08.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 -- 172.21.15.19:0/244981554 shutdown_connections 2024-08-17T02:27:08.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 --2- 172.21.15.19:0/244981554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf180aa580 0x7faf1806f080 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 --2- 172.21.15.19:0/244981554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155b30 0x7faf1806eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 --2- 172.21.15.19:0/244981554 >> v2:172.21.15.119:3300/0 conn(0x7faf18155760 0x7faf180abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 -- 172.21.15.19:0/244981554 >> 172.21.15.19:0/244981554 conn(0x7faf18067810 msgr2=0x7faf18067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 -- 172.21.15.19:0/244981554 shutdown_connections 2024-08-17T02:27:08.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.455+0000 7faf20134700 1 -- 172.21.15.19:0/244981554 wait complete. 2024-08-17T02:27:08.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf20134700 1 Processor -- start 2024-08-17T02:27:08.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf20134700 1 -- start start 2024-08-17T02:27:08.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf20134700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf180aa580 0x7faf18143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf20134700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155760 0x7faf180c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf20134700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf18155b30 0x7faf1806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf20134700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf18097b20 con 0x7faf18155b30 2024-08-17T02:27:08.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf20134700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf18096dd0 con 0x7faf180aa580 2024-08-17T02:27:08.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf20134700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf180970b0 con 0x7faf18155760 2024-08-17T02:27:08.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1e6d1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf18155b30 0x7faf1806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1e6d1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf18155b30 0x7faf1806e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39438/0 (socket says 172.21.15.19:39438) 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1e6d1700 1 -- 172.21.15.19:0/1091733451 learned_addr learned my addr 172.21.15.19:0/1091733451 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1ded0700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf180aa580 0x7faf18143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1d6cf700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155760 0x7faf180c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1e6d1700 1 -- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155760 msgr2=0x7faf180c0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1e6d1700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155760 0x7faf180c0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1e6d1700 1 -- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf180aa580 msgr2=0x7faf18143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1e6d1700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf180aa580 0x7faf18143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.459+0000 7faf1e6d1700 1 -- 172.21.15.19:0/1091733451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14009420 con 0x7faf18155b30 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf1e6d1700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf18155b30 0x7faf1806e2b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faf18068ac0 tx=0x7faf10018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf0dffb700 1 -- 172.21.15.19:0/1091733451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10008ad0 con 0x7faf18155b30 2024-08-17T02:27:08.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf0dffb700 1 -- 172.21.15.19:0/1091733451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf10008c50 con 0x7faf18155b30 2024-08-17T02:27:08.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf10009ae0 con 0x7faf18155b30 2024-08-17T02:27:08.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf0dffb700 1 -- 172.21.15.19:0/1091733451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10025460 con 0x7faf18155b30 2024-08-17T02:27:08.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf180977b0 con 0x7faf18155b30 2024-08-17T02:27:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf0dffb700 1 -- 172.21.15.19:0/1091733451 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7faf10003040 con 0x7faf18155b30 2024-08-17T02:27:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf18099f00 con 0x7faf18155b30 2024-08-17T02:27:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf0dffb700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faefc060890 0x7faefc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf0dffb700 1 -- 172.21.15.19:0/1091733451 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faf1007e1e0 con 0x7faf18155b30 2024-08-17T02:27:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.463+0000 7faf1ded0700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faefc060890 0x7faefc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.467+0000 7faf1ded0700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faefc060890 0x7faefc062d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf08009d10 tx=0x7faf080091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.475+0000 7faf0dffb700 1 -- 172.21.15.19:0/1091733451 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7faf18099f00 con 0x7faf18155b30 2024-08-17T02:27:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.695+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7faf18099f00 con 0x7faf18155b30 2024-08-17T02:27:08.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.703+0000 7faf0dffb700 1 -- 172.21.15.19:0/1091733451 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7faf18099f00 con 0x7faf18155b30 2024-08-17T02:27:08.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faefc060890 msgr2=0x7faefc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faefc060890 0x7faefc062d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf08009d10 tx=0x7faf080091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf18155b30 msgr2=0x7faf1806e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf18155b30 0x7faf1806e2b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faf18068ac0 tx=0x7faf10018000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 shutdown_connections 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faefc060890 0x7faefc062d40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf18155b30 0x7faf1806e2b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf18155760 0x7faf180c0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 --2- 172.21.15.19:0/1091733451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf180aa580 0x7faf18143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 >> 172.21.15.19:0/1091733451 conn(0x7faf18067810 msgr2=0x7faf1806ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 shutdown_connections 2024-08-17T02:27:08.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.707+0000 7faf20134700 1 -- 172.21.15.19:0/1091733451 wait complete. 2024-08-17T02:27:08.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:27:08.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99b59e700 1 Processor -- start 2024-08-17T02:27:08.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99b59e700 1 -- start start 2024-08-17T02:27:08.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99b59e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe99c15c620 0x7fe99c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99b59e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe99c0ad1b0 0x7fe99c0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99b59e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99c0c86e0 con 0x7fe99c15cd90 2024-08-17T02:27:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99b59e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c15d210 con 0x7fe99c15c620 2024-08-17T02:27:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99b59e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c0cb850 con 0x7fe99c0ad1b0 2024-08-17T02:27:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe99c15c620 0x7fe99c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe999d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe99c15cd90 0x7fe99c0acaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50580/0 (socket says 172.21.15.19:50580) 2024-08-17T02:27:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe999d9b700 1 -- 172.21.15.19:0/4104826336 learned_addr learned my addr 172.21.15.19:0/4104826336 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:08.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99ad9d700 1 --2- 172.21.15.19:0/4104826336 >> v2:172.21.15.119:3300/0 conn(0x7fe99c0ad1b0 0x7fe99c0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99959a700 1 -- 172.21.15.19:0/4104826336 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287683448 0 0) 0x7fe99c0c86e0 con 0x7fe99c15cd90 2024-08-17T02:27:08.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99959a700 1 -- 172.21.15.19:0/4104826336 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe984003570 con 0x7fe99c15cd90 2024-08-17T02:27:08.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99a59c700 1 -- 172.21.15.19:0/4104826336 >> v2:172.21.15.119:3300/0 conn(0x7fe99c0ad1b0 msgr2=0x7fe99c0c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99a59c700 1 --2- 172.21.15.19:0/4104826336 >> v2:172.21.15.119:3300/0 conn(0x7fe99c0ad1b0 0x7fe99c0c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99a59c700 1 -- 172.21.15.19:0/4104826336 >> v1:172.21.15.19:6789/0 conn(0x7fe99c15cd90 legacy=0x7fe99c0acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99a59c700 1 -- 172.21.15.19:0/4104826336 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c15d490 con 0x7fe99c15c620 2024-08-17T02:27:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99a59c700 1 --2- 172.21.15.19:0/4104826336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15c620 0x7fe99c0b0320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0b0930 tx=0x7fe98c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7947c9a3caf0fa0e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99959a700 1 -- 172.21.15.19:0/4104826336 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c011630 con 0x7fe99c15c620 2024-08-17T02:27:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99959a700 1 -- 172.21.15.19:0/4104826336 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c0117b0 con 0x7fe99c15c620 2024-08-17T02:27:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.831+0000 7fe99959a700 1 -- 172.21.15.19:0/4104826336 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c011b70 con 0x7fe99c15c620 2024-08-17T02:27:08.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 -- 172.21.15.19:0/4104826336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15c620 msgr2=0x7fe99c0b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 --2- 172.21.15.19:0/4104826336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15c620 0x7fe99c0b0320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0b0930 tx=0x7fe98c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 -- 172.21.15.19:0/4104826336 shutdown_connections 2024-08-17T02:27:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 --2- 172.21.15.19:0/4104826336 >> v2:172.21.15.119:3300/0 conn(0x7fe99c0ad1b0 0x7fe99c0c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 --2- 172.21.15.19:0/4104826336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15c620 0x7fe99c0b0320 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 -- 172.21.15.19:0/4104826336 >> 172.21.15.19:0/4104826336 conn(0x7fe99c0ca900 msgr2=0x7fe99c0cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 -- 172.21.15.19:0/4104826336 shutdown_connections 2024-08-17T02:27:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 -- 172.21.15.19:0/4104826336 wait complete. 2024-08-17T02:27:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 Processor -- start 2024-08-17T02:27:08.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 -- start start 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe99c0ad1b0 0x7fe99c0c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe99c15c620 0x7fe99c169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15cd90 0x7fe99c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c16b5f0 con 0x7fe99c15cd90 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c16a400 con 0x7fe99c15c620 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.835+0000 7fe99b59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c16a9e0 con 0x7fe99c0ad1b0 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99ad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15cd90 0x7fe99c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99ad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15cd90 0x7fe99c0c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39460/0 (socket says 172.21.15.19:39460) 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99ad9d700 1 -- 172.21.15.19:0/168046107 learned_addr learned my addr 172.21.15.19:0/168046107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe999d9b700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe99c15c620 0x7fe99c169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99a59c700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe99c0ad1b0 0x7fe99c0c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99ad9d700 1 -- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe99c0ad1b0 msgr2=0x7fe99c0c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99ad9d700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe99c0ad1b0 0x7fe99c0c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99ad9d700 1 -- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe99c15c620 msgr2=0x7fe99c169ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99ad9d700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe99c15c620 0x7fe99c169ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99ad9d700 1 -- 172.21.15.19:0/168046107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c009420 con 0x7fe99c15cd90 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99a59c700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe99c0ad1b0 0x7fe99c0c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99ad9d700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15cd90 0x7fe99c0c6c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe994009d70 tx=0x7fe99400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe98a7fc700 1 -- 172.21.15.19:0/168046107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99400cb50 con 0x7fe99c15cd90 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe98a7fc700 1 -- 172.21.15.19:0/168046107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99400f040 con 0x7fe99c15cd90 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe98a7fc700 1 -- 172.21.15.19:0/168046107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994014480 con 0x7fe99c15cd90 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c16acc0 con 0x7fe99c15cd90 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c16b280 con 0x7fe99c15cd90 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.839+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c0643a0 con 0x7fe99c15cd90 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.843+0000 7fe98a7fc700 1 -- 172.21.15.19:0/168046107 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe994014830 con 0x7fe99c15cd90 2024-08-17T02:27:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.843+0000 7fe98a7fc700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe97c060860 0x7fe97c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.843+0000 7fe98a7fc700 1 -- 172.21.15.19:0/168046107 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe99407d510 con 0x7fe99c15cd90 2024-08-17T02:27:08.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.843+0000 7fe99a59c700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe97c060860 0x7fe97c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.843+0000 7fe99a59c700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe97c060860 0x7fe97c062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0b0930 tx=0x7fe98c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:08.851+0000 7fe98a7fc700 1 -- 172.21.15.19:0/168046107 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe99404dcb0 con 0x7fe99c15cd90 2024-08-17T02:27:09.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.079+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fe99c0681a0 con 0x7fe99c15cd90 2024-08-17T02:27:09.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.083+0000 7fe98a7fc700 1 -- 172.21.15.19:0/168046107 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe9940512d0 con 0x7fe99c15cd90 2024-08-17T02:27:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe97c060860 msgr2=0x7fe97c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe97c060860 0x7fe97c062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0b0930 tx=0x7fe98c017000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15cd90 msgr2=0x7fe99c0c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15cd90 0x7fe99c0c6c60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe994009d70 tx=0x7fe99400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 shutdown_connections 2024-08-17T02:27:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe97c060860 0x7fe97c062d10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe99c15cd90 0x7fe99c0c6c60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe99c15c620 0x7fe99c169ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 --2- 172.21.15.19:0/168046107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe99c0ad1b0 0x7fe99c0c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 >> 172.21.15.19:0/168046107 conn(0x7fe99c0ca900 msgr2=0x7fe99c0cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 shutdown_connections 2024-08-17T02:27:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.087+0000 7fe99b59e700 1 -- 172.21.15.19:0/168046107 wait complete. 2024-08-17T02:27:09.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:27:09.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.207+0000 7ffb6ffff700 1 Processor -- start 2024-08-17T02:27:09.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.207+0000 7ffb6ffff700 1 -- start start 2024-08-17T02:27:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.207+0000 7ffb6ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb700abe80 0x7ffb700ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.207+0000 7ffb6ffff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb70159700 0x7ffb700686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.207+0000 7ffb6ffff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7015ab20 con 0x7ffb70068be0 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.207+0000 7ffb6ffff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7015a8b0 con 0x7ffb700abe80 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.207+0000 7ffb6ffff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700ae4e0 con 0x7ffb70159700 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb700abe80 0x7ffb700ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb700abe80 0x7ffb700ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39474/0 (socket says 172.21.15.19:39474) 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6effd700 1 -- 172.21.15.19:0/4226382025 learned_addr learned my addr 172.21.15.19:0/4226382025 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6f7fe700 1 --1- 172.21.15.19:0/4226382025 >> v1:172.21.15.19:6789/0 conn(0x7ffb70068be0 0x7ffb700b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50592/0 (socket says 172.21.15.19:50592) 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6e7fc700 1 --2- 172.21.15.19:0/4226382025 >> v2:172.21.15.119:3300/0 conn(0x7ffb70159700 0x7ffb700686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6effd700 1 -- 172.21.15.19:0/4226382025 >> v2:172.21.15.119:3300/0 conn(0x7ffb70159700 msgr2=0x7ffb700686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6effd700 1 --2- 172.21.15.19:0/4226382025 >> v2:172.21.15.119:3300/0 conn(0x7ffb70159700 0x7ffb700686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6effd700 1 -- 172.21.15.19:0/4226382025 >> v1:172.21.15.19:6789/0 conn(0x7ffb70068be0 legacy=0x7ffb700b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6effd700 1 -- 172.21.15.19:0/4226382025 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70069030 con 0x7ffb700abe80 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6effd700 1 --2- 172.21.15.19:0/4226382025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb700abe80 0x7ffb700ae9e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb7006d670 tx=0x7ffb68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6aeb99777b7cf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6dffb700 1 -- 172.21.15.19:0/4226382025 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800e070 con 0x7ffb700abe80 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6dffb700 1 -- 172.21.15.19:0/4226382025 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800ba50 con 0x7ffb700abe80 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6dffb700 1 -- 172.21.15.19:0/4226382025 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680092e0 con 0x7ffb700abe80 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6ffff700 1 -- 172.21.15.19:0/4226382025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb700abe80 msgr2=0x7ffb700ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6ffff700 1 --2- 172.21.15.19:0/4226382025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb700abe80 0x7ffb700ae9e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffb7006d670 tx=0x7ffb68009840 comp rx=0 tx=0).stop 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6ffff700 1 -- 172.21.15.19:0/4226382025 shutdown_connections 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6ffff700 1 --2- 172.21.15.19:0/4226382025 >> v2:172.21.15.119:3300/0 conn(0x7ffb70159700 0x7ffb700686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6ffff700 1 --2- 172.21.15.19:0/4226382025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb700abe80 0x7ffb700ae9e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6ffff700 1 -- 172.21.15.19:0/4226382025 >> 172.21.15.19:0/4226382025 conn(0x7ffb7006d870 msgr2=0x7ffb7006dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6ffff700 1 -- 172.21.15.19:0/4226382025 shutdown_connections 2024-08-17T02:27:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.211+0000 7ffb6ffff700 1 -- 172.21.15.19:0/4226382025 wait complete. 2024-08-17T02:27:09.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 Processor -- start 2024-08-17T02:27:09.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 -- start start 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb70068be0 0x7ffb70152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb700abe80 0x7ffb701407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb70159700 0x7ffb70140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70141220 con 0x7ffb70068be0 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70155c00 con 0x7ffb70159700 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70154ff0 con 0x7ffb700abe80 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb70068be0 0x7ffb70152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb70068be0 0x7ffb70152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39480/0 (socket says 172.21.15.19:39480) 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6effd700 1 -- 172.21.15.19:0/1448648229 learned_addr learned my addr 172.21.15.19:0/1448648229 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6f7fe700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb70159700 0x7ffb70140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6e7fc700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb700abe80 0x7ffb701407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6effd700 1 -- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb700abe80 msgr2=0x7ffb701407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6effd700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb700abe80 0x7ffb701407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6effd700 1 -- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb70159700 msgr2=0x7ffb70140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6effd700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb70159700 0x7ffb70140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6effd700 1 -- 172.21.15.19:0/1448648229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009ae0 con 0x7ffb70068be0 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6effd700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb70068be0 0x7ffb70152280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb7006f0d0 tx=0x7ffb68018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb66ffd700 1 -- 172.21.15.19:0/1448648229 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68008a00 con 0x7ffb70068be0 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb66ffd700 1 -- 172.21.15.19:0/1448648229 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68008b60 con 0x7ffb70068be0 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb701552d0 con 0x7ffb70068be0 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb70155890 con 0x7ffb70068be0 2024-08-17T02:27:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.215+0000 7ffb66ffd700 1 -- 172.21.15.19:0/1448648229 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68026460 con 0x7ffb70068be0 2024-08-17T02:27:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.219+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb700638f0 con 0x7ffb70068be0 2024-08-17T02:27:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.219+0000 7ffb66ffd700 1 -- 172.21.15.19:0/1448648229 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffb68003040 con 0x7ffb70068be0 2024-08-17T02:27:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.219+0000 7ffb66ffd700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb50060890 0x7ffb50062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.219+0000 7ffb66ffd700 1 -- 172.21.15.19:0/1448648229 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffb6807e5f0 con 0x7ffb70068be0 2024-08-17T02:27:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.219+0000 7ffb6e7fc700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb50060890 0x7ffb50062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.219+0000 7ffb6e7fc700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb50060890 0x7ffb50062d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb7016cd10 tx=0x7ffb58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.227+0000 7ffb66ffd700 1 -- 172.21.15.19:0/1448648229 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ffb6804ecf0 con 0x7ffb70068be0 2024-08-17T02:27:09.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.459+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ffb700695b0 con 0x7ffb70068be0 2024-08-17T02:27:09.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.467+0000 7ffb66ffd700 1 -- 172.21.15.19:0/1448648229 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffb68052310 con 0x7ffb70068be0 2024-08-17T02:27:09.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.467+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb50060890 msgr2=0x7ffb50062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.467+0000 7ffb6ffff700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb50060890 0x7ffb50062d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb7016cd10 tx=0x7ffb58008040 comp rx=0 tx=0).stop 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.467+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb70068be0 msgr2=0x7ffb70152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.467+0000 7ffb6ffff700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb70068be0 0x7ffb70152280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffb7006f0d0 tx=0x7ffb68018000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.471+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 shutdown_connections 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.471+0000 7ffb6ffff700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ffb50060890 0x7ffb50062d40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.471+0000 7ffb6ffff700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb70159700 0x7ffb70140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.471+0000 7ffb6ffff700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb700abe80 0x7ffb701407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.471+0000 7ffb6ffff700 1 --2- 172.21.15.19:0/1448648229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb70068be0 0x7ffb70152280 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.471+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 >> 172.21.15.19:0/1448648229 conn(0x7ffb7006d870 msgr2=0x7ffb70068050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.471+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 shutdown_connections 2024-08-17T02:27:09.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.471+0000 7ffb6ffff700 1 -- 172.21.15.19:0/1448648229 wait complete. 2024-08-17T02:27:09.491 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:27:09.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49346f700 1 Processor -- start 2024-08-17T02:27:09.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49346f700 1 -- start start 2024-08-17T02:27:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49346f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc48c155ef0 0x7fc48c0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49346f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c0ad180 0x7fc48c0c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49346f700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0c9520 con 0x7fc48c068be0 2024-08-17T02:27:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49346f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c06e840 con 0x7fc48c155ef0 2024-08-17T02:27:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49346f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c069010 con 0x7fc48c0ad180 2024-08-17T02:27:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49120b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc48c155ef0 0x7fc48c0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49120b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc48c155ef0 0x7fc48c0686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39494/0 (socket says 172.21.15.19:39494) 2024-08-17T02:27:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49120b700 1 -- 172.21.15.19:0/3460689852 learned_addr learned my addr 172.21.15.19:0/3460689852 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc491a0c700 1 --2- 172.21.15.19:0/3460689852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c0ad180 0x7fc48c0c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49120b700 1 -- 172.21.15.19:0/3460689852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c0ad180 msgr2=0x7fc48c0c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.595+0000 7fc49120b700 1 --2- 172.21.15.19:0/3460689852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c0ad180 0x7fc48c0c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49120b700 1 -- 172.21.15.19:0/3460689852 >> v1:172.21.15.119:6789/0 conn(0x7fc48c068be0 legacy=0x7fc48c0aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49120b700 1 -- 172.21.15.19:0/3460689852 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0ad6e0 con 0x7fc48c155ef0 2024-08-17T02:27:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc491a0c700 1 --2- 172.21.15.19:0/3460689852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c0ad180 0x7fc48c0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:09.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49120b700 1 --2- 172.21.15.19:0/3460689852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c155ef0 0x7fc48c0686a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc4880099b0 tx=0x7fc488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833e976077907590 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc483fff700 1 -- 172.21.15.19:0/3460689852 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800b860 con 0x7fc48c155ef0 2024-08-17T02:27:09.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc483fff700 1 -- 172.21.15.19:0/3460689852 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48800b9c0 con 0x7fc48c155ef0 2024-08-17T02:27:09.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc483fff700 1 -- 172.21.15.19:0/3460689852 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800bd60 con 0x7fc48c155ef0 2024-08-17T02:27:09.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49346f700 1 -- 172.21.15.19:0/3460689852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c155ef0 msgr2=0x7fc48c0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49346f700 1 --2- 172.21.15.19:0/3460689852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c155ef0 0x7fc48c0686a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc4880099b0 tx=0x7fc488009250 comp rx=0 tx=0).stop 2024-08-17T02:27:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49346f700 1 -- 172.21.15.19:0/3460689852 shutdown_connections 2024-08-17T02:27:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49346f700 1 --2- 172.21.15.19:0/3460689852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c0ad180 0x7fc48c0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49346f700 1 --2- 172.21.15.19:0/3460689852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c155ef0 0x7fc48c0686a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49346f700 1 -- 172.21.15.19:0/3460689852 >> 172.21.15.19:0/3460689852 conn(0x7fc48c0cd160 msgr2=0x7fc48c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49346f700 1 -- 172.21.15.19:0/3460689852 shutdown_connections 2024-08-17T02:27:09.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.599+0000 7fc49346f700 1 -- 172.21.15.19:0/3460689852 wait complete. 2024-08-17T02:27:09.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 Processor -- start 2024-08-17T02:27:09.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 -- start start 2024-08-17T02:27:09.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c068be0 0x7fc48c0a8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc48c0ad180 0x7fc48c0a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c155ef0 0x7fc48c0a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0a8190 con 0x7fc48c068be0 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0a7580 con 0x7fc48c0ad180 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0a7860 con 0x7fc48c155ef0 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49120b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c068be0 0x7fc48c0a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49120b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c068be0 0x7fc48c0a8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39496/0 (socket says 172.21.15.19:39496) 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49120b700 1 -- 172.21.15.19:0/2799163381 learned_addr learned my addr 172.21.15.19:0/2799163381 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc491a0c700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c155ef0 0x7fc48c0a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc490a0a700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc48c0ad180 0x7fc48c0a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49120b700 1 -- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c155ef0 msgr2=0x7fc48c0a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49120b700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c155ef0 0x7fc48c0a6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49120b700 1 -- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc48c0ad180 msgr2=0x7fc48c0a9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49120b700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc48c0ad180 0x7fc48c0a9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49120b700 1 -- 172.21.15.19:0/2799163381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4880094f0 con 0x7fc48c068be0 2024-08-17T02:27:09.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49120b700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c068be0 0x7fc48c0a8620 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc488009290 tx=0x7fc488019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc4817fa700 1 -- 172.21.15.19:0/2799163381 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48801ad80 con 0x7fc48c068be0 2024-08-17T02:27:09.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc4817fa700 1 -- 172.21.15.19:0/2799163381 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc488010470 con 0x7fc48c068be0 2024-08-17T02:27:09.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc4817fa700 1 -- 172.21.15.19:0/2799163381 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488010830 con 0x7fc48c068be0 2024-08-17T02:27:09.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c0a7b40 con 0x7fc48c068be0 2024-08-17T02:27:09.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.603+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c0a9ef0 con 0x7fc48c068be0 2024-08-17T02:27:09.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.607+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c0645c0 con 0x7fc48c068be0 2024-08-17T02:27:09.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.607+0000 7fc4817fa700 1 -- 172.21.15.19:0/2799163381 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc488022070 con 0x7fc48c068be0 2024-08-17T02:27:09.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.607+0000 7fc4817fa700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc470060860 0x7fc470062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.607+0000 7fc4817fa700 1 -- 172.21.15.19:0/2799163381 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc488014070 con 0x7fc48c068be0 2024-08-17T02:27:09.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.607+0000 7fc490a0a700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc470060860 0x7fc470062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.607+0000 7fc490a0a700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc470060860 0x7fc470062d10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0b1b90 tx=0x7fc47c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.615+0000 7fc4817fa700 1 -- 172.21.15.19:0/2799163381 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc4880500f0 con 0x7fc48c068be0 2024-08-17T02:27:09.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.835+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc48c0c8870 con 0x7fc48c068be0 2024-08-17T02:27:09.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.843+0000 7fc4817fa700 1 -- 172.21.15.19:0/2799163381 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc4880290a0 con 0x7fc48c068be0 2024-08-17T02:27:09.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc470060860 msgr2=0x7fc470062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc470060860 0x7fc470062d10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0b1b90 tx=0x7fc47c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:09.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c068be0 msgr2=0x7fc48c0a8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c068be0 0x7fc48c0a8620 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc488009290 tx=0x7fc488019000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 shutdown_connections 2024-08-17T02:27:09.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fc470060860 0x7fc470062d10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc48c155ef0 0x7fc48c0a6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc48c0ad180 0x7fc48c0a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 --2- 172.21.15.19:0/2799163381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc48c068be0 0x7fc48c0a8620 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 >> 172.21.15.19:0/2799163381 conn(0x7fc48c0cd160 msgr2=0x7fc48c0b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 shutdown_connections 2024-08-17T02:27:09.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.847+0000 7fc49346f700 1 -- 172.21.15.19:0/2799163381 wait complete. 2024-08-17T02:27:09.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:09.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 Processor -- start 2024-08-17T02:27:09.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 -- start start 2024-08-17T02:27:09.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc15d540 0x7f23bc0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f23bc06e830 0x7f23bc0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc0b0270 con 0x7f23bc0a9260 2024-08-17T02:27:09.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0af660 con 0x7f23bc06e830 2024-08-17T02:27:09.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc0af940 con 0x7f23bc15d540 2024-08-17T02:27:09.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b9d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f23bc06e830 0x7f23bc0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23bad9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f23bc0a9260 0x7f23bc0b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50602/0 (socket says 172.21.15.19:50602) 2024-08-17T02:27:09.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23bad9d700 1 -- 172.21.15.19:0/2205790366 learned_addr learned my addr 172.21.15.19:0/2205790366 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:09.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23ba59c700 1 --2- 172.21.15.19:0/2205790366 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc15d540 0x7f23bc0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b9d9b700 1 -- 172.21.15.19:0/2205790366 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc15d540 msgr2=0x7f23bc0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b9d9b700 1 --2- 172.21.15.19:0/2205790366 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc15d540 0x7f23bc0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b9d9b700 1 -- 172.21.15.19:0/2205790366 >> v1:172.21.15.19:6789/0 conn(0x7f23bc0a9260 legacy=0x7f23bc0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b9d9b700 1 -- 172.21.15.19:0/2205790366 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0afc20 con 0x7f23bc06e830 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b959a700 1 -- 172.21.15.19:0/2205790366 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632439402 0 0) 0x7f23bc0b0270 con 0x7f23bc0a9260 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b9d9b700 1 --2- 172.21.15.19:0/2205790366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 0x7f23bc0a8d20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009e60 tx=0x7f23b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700c777244bbd9c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b959a700 1 -- 172.21.15.19:0/2205790366 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b400e070 con 0x7f23bc06e830 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b959a700 1 -- 172.21.15.19:0/2205790366 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b400bb60 con 0x7f23bc06e830 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23b959a700 1 -- 172.21.15.19:0/2205790366 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b4012430 con 0x7f23bc06e830 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 -- 172.21.15.19:0/2205790366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 msgr2=0x7f23bc0a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 --2- 172.21.15.19:0/2205790366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 0x7f23bc0a8d20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009e60 tx=0x7f23b4009780 comp rx=0 tx=0).stop 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 -- 172.21.15.19:0/2205790366 shutdown_connections 2024-08-17T02:27:09.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 --2- 172.21.15.19:0/2205790366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 0x7f23bc0a8d20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 --2- 172.21.15.19:0/2205790366 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc15d540 0x7f23bc0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 -- 172.21.15.19:0/2205790366 >> 172.21.15.19:0/2205790366 conn(0x7f23bc066e00 msgr2=0x7f23bc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 -- 172.21.15.19:0/2205790366 shutdown_connections 2024-08-17T02:27:09.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.975+0000 7f23c0aa3700 1 -- 172.21.15.19:0/2205790366 wait complete. 2024-08-17T02:27:09.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 Processor -- start 2024-08-17T02:27:09.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 -- start start 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 0x7f23bc157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc0a9260 0x7f23bc14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23bc15d540 0x7f23bc170f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc1577b0 con 0x7f23bc06e830 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc099720 con 0x7f23bc15d540 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc0973a0 con 0x7f23bc0a9260 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23ba59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 0x7f23bc157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23ba59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 0x7f23bc157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39514/0 (socket says 172.21.15.19:39514) 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23ba59c700 1 -- 172.21.15.19:0/1851239221 learned_addr learned my addr 172.21.15.19:0/1851239221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23b9d9b700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc0a9260 0x7f23bc14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23bad9d700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23bc15d540 0x7f23bc170f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23ba59c700 1 -- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc0a9260 msgr2=0x7f23bc14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23ba59c700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc0a9260 0x7f23bc14c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23ba59c700 1 -- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23bc15d540 msgr2=0x7f23bc170f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23ba59c700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23bc15d540 0x7f23bc170f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23ba59c700 1 -- 172.21.15.19:0/1851239221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b4009a20 con 0x7f23bc06e830 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23bad9d700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23bc15d540 0x7f23bc170f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23ba59c700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 0x7f23bc157050 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f23a400e930 tx=0x7f23a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23b27fc700 1 -- 172.21.15.19:0/1851239221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4013680 con 0x7f23bc06e830 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc0970c0 con 0x7f23bc06e830 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23b27fc700 1 -- 172.21.15.19:0/1851239221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a40137e0 con 0x7f23bc06e830 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23b27fc700 1 -- 172.21.15.19:0/1851239221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4013b80 con 0x7f23bc06e830 2024-08-17T02:27:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.979+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc0cab00 con 0x7f23bc06e830 2024-08-17T02:27:09.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.983+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc0645c0 con 0x7f23bc06e830 2024-08-17T02:27:09.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.983+0000 7f23b27fc700 1 -- 172.21.15.19:0/1851239221 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f23a400c460 con 0x7f23bc06e830 2024-08-17T02:27:09.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.983+0000 7f23b27fc700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f239c060860 0x7f239c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.983+0000 7f23b27fc700 1 -- 172.21.15.19:0/1851239221 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f23a407ca30 con 0x7f23bc06e830 2024-08-17T02:27:09.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.983+0000 7f23b9d9b700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f239c060860 0x7f239c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.983+0000 7f23b9d9b700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f239c060860 0x7f239c062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097c0 tx=0x7f23b4019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:09.991+0000 7f23b27fc700 1 -- 172.21.15.19:0/1851239221 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f23a404d1d0 con 0x7f23bc06e830 2024-08-17T02:27:10.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.151+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23bc06f360 con 0x7f23bc06e830 2024-08-17T02:27:10.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23b27fc700 1 -- 172.21.15.19:0/1851239221 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f23a4054e60 con 0x7f23bc06e830 2024-08-17T02:27:10.160 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:10.160 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":29,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:27:07.199127+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:10.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f239c060860 msgr2=0x7f239c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f239c060860 0x7f239c062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23b40097c0 tx=0x7f23b4019000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 msgr2=0x7f23bc157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 0x7f23bc157050 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f23a400e930 tx=0x7f23a40091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 shutdown_connections 2024-08-17T02:27:10.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f239c060860 0x7f239c062d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23bc15d540 0x7f23bc170f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23bc0a9260 0x7f23bc14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 --2- 172.21.15.19:0/1851239221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23bc06e830 0x7f23bc157050 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.155+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 >> 172.21.15.19:0/1851239221 conn(0x7f23bc066e00 msgr2=0x7f23bc160d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.159+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 shutdown_connections 2024-08-17T02:27:10.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.159+0000 7f23c0aa3700 1 -- 172.21.15.19:0/1851239221 wait complete. 2024-08-17T02:27:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:27:10.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:10.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.279+0000 7f38511af700 1 Processor -- start 2024-08-17T02:27:10.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.279+0000 7f38511af700 1 -- start start 2024-08-17T02:27:10.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.279+0000 7f38511af700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.279+0000 7f38511af700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f384c0686a0 0x7f384c068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.279+0000 7f38511af700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c0b23d0 con 0x7f384c0ae2d0 2024-08-17T02:27:10.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c0cc020 con 0x7f384c0686a0 2024-08-17T02:27:10.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0b1850 con 0x7f384c156cf0 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38509ae700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f384c0ae2d0 0x7f384c0ae720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50612/0 (socket says 172.21.15.19:50612) 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38509ae700 1 -- 172.21.15.19:0/757452640 learned_addr learned my addr 172.21.15.19:0/757452640 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38437fe700 1 --2- 172.21.15.19:0/757452640 >> v2:172.21.15.19:3300/0 conn(0x7f384c0686a0 0x7f384c068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f384bfff700 1 --2- 172.21.15.19:0/757452640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f384b7fe700 1 -- 172.21.15.19:0/757452640 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408933704 0 0) 0x7f384c0b23d0 con 0x7f384c0ae2d0 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f384b7fe700 1 -- 172.21.15.19:0/757452640 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3838003570 con 0x7f384c0ae2d0 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38437fe700 1 -- 172.21.15.19:0/757452640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 msgr2=0x7f384c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38437fe700 1 --2- 172.21.15.19:0/757452640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c1570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38437fe700 1 -- 172.21.15.19:0/757452640 >> v1:172.21.15.19:6789/0 conn(0x7f384c0ae2d0 legacy=0x7f384c0ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38437fe700 1 -- 172.21.15.19:0/757452640 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c069030 con 0x7f384c0686a0 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f384bfff700 1 --2- 172.21.15.19:0/757452640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:10.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38437fe700 1 --2- 172.21.15.19:0/757452640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 0x7f384c068af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f38340098e0 tx=0x7f38340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ac267b6f76b952 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f384b7fe700 1 -- 172.21.15.19:0/757452640 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834011630 con 0x7f384c0686a0 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f384b7fe700 1 -- 172.21.15.19:0/757452640 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834011790 con 0x7f384c0686a0 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f384b7fe700 1 -- 172.21.15.19:0/757452640 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834011b30 con 0x7f384c0686a0 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 -- 172.21.15.19:0/757452640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 msgr2=0x7f384c068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 --2- 172.21.15.19:0/757452640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 0x7f384c068af0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f38340098e0 tx=0x7f38340091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 -- 172.21.15.19:0/757452640 shutdown_connections 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 --2- 172.21.15.19:0/757452640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 0x7f384c068af0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 --2- 172.21.15.19:0/757452640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 -- 172.21.15.19:0/757452640 >> 172.21.15.19:0/757452640 conn(0x7f384c06e350 msgr2=0x7f384c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 -- 172.21.15.19:0/757452640 shutdown_connections 2024-08-17T02:27:10.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.283+0000 7f38511af700 1 -- 172.21.15.19:0/757452640 wait complete. 2024-08-17T02:27:10.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38511af700 1 Processor -- start 2024-08-17T02:27:10.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38511af700 1 -- start start 2024-08-17T02:27:10.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38511af700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 0x7f384c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38511af700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c0ae2d0 0x7f384c150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38511af700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38511af700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c155e90 con 0x7f384c0686a0 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38511af700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c155bb0 con 0x7f384c0ae2d0 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38511af700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c15cf50 con 0x7f384c156cf0 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f384bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 0x7f384c1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f384bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 0x7f384c1500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39534/0 (socket says 172.21.15.19:39534) 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f384bfff700 1 -- 172.21.15.19:0/1759901855 learned_addr learned my addr 172.21.15.19:0/1759901855 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38437fe700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c0ae2d0 0x7f384c150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f38509ae700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f384bfff700 1 -- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 msgr2=0x7f384c15aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f384bfff700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c15aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f384bfff700 1 -- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c0ae2d0 msgr2=0x7f384c150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f384bfff700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c0ae2d0 0x7f384c150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.287+0000 7f384bfff700 1 -- 172.21.15.19:0/1759901855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c009420 con 0x7f384c0686a0 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f38509ae700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c15aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f384bfff700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 0x7f384c1500b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f383c00ec80 tx=0x7f383c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f3848ff9700 1 -- 172.21.15.19:0/1759901855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00c8f0 con 0x7f384c0686a0 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f3848ff9700 1 -- 172.21.15.19:0/1759901855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00ca50 con 0x7f384c0686a0 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3834009420 con 0x7f384c0686a0 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f3848ff9700 1 -- 172.21.15.19:0/1759901855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00cdd0 con 0x7f384c0686a0 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c1505f0 con 0x7f384c0686a0 2024-08-17T02:27:10.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c0638f0 con 0x7f384c0686a0 2024-08-17T02:27:10.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f3848ff9700 1 -- 172.21.15.19:0/1759901855 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f383c013680 con 0x7f384c0686a0 2024-08-17T02:27:10.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f3848ff9700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f382c060860 0x7f382c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f3848ff9700 1 -- 172.21.15.19:0/1759901855 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f383c07cc60 con 0x7f384c0686a0 2024-08-17T02:27:10.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.291+0000 7f38437fe700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f382c060860 0x7f382c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.295+0000 7f38437fe700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f382c060860 0x7f382c062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38340091e0 tx=0x7f3834017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.303+0000 7f3848ff9700 1 -- 172.21.15.19:0/1759901855 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f383c04d400 con 0x7f384c0686a0 2024-08-17T02:27:10.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.467+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f384c066f40 con 0x7f384c0686a0 2024-08-17T02:27:10.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.467+0000 7f3848ff9700 1 -- 172.21.15.19:0/1759901855 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f383c0170a0 con 0x7f384c0686a0 2024-08-17T02:27:10.473 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:27:10.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f382c060860 msgr2=0x7f382c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f382c060860 0x7f382c062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38340091e0 tx=0x7f3834017000 comp rx=0 tx=0).stop 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 msgr2=0x7f384c1500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 0x7f384c1500b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f383c00ec80 tx=0x7f383c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 shutdown_connections 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f382c060860 0x7f382c062d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f384c156cf0 0x7f384c15aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f384c0ae2d0 0x7f384c150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 --2- 172.21.15.19:0/1759901855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f384c0686a0 0x7f384c1500b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 >> 172.21.15.19:0/1759901855 conn(0x7f384c06e350 msgr2=0x7f384c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 shutdown_connections 2024-08-17T02:27:10.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.471+0000 7f38511af700 1 -- 172.21.15.19:0/1759901855 wait complete. 2024-08-17T02:27:10.488 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:27:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44fc22700 1 Processor -- start 2024-08-17T02:27:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44fc22700 1 -- start start 2024-08-17T02:27:10.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44fc22700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa448068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44fc22700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44806af40 con 0x7fa448155570 2024-08-17T02:27:10.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44fc22700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44806b7e0 con 0x7fa448069c50 2024-08-17T02:27:10.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44fc22700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44806a7a0 con 0x7fa4480686a0 2024-08-17T02:27:10.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44d9be700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa448155570 0x7fa44806bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50628/0 (socket says 172.21.15.19:50628) 2024-08-17T02:27:10.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44d9be700 1 -- 172.21.15.19:0/4092082163 learned_addr learned my addr 172.21.15.19:0/4092082163 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:10.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44d1bd700 1 --2- 172.21.15.19:0/4092082163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa448068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44c9bc700 1 -- 172.21.15.19:0/4092082163 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888712403 0 0) 0x7fa44806af40 con 0x7fa448155570 2024-08-17T02:27:10.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44c9bc700 1 -- 172.21.15.19:0/4092082163 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa434003570 con 0x7fa448155570 2024-08-17T02:27:10.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44c9bc700 1 -- 172.21.15.19:0/4092082163 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437038208 0 0) 0x7fa44806b7e0 con 0x7fa448069c50 2024-08-17T02:27:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44c9bc700 1 -- 172.21.15.19:0/4092082163 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa44806af40 con 0x7fa448069c50 2024-08-17T02:27:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44d1bd700 1 -- 172.21.15.19:0/4092082163 >> v1:172.21.15.119:6789/0 conn(0x7fa448069c50 legacy=0x7fa44806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44d1bd700 1 -- 172.21.15.19:0/4092082163 >> v1:172.21.15.19:6789/0 conn(0x7fa448155570 legacy=0x7fa44806bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44d1bd700 1 -- 172.21.15.19:0/4092082163 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448069030 con 0x7fa4480686a0 2024-08-17T02:27:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.587+0000 7fa44d1bd700 1 --2- 172.21.15.19:0/4092082163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa448068af0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa430009910 tx=0x7fa4300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af60d959c13a6174 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44c9bc700 1 -- 172.21.15.19:0/4092082163 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430011630 con 0x7fa4480686a0 2024-08-17T02:27:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44c9bc700 1 -- 172.21.15.19:0/4092082163 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430011790 con 0x7fa4480686a0 2024-08-17T02:27:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44c9bc700 1 -- 172.21.15.19:0/4092082163 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430011b30 con 0x7fa4480686a0 2024-08-17T02:27:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44fc22700 1 -- 172.21.15.19:0/4092082163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 msgr2=0x7fa448068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44fc22700 1 --2- 172.21.15.19:0/4092082163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa448068af0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa430009910 tx=0x7fa4300091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44fc22700 1 -- 172.21.15.19:0/4092082163 shutdown_connections 2024-08-17T02:27:10.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44fc22700 1 --2- 172.21.15.19:0/4092082163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa448068af0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44fc22700 1 -- 172.21.15.19:0/4092082163 >> 172.21.15.19:0/4092082163 conn(0x7fa44806db30 msgr2=0x7fa44806df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44fc22700 1 -- 172.21.15.19:0/4092082163 shutdown_connections 2024-08-17T02:27:10.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44fc22700 1 -- 172.21.15.19:0/4092082163 wait complete. 2024-08-17T02:27:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44fc22700 1 Processor -- start 2024-08-17T02:27:10.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.591+0000 7fa44fc22700 1 -- start start 2024-08-17T02:27:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44fc22700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa4481452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44fc22700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa448069c50 0x7fa4480ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44fc22700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa448155570 0x7fa4480cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44fc22700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480a9b40 con 0x7fa448155570 2024-08-17T02:27:10.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44fc22700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480cb290 con 0x7fa448069c50 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44fc22700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480cb570 con 0x7fa4480686a0 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44e1bf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa448155570 0x7fa4480cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44e1bf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa448155570 0x7fa4480cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39548/0 (socket says 172.21.15.19:39548) 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44e1bf700 1 -- 172.21.15.19:0/1907145115 learned_addr learned my addr 172.21.15.19:0/1907145115 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44d1bd700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa448069c50 0x7fa4480ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44d9be700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa4481452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44e1bf700 1 -- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 msgr2=0x7fa4481452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44e1bf700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa4481452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44e1bf700 1 -- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa448069c50 msgr2=0x7fa4480ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44e1bf700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa448069c50 0x7fa4480ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44e1bf700 1 -- 172.21.15.19:0/1907145115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430009420 con 0x7fa448155570 2024-08-17T02:27:10.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44d9be700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa4481452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44e1bf700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa448155570 0x7fa4480cac60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa43800c590 tx=0x7fa438007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa445ffb700 1 -- 172.21.15.19:0/1907145115 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438016070 con 0x7fa448155570 2024-08-17T02:27:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4480cb850 con 0x7fa448155570 2024-08-17T02:27:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa445ffb700 1 -- 172.21.15.19:0/1907145115 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa438011660 con 0x7fa448155570 2024-08-17T02:27:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa445ffb700 1 -- 172.21.15.19:0/1907145115 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438011a40 con 0x7fa448155570 2024-08-17T02:27:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4480aaa60 con 0x7fa448155570 2024-08-17T02:27:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4480645c0 con 0x7fa448155570 2024-08-17T02:27:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa445ffb700 1 -- 172.21.15.19:0/1907145115 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa438012420 con 0x7fa448155570 2024-08-17T02:27:10.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.595+0000 7fa445ffb700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa428060860 0x7fa428062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.599+0000 7fa445ffb700 1 -- 172.21.15.19:0/1907145115 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa43807c610 con 0x7fa448155570 2024-08-17T02:27:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.599+0000 7fa44d9be700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa428060860 0x7fa428062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.599+0000 7fa44d9be700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa428060860 0x7fa428062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa440005c50 tx=0x7fa440009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.603+0000 7fa445ffb700 1 -- 172.21.15.19:0/1907145115 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa43804cdb0 con 0x7fa448155570 2024-08-17T02:27:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa44806a340 con 0x7fa448155570 2024-08-17T02:27:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa445ffb700 1 -- 172.21.15.19:0/1907145115 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa4380503d0 con 0x7fa448155570 2024-08-17T02:27:10.776 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:10.776 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-08-17T02:27:10.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:10.776 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-08-17T02:27:10.776 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-08-17T02:27:10.776 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:10.776 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa428060860 msgr2=0x7fa428062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa44fc22700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa428060860 0x7fa428062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa440005c50 tx=0x7fa440009040 comp rx=0 tx=0).stop 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa448155570 msgr2=0x7fa4480cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa44fc22700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa448155570 0x7fa4480cac60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa43800c590 tx=0x7fa438007d80 comp rx=0 tx=0).stop 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 shutdown_connections 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa44fc22700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa428060860 0x7fa428062d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa44fc22700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa448155570 0x7fa4480cac60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.771+0000 7fa44fc22700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa448069c50 0x7fa4480ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.775+0000 7fa44fc22700 1 --2- 172.21.15.19:0/1907145115 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4480686a0 0x7fa4481452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.775+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 >> 172.21.15.19:0/1907145115 conn(0x7fa44806db30 msgr2=0x7fa448151be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.775+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 shutdown_connections 2024-08-17T02:27:10.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.775+0000 7fa44fc22700 1 -- 172.21.15.19:0/1907145115 wait complete. 2024-08-17T02:27:10.791 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:27:10.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:27:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.895+0000 7fa743524700 1 Processor -- start 2024-08-17T02:27:10.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.895+0000 7fa743524700 1 -- start start 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 0x7fa73c0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa73c159dc0 0x7fa73c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c158640 con 0x7fa73c0cb880 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c157780 con 0x7fa73c159dc0 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0aeb30 con 0x7fa73c0cbc50 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa742d23700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa73c159dc0 0x7fa73c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa742522700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa73c0cb880 0x7fa73c0ae020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50638/0 (socket says 172.21.15.19:50638) 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa742522700 1 -- 172.21.15.19:0/917332391 learned_addr learned my addr 172.21.15.19:0/917332391 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa742d23700 1 --2- 172.21.15.19:0/917332391 >> v2:172.21.15.19:3300/0 conn(0x7fa73c159dc0 0x7fa73c0b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39562/0 (socket says 172.21.15.19:39562) 2024-08-17T02:27:10.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa741d21700 1 --2- 172.21.15.19:0/917332391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 0x7fa73c0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa742d23700 1 -- 172.21.15.19:0/917332391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 msgr2=0x7fa73c0b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:10.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa742d23700 1 --2- 172.21.15.19:0/917332391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 0x7fa73c0b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa741520700 1 -- 172.21.15.19:0/917332391 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188227089 0 0) 0x7fa73c158640 con 0x7fa73c0cb880 2024-08-17T02:27:10.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa742d23700 1 -- 172.21.15.19:0/917332391 >> v1:172.21.15.19:6789/0 conn(0x7fa73c0cb880 legacy=0x7fa73c0ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa742d23700 1 -- 172.21.15.19:0/917332391 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0aee10 con 0x7fa73c159dc0 2024-08-17T02:27:10.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa742d23700 1 --2- 172.21.15.19:0/917332391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c159dc0 0x7fa73c0b24f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa734009e60 tx=0x7fa734009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c409b8c6a4605674 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa741520700 1 -- 172.21.15.19:0/917332391 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400e070 con 0x7fa73c159dc0 2024-08-17T02:27:10.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa741520700 1 -- 172.21.15.19:0/917332391 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400bb60 con 0x7fa73c159dc0 2024-08-17T02:27:10.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa741520700 1 -- 172.21.15.19:0/917332391 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734012430 con 0x7fa73c159dc0 2024-08-17T02:27:10.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 -- 172.21.15.19:0/917332391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c159dc0 msgr2=0x7fa73c0b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 --2- 172.21.15.19:0/917332391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c159dc0 0x7fa73c0b24f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa734009e60 tx=0x7fa734009780 comp rx=0 tx=0).stop 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 -- 172.21.15.19:0/917332391 shutdown_connections 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 --2- 172.21.15.19:0/917332391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c159dc0 0x7fa73c0b24f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 --2- 172.21.15.19:0/917332391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 0x7fa73c0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 -- 172.21.15.19:0/917332391 >> 172.21.15.19:0/917332391 conn(0x7fa73c0a9d30 msgr2=0x7fa73c0ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.899+0000 7fa743524700 1 -- 172.21.15.19:0/917332391 shutdown_connections 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa743524700 1 -- 172.21.15.19:0/917332391 wait complete. 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa743524700 1 Processor -- start 2024-08-17T02:27:10.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa743524700 1 -- start start 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa743524700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c0cb880 0x7fa73c1448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa743524700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 0x7fa73c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa743524700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c159dc0 0x7fa73c06bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa743524700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c14ef90 con 0x7fa73c0cb880 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa743524700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c14e380 con 0x7fa73c159dc0 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa743524700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c14e660 con 0x7fa73c0cbc50 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa742522700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c0cb880 0x7fa73c1448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa742522700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c0cb880 0x7fa73c1448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39574/0 (socket says 172.21.15.19:39574) 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa742d23700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c159dc0 0x7fa73c06bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa741d21700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 0x7fa73c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.903+0000 7fa742522700 1 -- 172.21.15.19:0/131098082 learned_addr learned my addr 172.21.15.19:0/131098082 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:10.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa742522700 1 -- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 msgr2=0x7fa73c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa742522700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 0x7fa73c06b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa742522700 1 -- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c159dc0 msgr2=0x7fa73c06bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa742522700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c159dc0 0x7fa73c06bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa742522700 1 -- 172.21.15.19:0/131098082 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009a20 con 0x7fa73c0cb880 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa742d23700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c159dc0 0x7fa73c06bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa742522700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c0cb880 0x7fa73c1448a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa73800c7e0 tx=0x7fa738007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa7327fc700 1 -- 172.21.15.19:0/131098082 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738005b30 con 0x7fa73c0cb880 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa7327fc700 1 -- 172.21.15.19:0/131098082 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa738005c90 con 0x7fa73c0cb880 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c14e940 con 0x7fa73c0cb880 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa7327fc700 1 -- 172.21.15.19:0/131098082 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738007300 con 0x7fa73c0cb880 2024-08-17T02:27:10.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c144de0 con 0x7fa73c0cb880 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c0644b0 con 0x7fa73c0cb880 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.907+0000 7fa7327fc700 1 -- 172.21.15.19:0/131098082 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa73801b3b0 con 0x7fa73c0cb880 2024-08-17T02:27:10.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.911+0000 7fa7327fc700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa720060860 0x7fa720062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.911+0000 7fa7327fc700 1 -- 172.21.15.19:0/131098082 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa73807bdf0 con 0x7fa73c0cb880 2024-08-17T02:27:10.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.911+0000 7fa741d21700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa720060860 0x7fa720062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.911+0000 7fa741d21700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa720060860 0x7fa720062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa73c157250 tx=0x7fa72c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:10.919+0000 7fa7327fc700 1 -- 172.21.15.19:0/131098082 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa73804c4f0 con 0x7fa73c0cb880 2024-08-17T02:27:11.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.079+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa73c169500 con 0x7fa73c0cb880 2024-08-17T02:27:11.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.199+0000 7fa7327fc700 1 -- 172.21.15.19:0/131098082 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa7380170b0 con 0x7fa73c0cb880 2024-08-17T02:27:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa720060860 msgr2=0x7fa720062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa720060860 0x7fa720062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa73c157250 tx=0x7fa72c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c0cb880 msgr2=0x7fa73c1448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c0cb880 0x7fa73c1448a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa73800c7e0 tx=0x7fa738007df0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 shutdown_connections 2024-08-17T02:27:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa720060860 0x7fa720062d10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c159dc0 0x7fa73c06bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa73c0cbc50 0x7fa73c06b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 --2- 172.21.15.19:0/131098082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c0cb880 0x7fa73c1448a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 >> 172.21.15.19:0/131098082 conn(0x7fa73c0a9d30 msgr2=0x7fa73c0970b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 shutdown_connections 2024-08-17T02:27:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.203+0000 7fa743524700 1 -- 172.21.15.19:0/131098082 wait complete. 2024-08-17T02:27:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-08-17T02:27:11.225 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:27:11.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.335+0000 7f5761c36700 1 Processor -- start 2024-08-17T02:27:11.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.335+0000 7f5761c36700 1 -- start start 2024-08-17T02:27:11.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.335+0000 7f5761c36700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c066e00 0x7f575c0671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.335+0000 7f5761c36700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f575c0b2720 0x7f575c0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f575c0cbbf0 con 0x7f575c0cc080 2024-08-17T02:27:11.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f575c067710 con 0x7f575c0b2720 2024-08-17T02:27:11.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0cd440 con 0x7f575c066e00 2024-08-17T02:27:11.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f575bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f575c0cc080 0x7f575c0b2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50654/0 (socket says 172.21.15.19:50654) 2024-08-17T02:27:11.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f575bfff700 1 -- 172.21.15.19:0/635605826 learned_addr learned my addr 172.21.15.19:0/635605826 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:11.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761435700 1 --2- 172.21.15.19:0/635605826 >> v2:172.21.15.119:3300/0 conn(0x7f575c0b2720 0x7f575c0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5760c34700 1 --2- 172.21.15.19:0/635605826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c066e00 0x7f575c0671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f575b7fe700 1 -- 172.21.15.19:0/635605826 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202769554 0 0) 0x7f575c0cbbf0 con 0x7f575c0cc080 2024-08-17T02:27:11.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f575b7fe700 1 -- 172.21.15.19:0/635605826 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5744003570 con 0x7f575c0cc080 2024-08-17T02:27:11.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761435700 1 -- 172.21.15.19:0/635605826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c066e00 msgr2=0x7f575c0671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:11.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761435700 1 --2- 172.21.15.19:0/635605826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c066e00 0x7f575c0671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761435700 1 -- 172.21.15.19:0/635605826 >> v1:172.21.15.19:6789/0 conn(0x7f575c0cc080 legacy=0x7f575c0b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761435700 1 -- 172.21.15.19:0/635605826 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c0cafe0 con 0x7f575c0b2720 2024-08-17T02:27:11.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761435700 1 --2- 172.21.15.19:0/635605826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f575c0b2720 0x7f575c0b2ea0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5754009e60 tx=0x7f5754009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d56aeda0e8857ef1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f575b7fe700 1 -- 172.21.15.19:0/635605826 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400e070 con 0x7f575c0b2720 2024-08-17T02:27:11.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f575b7fe700 1 -- 172.21.15.19:0/635605826 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575400bab0 con 0x7f575c0b2720 2024-08-17T02:27:11.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f575b7fe700 1 -- 172.21.15.19:0/635605826 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400be30 con 0x7f575c0b2720 2024-08-17T02:27:11.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 -- 172.21.15.19:0/635605826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f575c0b2720 msgr2=0x7f575c0b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 --2- 172.21.15.19:0/635605826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f575c0b2720 0x7f575c0b2ea0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5754009e60 tx=0x7f5754009780 comp rx=0 tx=0).stop 2024-08-17T02:27:11.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 -- 172.21.15.19:0/635605826 shutdown_connections 2024-08-17T02:27:11.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 --2- 172.21.15.19:0/635605826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f575c0b2720 0x7f575c0b2ea0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 --2- 172.21.15.19:0/635605826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c066e00 0x7f575c0671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 -- 172.21.15.19:0/635605826 >> 172.21.15.19:0/635605826 conn(0x7f575c0682c0 msgr2=0x7f575c0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:11.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 -- 172.21.15.19:0/635605826 shutdown_connections 2024-08-17T02:27:11.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.339+0000 7f5761c36700 1 -- 172.21.15.19:0/635605826 wait complete. 2024-08-17T02:27:11.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.343+0000 7f5761c36700 1 Processor -- start 2024-08-17T02:27:11.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.343+0000 7f5761c36700 1 -- start start 2024-08-17T02:27:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761c36700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f575c066e00 0x7f575c14f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761c36700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f575c0b2720 0x7f575c0a7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761c36700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c0cc080 0x7f575c0ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761c36700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0a7d20 con 0x7f575c066e00 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761c36700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0a8000 con 0x7f575c0b2720 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761c36700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575c0a82e0 con 0x7f575c0cc080 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5760c34700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f575c066e00 0x7f575c14f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5760c34700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f575c066e00 0x7f575c14f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39586/0 (socket says 172.21.15.19:39586) 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5760c34700 1 -- 172.21.15.19:0/2009111501 learned_addr learned my addr 172.21.15.19:0/2009111501 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761435700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c0cc080 0x7f575c0ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f575bfff700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f575c0b2720 0x7f575c0a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5760c34700 1 -- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c0cc080 msgr2=0x7f575c0ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5760c34700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c0cc080 0x7f575c0ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5760c34700 1 -- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f575c0b2720 msgr2=0x7f575c0a7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:11.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5760c34700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f575c0b2720 0x7f575c0a7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5760c34700 1 -- 172.21.15.19:0/2009111501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5754009a20 con 0x7f575c066e00 2024-08-17T02:27:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5760c34700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f575c066e00 0x7f575c14f4d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f574c00e930 tx=0x7f574c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5758ff9700 1 -- 172.21.15.19:0/2009111501 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c013680 con 0x7f575c066e00 2024-08-17T02:27:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5758ff9700 1 -- 172.21.15.19:0/2009111501 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c0137e0 con 0x7f575c066e00 2024-08-17T02:27:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c0a85c0 con 0x7f575c066e00 2024-08-17T02:27:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5758ff9700 1 -- 172.21.15.19:0/2009111501 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c013b80 con 0x7f575c066e00 2024-08-17T02:27:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c14fa10 con 0x7f575c066e00 2024-08-17T02:27:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.347+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c0638f0 con 0x7f575c066e00 2024-08-17T02:27:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.351+0000 7f5758ff9700 1 -- 172.21.15.19:0/2009111501 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f574c00c3e0 con 0x7f575c066e00 2024-08-17T02:27:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.351+0000 7f5758ff9700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5748060890 0x7f5748062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.351+0000 7f5758ff9700 1 -- 172.21.15.19:0/2009111501 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f574c07ca50 con 0x7f575c066e00 2024-08-17T02:27:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.351+0000 7f575bfff700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5748060890 0x7f5748062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:11.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.351+0000 7f575bfff700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5748060890 0x7f5748062d40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f575c0c7090 tx=0x7f5750009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:11.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.359+0000 7f5758ff9700 1 -- 172.21.15.19:0/2009111501 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f574c04d080 con 0x7f575c066e00 2024-08-17T02:27:11.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:11.527+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f575c067270 con 0x7f575c066e00 2024-08-17T02:27:12.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.219+0000 7f5758ff9700 1 -- 172.21.15.19:0/2009111501 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f574c0506a0 con 0x7f575c066e00 2024-08-17T02:27:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5748060890 msgr2=0x7f5748062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5748060890 0x7f5748062d40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f575c0c7090 tx=0x7f5750009040 comp rx=0 tx=0).stop 2024-08-17T02:27:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f575c066e00 msgr2=0x7f575c14f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f575c066e00 0x7f575c14f4d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f574c00e930 tx=0x7f574c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 shutdown_connections 2024-08-17T02:27:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5748060890 0x7f5748062d40 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f575c0c7090 tx=0x7f5750009040 comp rx=0 tx=0).stop 2024-08-17T02:27:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f575c0cc080 0x7f575c0ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f575c0b2720 0x7f575c0a7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 --2- 172.21.15.19:0/2009111501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f575c066e00 0x7f575c14f4d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.231+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 >> 172.21.15.19:0/2009111501 conn(0x7f575c0682c0 msgr2=0x7f575c0cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.235+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 shutdown_connections 2024-08-17T02:27:12.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.235+0000 7f5761c36700 1 -- 172.21.15.19:0/2009111501 wait complete. 2024-08-17T02:27:12.245 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-08-17T02:27:12.258 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:27:12.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f174688a700 1 Processor -- start 2024-08-17T02:27:12.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f174688a700 1 -- start start 2024-08-17T02:27:12.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f174688a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17400cbab0 0x7f17400cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f174688a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 0x7f17400adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f174688a700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17400cc450 con 0x7f1740140910 2024-08-17T02:27:12.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f174688a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17400c8c30 con 0x7f17400cbab0 2024-08-17T02:27:12.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f174688a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17400c3e30 con 0x7f17400ad6e0 2024-08-17T02:27:12.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f1745087700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17400cbab0 0x7f17400cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f1745087700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17400cbab0 0x7f17400cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39598/0 (socket says 172.21.15.19:39598) 2024-08-17T02:27:12.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f1745087700 1 -- 172.21.15.19:0/2208477874 learned_addr learned my addr 172.21.15.19:0/2208477874 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:12.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f1746089700 1 --2- 172.21.15.19:0/2208477874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 0x7f17400adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f1745087700 1 -- 172.21.15.19:0/2208477874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 msgr2=0x7f17400adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:12.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f1745087700 1 --2- 172.21.15.19:0/2208477874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 0x7f17400adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f1745087700 1 -- 172.21.15.19:0/2208477874 >> v1:172.21.15.119:6789/0 conn(0x7f1740140910 legacy=0x7f17400c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f1745087700 1 -- 172.21.15.19:0/2208477874 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17400c4110 con 0x7f17400cbab0 2024-08-17T02:27:12.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.359+0000 7f1745087700 1 --2- 172.21.15.19:0/2208477874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 0x7f17400cbf10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f17300099b0 tx=0x7f1730009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653388539fa9d2b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f1744886700 1 -- 172.21.15.19:0/2208477874 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730009ea0 con 0x7f17400cbab0 2024-08-17T02:27:12.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f1744886700 1 -- 172.21.15.19:0/2208477874 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173000b860 con 0x7f17400cbab0 2024-08-17T02:27:12.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f1744886700 1 -- 172.21.15.19:0/2208477874 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173000bc00 con 0x7f17400cbab0 2024-08-17T02:27:12.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 -- 172.21.15.19:0/2208477874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 msgr2=0x7f17400cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 --2- 172.21.15.19:0/2208477874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 0x7f17400cbf10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f17300099b0 tx=0x7f1730009250 comp rx=0 tx=0).stop 2024-08-17T02:27:12.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 -- 172.21.15.19:0/2208477874 shutdown_connections 2024-08-17T02:27:12.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 --2- 172.21.15.19:0/2208477874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 0x7f17400adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 --2- 172.21.15.19:0/2208477874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 0x7f17400cbf10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 -- 172.21.15.19:0/2208477874 >> 172.21.15.19:0/2208477874 conn(0x7f17400cdee0 msgr2=0x7f17400ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:12.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 -- 172.21.15.19:0/2208477874 shutdown_connections 2024-08-17T02:27:12.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 -- 172.21.15.19:0/2208477874 wait complete. 2024-08-17T02:27:12.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 Processor -- start 2024-08-17T02:27:12.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.363+0000 7f174688a700 1 -- start start 2024-08-17T02:27:12.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f174688a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 0x7f174012c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f174688a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 0x7f17401576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f174688a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1740140910 0x7f174015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f174688a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174013ff50 con 0x7f17400cbab0 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f174688a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17401580f0 con 0x7f1740140910 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f174688a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17401583d0 con 0x7f17400ad6e0 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745087700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 0x7f17401576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745888700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 0x7f174012c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745087700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 0x7f17401576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39606/0 (socket says 172.21.15.19:39606) 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745087700 1 -- 172.21.15.19:0/1072731261 learned_addr learned my addr 172.21.15.19:0/1072731261 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1746089700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1740140910 0x7f174015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745087700 1 -- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 msgr2=0x7f174012c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745087700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 0x7f174012c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745087700 1 -- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1740140910 msgr2=0x7f174015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:12.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745087700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1740140910 0x7f174015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:12.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745087700 1 -- 172.21.15.19:0/1072731261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17300094f0 con 0x7f17400cbab0 2024-08-17T02:27:12.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1745087700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 0x7f17401576f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f174006fbe0 tx=0x7f1730017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1735ffb700 1 -- 172.21.15.19:0/1072731261 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730000d10 con 0x7f17400cbab0 2024-08-17T02:27:12.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1735ffb700 1 -- 172.21.15.19:0/1072731261 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173000bbe0 con 0x7f17400cbab0 2024-08-17T02:27:12.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17401586b0 con 0x7f17400cbab0 2024-08-17T02:27:12.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f1735ffb700 1 -- 172.21.15.19:0/1072731261 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730011670 con 0x7f17400cbab0 2024-08-17T02:27:12.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.367+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1740158c70 con 0x7f17400cbab0 2024-08-17T02:27:12.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.371+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17400638f0 con 0x7f17400cbab0 2024-08-17T02:27:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.371+0000 7f1735ffb700 1 -- 172.21.15.19:0/1072731261 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1730011aa0 con 0x7f17400cbab0 2024-08-17T02:27:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.371+0000 7f1735ffb700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1724060860 0x7f1724062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:12.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.371+0000 7f1735ffb700 1 -- 172.21.15.19:0/1072731261 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f173007eaa0 con 0x7f17400cbab0 2024-08-17T02:27:12.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.371+0000 7f1745888700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1724060860 0x7f1724062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:12.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.371+0000 7f1745888700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1724060860 0x7f1724062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f173c003a80 tx=0x7f173c007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:12.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.383+0000 7f1735ffb700 1 -- 172.21.15.19:0/1072731261 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1730052a60 con 0x7f17400cbab0 2024-08-17T02:27:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:12.587+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f17400c9940 con 0x7f17400cbab0 2024-08-17T02:27:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.247+0000 7f1735ffb700 1 -- 172.21.15.19:0/1072731261 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f17300150c0 con 0x7f17400cbab0 2024-08-17T02:27:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1724060860 msgr2=0x7f1724062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1724060860 0x7f1724062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f173c003a80 tx=0x7f173c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 msgr2=0x7f17401576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 0x7f17401576f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f174006fbe0 tx=0x7f1730017000 comp rx=0 tx=0).stop 2024-08-17T02:27:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 shutdown_connections 2024-08-17T02:27:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1724060860 0x7f1724062d10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1740140910 0x7f174015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17400cbab0 0x7f17401576f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 --2- 172.21.15.19:0/1072731261 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17400ad6e0 0x7f174012c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 >> 172.21.15.19:0/1072731261 conn(0x7f17400cdee0 msgr2=0x7f17400cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 shutdown_connections 2024-08-17T02:27:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.255+0000 7f174688a700 1 -- 172.21.15.19:0/1072731261 wait complete. 2024-08-17T02:27:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:27:13.275 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:13.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.371+0000 7f20e1a22700 1 Processor -- start 2024-08-17T02:27:13.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.371+0000 7f20e1a22700 1 -- start start 2024-08-17T02:27:13.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f20dc0d0010 0x7f20dc0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc15cea0 0x7f20dc15d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc0cf190 con 0x7f20dc159040 2024-08-17T02:27:13.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20dc0d09a0 con 0x7f20dc0d0010 2024-08-17T02:27:13.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0ce5e0 con 0x7f20dc15cea0 2024-08-17T02:27:13.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1221700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc15cea0 0x7f20dc15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20d3fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f20dc0d0010 0x7f20dc0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20d3fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f20dc0d0010 0x7f20dc0d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:52054/0 (socket says 172.21.15.19:52054) 2024-08-17T02:27:13.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20d3fff700 1 -- 172.21.15.19:0/1597401636 learned_addr learned my addr 172.21.15.19:0/1597401636 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1221700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc15cea0 0x7f20dc15d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:46488/0 (socket says 172.21.15.19:46488) 2024-08-17T02:27:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e0a20700 1 --1- 172.21.15.19:0/1597401636 >> v1:172.21.15.119:6789/0 conn(0x7f20dc159040 0x7f20dc0cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:40280/0 (socket says 172.21.15.19:40280) 2024-08-17T02:27:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1221700 1 -- 172.21.15.19:0/1597401636 >> v2:172.21.15.119:3300/0 conn(0x7f20dc0d0010 msgr2=0x7f20dc0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1221700 1 --2- 172.21.15.19:0/1597401636 >> v2:172.21.15.119:3300/0 conn(0x7f20dc0d0010 0x7f20dc0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1221700 1 -- 172.21.15.19:0/1597401636 >> v1:172.21.15.119:6789/0 conn(0x7f20dc159040 legacy=0x7f20dc0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20d37fe700 1 -- 172.21.15.19:0/1597401636 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730902321 0 0) 0x7f20dc0cf190 con 0x7f20dc159040 2024-08-17T02:27:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1221700 1 -- 172.21.15.19:0/1597401636 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0ce860 con 0x7f20dc15cea0 2024-08-17T02:27:13.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20d3fff700 1 --2- 172.21.15.19:0/1597401636 >> v2:172.21.15.119:3300/0 conn(0x7f20dc0d0010 0x7f20dc0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1221700 1 --2- 172.21.15.19:0/1597401636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc15cea0 0x7f20dc15d320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009e60 tx=0x7f20d4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b1855a2e8dbd99f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20d37fe700 1 -- 172.21.15.19:0/1597401636 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d400e070 con 0x7f20dc15cea0 2024-08-17T02:27:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20d37fe700 1 -- 172.21.15.19:0/1597401636 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d400bb60 con 0x7f20dc15cea0 2024-08-17T02:27:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20d37fe700 1 -- 172.21.15.19:0/1597401636 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4012430 con 0x7f20dc15cea0 2024-08-17T02:27:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 -- 172.21.15.19:0/1597401636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc15cea0 msgr2=0x7f20dc15d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 --2- 172.21.15.19:0/1597401636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc15cea0 0x7f20dc15d320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009e60 tx=0x7f20d4009780 comp rx=0 tx=0).stop 2024-08-17T02:27:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 -- 172.21.15.19:0/1597401636 shutdown_connections 2024-08-17T02:27:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 --2- 172.21.15.19:0/1597401636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc15cea0 0x7f20dc15d320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 --2- 172.21.15.19:0/1597401636 >> v2:172.21.15.119:3300/0 conn(0x7f20dc0d0010 0x7f20dc0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 -- 172.21.15.19:0/1597401636 >> 172.21.15.19:0/1597401636 conn(0x7f20dc068250 msgr2=0x7f20dc068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 -- 172.21.15.19:0/1597401636 shutdown_connections 2024-08-17T02:27:13.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.375+0000 7f20e1a22700 1 -- 172.21.15.19:0/1597401636 wait complete. 2024-08-17T02:27:13.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.379+0000 7f20e1a22700 1 Processor -- start 2024-08-17T02:27:13.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.379+0000 7f20e1a22700 1 -- start start 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.379+0000 7f20e1a22700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc0d0010 0x7f20dc147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.379+0000 7f20e1a22700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc159040 0x7f20dc0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.379+0000 7f20e1a22700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20dc15cea0 0x7f20dc159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.379+0000 7f20e1a22700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0a7ac0 con 0x7f20dc15cea0 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.379+0000 7f20e1a22700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0a6eb0 con 0x7f20dc159040 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.379+0000 7f20e1a22700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0a7190 con 0x7f20dc0d0010 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1221700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20dc15cea0 0x7f20dc159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1221700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20dc15cea0 0x7f20dc159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39612/0 (socket says 172.21.15.19:39612) 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1221700 1 -- 172.21.15.19:0/2863546069 learned_addr learned my addr 172.21.15.19:0/2863546069 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:13.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20d3fff700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc159040 0x7f20dc0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e0a20700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc0d0010 0x7f20dc147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1221700 1 -- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc0d0010 msgr2=0x7f20dc147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1221700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc0d0010 0x7f20dc147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1221700 1 -- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc159040 msgr2=0x7f20dc0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1221700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc159040 0x7f20dc0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1221700 1 -- 172.21.15.19:0/2863546069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0094f0 con 0x7f20dc15cea0 2024-08-17T02:27:13.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1221700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20dc15cea0 0x7f20dc159c20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20d400b6c0 tx=0x7f20d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:13.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20d0ff9700 1 -- 172.21.15.19:0/2863546069 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4007000 con 0x7f20dc15cea0 2024-08-17T02:27:13.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20d0ff9700 1 -- 172.21.15.19:0/2863546069 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4025440 con 0x7f20dc15cea0 2024-08-17T02:27:13.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d4009a20 con 0x7f20dc15cea0 2024-08-17T02:27:13.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20d0ff9700 1 -- 172.21.15.19:0/2863546069 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4025800 con 0x7f20dc15cea0 2024-08-17T02:27:13.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc0a7750 con 0x7f20dc15cea0 2024-08-17T02:27:13.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.383+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc0643a0 con 0x7f20dc15cea0 2024-08-17T02:27:13.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.387+0000 7f20d0ff9700 1 -- 172.21.15.19:0/2863546069 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f20d4003050 con 0x7f20dc15cea0 2024-08-17T02:27:13.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.387+0000 7f20d0ff9700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f20c8060890 0x7f20c8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.387+0000 7f20d0ff9700 1 -- 172.21.15.19:0/2863546069 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20d407e6f0 con 0x7f20dc15cea0 2024-08-17T02:27:13.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.387+0000 7f20e0a20700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f20c8060890 0x7f20c8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.387+0000 7f20e0a20700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f20c8060890 0x7f20c8062d40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f20dc156030 tx=0x7f20d8007ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:13.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.391+0000 7f20d0ff9700 1 -- 172.21.15.19:0/2863546069 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f20d404eb40 con 0x7f20dc15cea0 2024-08-17T02:27:13.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.559+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20dc0b3480 con 0x7f20dc15cea0 2024-08-17T02:27:13.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.563+0000 7f20d0ff9700 1 -- 172.21.15.19:0/2863546069 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f20d4052160 con 0x7f20dc15cea0 2024-08-17T02:27:13.567 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:13.568 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":32,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:27:12.590708+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:11.122666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:11.570819+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:13.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f20c8060890 msgr2=0x7f20c8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f20c8060890 0x7f20c8062d40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f20dc156030 tx=0x7f20d8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20dc15cea0 msgr2=0x7f20dc159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20dc15cea0 0x7f20dc159c20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20d400b6c0 tx=0x7f20d4019000 comp rx=0 tx=0).stop 2024-08-17T02:27:13.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 shutdown_connections 2024-08-17T02:27:13.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f20c8060890 0x7f20c8062d40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20dc15cea0 0x7f20dc159c20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f20dc159040 0x7f20dc0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 --2- 172.21.15.19:0/2863546069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20dc0d0010 0x7f20dc147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 >> 172.21.15.19:0/2863546069 conn(0x7f20dc068250 msgr2=0x7f20dc158290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:13.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 shutdown_connections 2024-08-17T02:27:13.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.567+0000 7f20e1a22700 1 -- 172.21.15.19:0/2863546069 wait complete. 2024-08-17T02:27:13.586 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 Processor -- start 2024-08-17T02:27:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 -- start start 2024-08-17T02:27:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f615c0b0d20 0x7f615c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c141a00 con 0x7f615c0b1800 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c06e8a0 con 0x7f615c06e450 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615c140b10 con 0x7f615c0b0d20 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6161d74700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f615c0b0d20 0x7f615c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162575700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f615c0b1800 0x7f615c141e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50664/0 (socket says 172.21.15.19:50664) 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162575700 1 -- 172.21.15.19:0/900808946 learned_addr learned my addr 172.21.15.19:0/900808946 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6161d74700 1 -- 172.21.15.19:0/900808946 >> v1:172.21.15.119:6789/0 conn(0x7f615c06e450 legacy=0x7f615c0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6161d74700 1 -- 172.21.15.19:0/900808946 >> v1:172.21.15.19:6789/0 conn(0x7f615c0b1800 legacy=0x7f615c141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6161d74700 1 -- 172.21.15.19:0/900808946 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c140df0 con 0x7f615c0b0d20 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6160d72700 1 -- 172.21.15.19:0/900808946 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345587920 0 0) 0x7f615c141a00 con 0x7f615c0b1800 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6161d74700 1 --2- 172.21.15.19:0/900808946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b0d20 0x7f615c06df10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f61580098e0 tx=0x7f61580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8432faeecd26e796 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6160d72700 1 -- 172.21.15.19:0/900808946 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158009e80 con 0x7f615c0b0d20 2024-08-17T02:27:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6160d72700 1 -- 172.21.15.19:0/900808946 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800b860 con 0x7f615c0b0d20 2024-08-17T02:27:13.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6160d72700 1 -- 172.21.15.19:0/900808946 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800bbe0 con 0x7f615c0b0d20 2024-08-17T02:27:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 -- 172.21.15.19:0/900808946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b0d20 msgr2=0x7f615c06df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 --2- 172.21.15.19:0/900808946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b0d20 0x7f615c06df10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f61580098e0 tx=0x7f61580091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 -- 172.21.15.19:0/900808946 shutdown_connections 2024-08-17T02:27:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 --2- 172.21.15.19:0/900808946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b0d20 0x7f615c06df10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 -- 172.21.15.19:0/900808946 >> 172.21.15.19:0/900808946 conn(0x7f615c0678d0 msgr2=0x7f615c067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 -- 172.21.15.19:0/900808946 shutdown_connections 2024-08-17T02:27:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.691+0000 7f6162d76700 1 -- 172.21.15.19:0/900808946 wait complete. 2024-08-17T02:27:13.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.695+0000 7f6162d76700 1 Processor -- start 2024-08-17T02:27:13.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.695+0000 7f6162d76700 1 -- start start 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.695+0000 7f6162d76700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f615c06e450 0x7f615c16e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.695+0000 7f6162d76700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f615c0b0d20 0x7f615c1463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.695+0000 7f6162d76700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b1800 0x7f615c145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.695+0000 7f6162d76700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0a7a90 con 0x7f615c0b1800 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.695+0000 7f6162d76700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c146930 con 0x7f615c0b0d20 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.695+0000 7f6162d76700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0a7160 con 0x7f615c06e450 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.695+0000 7f6162575700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b1800 0x7f615c145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162575700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b1800 0x7f615c145910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39636/0 (socket says 172.21.15.19:39636) 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162575700 1 -- 172.21.15.19:0/119462594 learned_addr learned my addr 172.21.15.19:0/119462594 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6161573700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f615c0b0d20 0x7f615c1463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6161d74700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f615c06e450 0x7f615c16e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162575700 1 -- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f615c06e450 msgr2=0x7f615c16e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162575700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f615c06e450 0x7f615c16e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162575700 1 -- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f615c0b0d20 msgr2=0x7f615c1463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162575700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f615c0b0d20 0x7f615c1463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162575700 1 -- 172.21.15.19:0/119462594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158009420 con 0x7f615c0b1800 2024-08-17T02:27:13.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162575700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b1800 0x7f615c145910 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f615400cc90 tx=0x7f6154001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:13.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6151ffb700 1 -- 172.21.15.19:0/119462594 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400a870 con 0x7f615c0b1800 2024-08-17T02:27:13.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6151ffb700 1 -- 172.21.15.19:0/119462594 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615400a9d0 con 0x7f615c0b1800 2024-08-17T02:27:13.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c0a7440 con 0x7f615c0b1800 2024-08-17T02:27:13.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6151ffb700 1 -- 172.21.15.19:0/119462594 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400ad90 con 0x7f615c0b1800 2024-08-17T02:27:13.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c145e50 con 0x7f615c0b1800 2024-08-17T02:27:13.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.699+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c0a7c00 con 0x7f615c0b1800 2024-08-17T02:27:13.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.703+0000 7f6151ffb700 1 -- 172.21.15.19:0/119462594 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6154007300 con 0x7f615c0b1800 2024-08-17T02:27:13.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.703+0000 7f6151ffb700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6140060860 0x7f6140062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:13.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.703+0000 7f6151ffb700 1 -- 172.21.15.19:0/119462594 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f615407cf90 con 0x7f615c0b1800 2024-08-17T02:27:13.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.703+0000 7f6161d74700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6140060860 0x7f6140062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:13.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.703+0000 7f6161d74700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6140060860 0x7f6140062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f61580093f0 tx=0x7f6158017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:13.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.711+0000 7f6151ffb700 1 -- 172.21.15.19:0/119462594 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f615404d3d0 con 0x7f615c0b1800 2024-08-17T02:27:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.875+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f615c0643a0 con 0x7f615c0b1800 2024-08-17T02:27:13.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.875+0000 7f6151ffb700 1 -- 172.21.15.19:0/119462594 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f61540509f0 con 0x7f615c0b1800 2024-08-17T02:27:13.881 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:13.881 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":32,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:27:12.590708+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:11.122666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:11.570819+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6140060860 msgr2=0x7f6140062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6140060860 0x7f6140062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f61580093f0 tx=0x7f6158017000 comp rx=0 tx=0).stop 2024-08-17T02:27:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b1800 msgr2=0x7f615c145910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b1800 0x7f615c145910 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f615400cc90 tx=0x7f6154001a20 comp rx=0 tx=0).stop 2024-08-17T02:27:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 shutdown_connections 2024-08-17T02:27:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6140060860 0x7f6140062d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f615c0b1800 0x7f615c145910 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f615c0b0d20 0x7f615c1463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 --2- 172.21.15.19:0/119462594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f615c06e450 0x7f615c16e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 >> 172.21.15.19:0/119462594 conn(0x7f615c0678d0 msgr2=0x7f615c063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 shutdown_connections 2024-08-17T02:27:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:13.879+0000 7f6162d76700 1 -- 172.21.15.19:0/119462594 wait complete. 2024-08-17T02:27:13.897 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:27:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 Processor -- start 2024-08-17T02:27:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 -- start start 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba24146f40 0x7fba2406e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 0x7fba2406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba240b0010 con 0x7fba24147310 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba240af440 con 0x7fba24146f40 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba240af6e0 con 0x7fba2415dcc0 2024-08-17T02:27:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba23fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba24146f40 0x7fba2406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba23fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba24146f40 0x7fba2406e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39646/0 (socket says 172.21.15.19:39646) 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba23fff700 1 -- 172.21.15.19:0/231305781 learned_addr learned my addr 172.21.15.19:0/231305781 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba237fe700 1 --2- 172.21.15.19:0/231305781 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 0x7fba2406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba23fff700 1 -- 172.21.15.19:0/231305781 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 msgr2=0x7fba2406ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba23fff700 1 --2- 172.21.15.19:0/231305781 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 0x7fba2406ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba23fff700 1 -- 172.21.15.19:0/231305781 >> v1:172.21.15.119:6789/0 conn(0x7fba24147310 legacy=0x7fba240a8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba23fff700 1 -- 172.21.15.19:0/231305781 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba240af9c0 con 0x7fba24146f40 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba23fff700 1 --2- 172.21.15.19:0/231305781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 0x7fba2406e540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fba140099e0 tx=0x7fba14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3283264db6c0bc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba22ffd700 1 -- 172.21.15.19:0/231305781 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400b820 con 0x7fba24146f40 2024-08-17T02:27:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba22ffd700 1 -- 172.21.15.19:0/231305781 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1400b980 con 0x7fba24146f40 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba22ffd700 1 -- 172.21.15.19:0/231305781 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400bd20 con 0x7fba24146f40 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 -- 172.21.15.19:0/231305781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 msgr2=0x7fba2406e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 --2- 172.21.15.19:0/231305781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 0x7fba2406e540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fba140099e0 tx=0x7fba14009250 comp rx=0 tx=0).stop 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 -- 172.21.15.19:0/231305781 shutdown_connections 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 --2- 172.21.15.19:0/231305781 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 0x7fba2406ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 --2- 172.21.15.19:0/231305781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 0x7fba2406e540 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.007+0000 7fba2a565700 1 -- 172.21.15.19:0/231305781 >> 172.21.15.19:0/231305781 conn(0x7fba24066e00 msgr2=0x7fba24067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 -- 172.21.15.19:0/231305781 shutdown_connections 2024-08-17T02:27:14.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 -- 172.21.15.19:0/231305781 wait complete. 2024-08-17T02:27:14.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 Processor -- start 2024-08-17T02:27:14.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 -- start start 2024-08-17T02:27:14.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 0x7fba240cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba24147310 0x7fba24141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 0x7fba24069220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2416e880 con 0x7fba24146f40 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2416df50 con 0x7fba24147310 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2416e230 con 0x7fba2415dcc0 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba23fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 0x7fba240cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba23fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 0x7fba240cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39656/0 (socket says 172.21.15.19:39656) 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba23fff700 1 -- 172.21.15.19:0/1383939108 learned_addr learned my addr 172.21.15.19:0/1383939108 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba28b02700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 0x7fba24069220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba237fe700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba24147310 0x7fba24141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba23fff700 1 -- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 msgr2=0x7fba24069220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba23fff700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 0x7fba24069220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba23fff700 1 -- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba24147310 msgr2=0x7fba24141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba23fff700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba24147310 0x7fba24141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba23fff700 1 -- 172.21.15.19:0/1383939108 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140094f0 con 0x7fba24146f40 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba23fff700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 0x7fba240cabb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fba240710e0 tx=0x7fba14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba0bfff700 1 -- 172.21.15.19:0/1383939108 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14011dc0 con 0x7fba24146f40 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2416e510 con 0x7fba24146f40 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba0bfff700 1 -- 172.21.15.19:0/1383939108 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba14026450 con 0x7fba24146f40 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba0bfff700 1 -- 172.21.15.19:0/1383939108 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14026810 con 0x7fba24146f40 2024-08-17T02:27:14.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.011+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2416dc00 con 0x7fba24146f40 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.015+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba240645c0 con 0x7fba24146f40 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.015+0000 7fba0bfff700 1 -- 172.21.15.19:0/1383939108 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fba1401a420 con 0x7fba24146f40 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.015+0000 7fba0bfff700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba10060860 0x7fba10062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.015+0000 7fba0bfff700 1 -- 172.21.15.19:0/1383939108 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba1407e940 con 0x7fba24146f40 2024-08-17T02:27:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.015+0000 7fba237fe700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba10060860 0x7fba10062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.015+0000 7fba237fe700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba10060860 0x7fba10062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba24171160 tx=0x7fba18008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.019+0000 7fba0bfff700 1 -- 172.21.15.19:0/1383939108 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fba1404ecf0 con 0x7fba24146f40 2024-08-17T02:27:14.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.223+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fba2406ab60 con 0x7fba24146f40 2024-08-17T02:27:14.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.243+0000 7fba0bfff700 1 -- 172.21.15.19:0/1383939108 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7fba140150b0 con 0x7fba24146f40 2024-08-17T02:27:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba10060860 msgr2=0x7fba10062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba10060860 0x7fba10062d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba24171160 tx=0x7fba18008040 comp rx=0 tx=0).stop 2024-08-17T02:27:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 msgr2=0x7fba240cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 0x7fba240cabb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fba240710e0 tx=0x7fba14017000 comp rx=0 tx=0).stop 2024-08-17T02:27:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 shutdown_connections 2024-08-17T02:27:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba10060860 0x7fba10062d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba2415dcc0 0x7fba24069220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba24147310 0x7fba24141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 --2- 172.21.15.19:0/1383939108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba24146f40 0x7fba240cabb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 >> 172.21.15.19:0/1383939108 conn(0x7fba24066e00 msgr2=0x7fba2415d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 shutdown_connections 2024-08-17T02:27:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.247+0000 7fba2a565700 1 -- 172.21.15.19:0/1383939108 wait complete. 2024-08-17T02:27:14.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:27:14.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.379+0000 7f0e62233700 1 Processor -- start 2024-08-17T02:27:14.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.379+0000 7f0e62233700 1 -- start start 2024-08-17T02:27:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e5c159300 0x7f0e5c0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 0x7f0e5c0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5c0cba90 con 0x7f0e5c1596d0 2024-08-17T02:27:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5c0b2b60 con 0x7f0e5c159300 2024-08-17T02:27:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0cb160 con 0x7f0e5c067510 2024-08-17T02:27:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e5c159300 0x7f0e5c0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0e5c159300 0x7f0e5c0b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39670/0 (socket says 172.21.15.19:39670) 2024-08-17T02:27:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5bfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 0x7f0e5c0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5b7fe700 1 -- 172.21.15.19:0/1902132778 learned_addr learned my addr 172.21.15.19:0/1902132778 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5affd700 1 -- 172.21.15.19:0/1902132778 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617297452 0 0) 0x7f0e5c0cba90 con 0x7f0e5c1596d0 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5affd700 1 -- 172.21.15.19:0/1902132778 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e48003570 con 0x7f0e5c1596d0 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5bfff700 1 -- 172.21.15.19:0/1902132778 >> v2:172.21.15.19:3300/0 conn(0x7f0e5c159300 msgr2=0x7f0e5c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5bfff700 1 --2- 172.21.15.19:0/1902132778 >> v2:172.21.15.19:3300/0 conn(0x7f0e5c159300 0x7f0e5c0b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5bfff700 1 -- 172.21.15.19:0/1902132778 >> v1:172.21.15.119:6789/0 conn(0x7f0e5c1596d0 legacy=0x7f0e5c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5bfff700 1 -- 172.21.15.19:0/1902132778 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c0cb440 con 0x7f0e5c067510 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5b7fe700 1 --2- 172.21.15.19:0/1902132778 >> v2:172.21.15.19:3300/0 conn(0x7f0e5c159300 0x7f0e5c0b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5bfff700 1 --2- 172.21.15.19:0/1902132778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 0x7f0e5c0cbf20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009e60 tx=0x7f0e54009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a76885d0e0cc7be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5affd700 1 -- 172.21.15.19:0/1902132778 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400e070 con 0x7f0e5c067510 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5affd700 1 -- 172.21.15.19:0/1902132778 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5400bab0 con 0x7f0e5c067510 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e5affd700 1 -- 172.21.15.19:0/1902132778 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400be70 con 0x7f0e5c067510 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 -- 172.21.15.19:0/1902132778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 msgr2=0x7f0e5c0cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 --2- 172.21.15.19:0/1902132778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 0x7f0e5c0cbf20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009e60 tx=0x7f0e54009780 comp rx=0 tx=0).stop 2024-08-17T02:27:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 -- 172.21.15.19:0/1902132778 shutdown_connections 2024-08-17T02:27:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 --2- 172.21.15.19:0/1902132778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 0x7f0e5c0cbf20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 --2- 172.21.15.19:0/1902132778 >> v2:172.21.15.19:3300/0 conn(0x7f0e5c159300 0x7f0e5c0b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 -- 172.21.15.19:0/1902132778 >> 172.21.15.19:0/1902132778 conn(0x7f0e5c0682c0 msgr2=0x7f0e5c0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 -- 172.21.15.19:0/1902132778 shutdown_connections 2024-08-17T02:27:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.383+0000 7f0e62233700 1 -- 172.21.15.19:0/1902132778 wait complete. 2024-08-17T02:27:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 Processor -- start 2024-08-17T02:27:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 -- start start 2024-08-17T02:27:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 0x7f0e5c0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e5c159300 0x7f0e5c147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e5c1596d0 0x7f0e5c0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0c8880 con 0x7f0e5c159300 2024-08-17T02:27:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0c7c70 con 0x7f0e5c1596d0 2024-08-17T02:27:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0c7f50 con 0x7f0e5c067510 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e53fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e5c159300 0x7f0e5c147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e53fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e5c159300 0x7f0e5c147360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39678/0 (socket says 172.21.15.19:39678) 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e53fff700 1 -- 172.21.15.19:0/2291822407 learned_addr learned my addr 172.21.15.19:0/2291822407 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e5bfff700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e5c1596d0 0x7f0e5c0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e5b7fe700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 0x7f0e5c0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e53fff700 1 -- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 msgr2=0x7f0e5c0b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e53fff700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 0x7f0e5c0b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e53fff700 1 -- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e5c1596d0 msgr2=0x7f0e5c0c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e53fff700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e5c1596d0 0x7f0e5c0c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e53fff700 1 -- 172.21.15.19:0/2291822407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0094f0 con 0x7f0e5c159300 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e53fff700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e5c159300 0x7f0e5c147360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400c580 tx=0x7f0e44007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e537fe700 1 -- 172.21.15.19:0/2291822407 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44010510 con 0x7f0e5c159300 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e537fe700 1 -- 172.21.15.19:0/2291822407 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e44010690 con 0x7f0e5c159300 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e54009a20 con 0x7f0e5c159300 2024-08-17T02:27:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e537fe700 1 -- 172.21.15.19:0/2291822407 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44010a50 con 0x7f0e5c159300 2024-08-17T02:27:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.387+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c0c8510 con 0x7f0e5c159300 2024-08-17T02:27:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.391+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c0c89f0 con 0x7f0e5c159300 2024-08-17T02:27:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.391+0000 7f0e537fe700 1 -- 172.21.15.19:0/2291822407 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0e4401b400 con 0x7f0e5c159300 2024-08-17T02:27:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.391+0000 7f0e537fe700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e3c060860 0x7f0e3c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.391+0000 7f0e537fe700 1 -- 172.21.15.19:0/2291822407 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e4407c710 con 0x7f0e5c159300 2024-08-17T02:27:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.391+0000 7f0e5b7fe700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e3c060860 0x7f0e3c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:14.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.391+0000 7f0e5b7fe700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e3c060860 0x7f0e3c062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c006d20 tx=0x7f0e4c009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:14.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.399+0000 7f0e537fe700 1 -- 172.21.15.19:0/2291822407 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0e4404cb60 con 0x7f0e5c159300 2024-08-17T02:27:14.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:14.603+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0e5c0645c0 con 0x7f0e5c159300 2024-08-17T02:27:15.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.263+0000 7f0e537fe700 1 -- 172.21.15.19:0/2291822407 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e44050180 con 0x7f0e5c159300 2024-08-17T02:27:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e3c060860 msgr2=0x7f0e3c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e3c060860 0x7f0e3c062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c006d20 tx=0x7f0e4c009250 comp rx=0 tx=0).stop 2024-08-17T02:27:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e5c159300 msgr2=0x7f0e5c147360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e5c159300 0x7f0e5c147360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400c580 tx=0x7f0e44007e10 comp rx=0 tx=0).stop 2024-08-17T02:27:15.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 shutdown_connections 2024-08-17T02:27:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0e3c060860 0x7f0e3c062d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e5c1596d0 0x7f0e5c0c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e5c159300 0x7f0e5c147360 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 --2- 172.21.15.19:0/2291822407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5c067510 0x7f0e5c0b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 >> 172.21.15.19:0/2291822407 conn(0x7f0e5c0682c0 msgr2=0x7f0e5c158630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 shutdown_connections 2024-08-17T02:27:15.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.267+0000 7f0e62233700 1 -- 172.21.15.19:0/2291822407 wait complete. 2024-08-17T02:27:15.289 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:15.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febff0f8700 1 Processor -- start 2024-08-17T02:27:15.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febff0f8700 1 -- start start 2024-08-17T02:27:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febff0f8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7febf80af4d0 0x7febf81557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febff0f8700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7febf80686a0 0x7febf8068ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febff0f8700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf8069020 con 0x7febf81553e0 2024-08-17T02:27:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febff0f8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf8155e30 con 0x7febf80af4d0 2024-08-17T02:27:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febff0f8700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf8156110 con 0x7febf80686a0 2024-08-17T02:27:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febfd8f5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7febf80af4d0 0x7febf81557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febfd8f5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7febf80af4d0 0x7febf81557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39686/0 (socket says 172.21.15.19:39686) 2024-08-17T02:27:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febfd8f5700 1 -- 172.21.15.19:0/2645203488 learned_addr learned my addr 172.21.15.19:0/2645203488 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febfe8f7700 1 --2- 172.21.15.19:0/2645203488 >> v2:172.21.15.119:3300/0 conn(0x7febf80686a0 0x7febf8068ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febfd8f5700 1 -- 172.21.15.19:0/2645203488 >> v2:172.21.15.119:3300/0 conn(0x7febf80686a0 msgr2=0x7febf8068ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febfd8f5700 1 --2- 172.21.15.19:0/2645203488 >> v2:172.21.15.119:3300/0 conn(0x7febf80686a0 0x7febf8068ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febfd8f5700 1 -- 172.21.15.19:0/2645203488 >> v1:172.21.15.119:6789/0 conn(0x7febf81553e0 legacy=0x7febf80b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febfd8f5700 1 -- 172.21.15.19:0/2645203488 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf81563f0 con 0x7febf80af4d0 2024-08-17T02:27:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.399+0000 7febfe8f7700 1 --2- 172.21.15.19:0/2645203488 >> v2:172.21.15.119:3300/0 conn(0x7febf80686a0 0x7febf8068ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febfd8f5700 1 --2- 172.21.15.19:0/2645203488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf80af4d0 0x7febf81557b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7febf80cc390 tx=0x7febe8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965932219a7207f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febfd0f4700 1 -- 172.21.15.19:0/2645203488 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8009e70 con 0x7febf80af4d0 2024-08-17T02:27:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febfd0f4700 1 -- 172.21.15.19:0/2645203488 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe800b860 con 0x7febf80af4d0 2024-08-17T02:27:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febfd0f4700 1 -- 172.21.15.19:0/2645203488 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800bc00 con 0x7febf80af4d0 2024-08-17T02:27:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febff0f8700 1 -- 172.21.15.19:0/2645203488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf80af4d0 msgr2=0x7febf81557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febff0f8700 1 --2- 172.21.15.19:0/2645203488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf80af4d0 0x7febf81557b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7febf80cc390 tx=0x7febe8009250 comp rx=0 tx=0).stop 2024-08-17T02:27:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febff0f8700 1 -- 172.21.15.19:0/2645203488 shutdown_connections 2024-08-17T02:27:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febff0f8700 1 --2- 172.21.15.19:0/2645203488 >> v2:172.21.15.119:3300/0 conn(0x7febf80686a0 0x7febf8068ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febff0f8700 1 --2- 172.21.15.19:0/2645203488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf80af4d0 0x7febf81557b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febff0f8700 1 -- 172.21.15.19:0/2645203488 >> 172.21.15.19:0/2645203488 conn(0x7febf806d800 msgr2=0x7febf806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febff0f8700 1 -- 172.21.15.19:0/2645203488 shutdown_connections 2024-08-17T02:27:15.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febff0f8700 1 -- 172.21.15.19:0/2645203488 wait complete. 2024-08-17T02:27:15.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.403+0000 7febff0f8700 1 Processor -- start 2024-08-17T02:27:15.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 -- start start 2024-08-17T02:27:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf80686a0 0x7febf815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf80af4d0 0x7febf81530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf81553e0 0x7febf814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80a8790 con 0x7febf81553e0 2024-08-17T02:27:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf815c200 con 0x7febf80af4d0 2024-08-17T02:27:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf815c4e0 con 0x7febf80686a0 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe8f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf81553e0 0x7febf814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe8f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf81553e0 0x7febf814ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39692/0 (socket says 172.21.15.19:39692) 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe8f7700 1 -- 172.21.15.19:0/3194566349 learned_addr learned my addr 172.21.15.19:0/3194566349 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe0f6700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf80686a0 0x7febf815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfd8f5700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf80af4d0 0x7febf81530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe8f7700 1 -- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf80686a0 msgr2=0x7febf815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe8f7700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf80686a0 0x7febf815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe8f7700 1 -- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf80af4d0 msgr2=0x7febf81530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe8f7700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf80af4d0 0x7febf81530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe8f7700 1 -- 172.21.15.19:0/3194566349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf000a5d0 con 0x7febf81553e0 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfd8f5700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf80af4d0 0x7febf81530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febfe8f7700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf81553e0 0x7febf814ef20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7febf000e9d0 tx=0x7febf000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febee7fc700 1 -- 172.21.15.19:0/3194566349 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000eec0 con 0x7febf81553e0 2024-08-17T02:27:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febee7fc700 1 -- 172.21.15.19:0/3194566349 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf000c950 con 0x7febf81553e0 2024-08-17T02:27:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febee7fc700 1 -- 172.21.15.19:0/3194566349 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000ccf0 con 0x7febf81553e0 2024-08-17T02:27:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe80094f0 con 0x7febf81553e0 2024-08-17T02:27:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf815caa0 con 0x7febf81553e0 2024-08-17T02:27:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.407+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf80a8560 con 0x7febf81553e0 2024-08-17T02:27:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.411+0000 7febee7fc700 1 -- 172.21.15.19:0/3194566349 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7febf0011600 con 0x7febf81553e0 2024-08-17T02:27:15.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.411+0000 7febee7fc700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7febdc060890 0x7febdc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.411+0000 7febee7fc700 1 -- 172.21.15.19:0/3194566349 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7febf0015030 con 0x7febf81553e0 2024-08-17T02:27:15.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.411+0000 7febfe0f6700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7febdc060890 0x7febdc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.411+0000 7febfe0f6700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7febdc060890 0x7febdc062d40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7febf4007fd0 tx=0x7febf4001650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.415+0000 7febee7fc700 1 -- 172.21.15.19:0/3194566349 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7febf80a8560 con 0x7febf81553e0 2024-08-17T02:27:15.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.615+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febf80a8560 con 0x7febf81553e0 2024-08-17T02:27:15.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.619+0000 7febee7fc700 1 -- 172.21.15.19:0/3194566349 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4604 (secure 0 0 0) 0x7febf80a8560 con 0x7febf81553e0 2024-08-17T02:27:15.623 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:15.623 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34643,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:12.591455+0000","modified":"2024-08-17T02:27:15.252576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34649":{"gid":34649,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/363347157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":363347157},{"type":"v1","addr":"172.21.15.19:6835","nonce":363347157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7febdc060890 msgr2=0x7febdc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7febdc060890 0x7febdc062d40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7febf4007fd0 tx=0x7febf4001650 comp rx=0 tx=0).stop 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf81553e0 msgr2=0x7febf814ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf81553e0 0x7febf814ef20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7febf000e9d0 tx=0x7febf000a330 comp rx=0 tx=0).stop 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 shutdown_connections 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7febdc060890 0x7febdc062d40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febf81553e0 0x7febf814ef20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf80af4d0 0x7febf81530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 --2- 172.21.15.19:0/3194566349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf80686a0 0x7febf815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 >> 172.21.15.19:0/3194566349 conn(0x7febf806d800 msgr2=0x7febf8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 shutdown_connections 2024-08-17T02:27:15.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.623+0000 7febff0f8700 1 -- 172.21.15.19:0/3194566349 wait complete. 2024-08-17T02:27:15.628 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 13 2024-08-17T02:27:15.642 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:15.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbb0cd4700 1 Processor -- start 2024-08-17T02:27:15.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbb0cd4700 1 -- start start 2024-08-17T02:27:15.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbb0cd4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcbac068db0 0x7fcbac1557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbb0cd4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac155e30 con 0x7fcbac1553e0 2024-08-17T02:27:15.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbb0cd4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac156110 con 0x7fcbac0af4d0 2024-08-17T02:27:15.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbb0cd4700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac1563f0 con 0x7fcbac068db0 2024-08-17T02:27:15.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbab7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcbac1553e0 0x7fcbac0b1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50668/0 (socket says 172.21.15.19:50668) 2024-08-17T02:27:15.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbab7fe700 1 -- 172.21.15.19:0/4245693133 learned_addr learned my addr 172.21.15.19:0/4245693133 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:15.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbabfff700 1 --2- 172.21.15.19:0/4245693133 >> v2:172.21.15.119:3300/0 conn(0x7fcbac068db0 0x7fcbac1557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbaa7fc700 1 -- 172.21.15.19:0/4245693133 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246173587 0 0) 0x7fcbac155e30 con 0x7fcbac1553e0 2024-08-17T02:27:15.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbaa7fc700 1 -- 172.21.15.19:0/4245693133 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb94003570 con 0x7fcbac1553e0 2024-08-17T02:27:15.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbabfff700 1 -- 172.21.15.19:0/4245693133 >> v1:172.21.15.119:6789/0 conn(0x7fcbac0af4d0 legacy=0x7fcbac0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbabfff700 1 -- 172.21.15.19:0/4245693133 >> v1:172.21.15.19:6789/0 conn(0x7fcbac1553e0 legacy=0x7fcbac0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbabfff700 1 -- 172.21.15.19:0/4245693133 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac1566d0 con 0x7fcbac068db0 2024-08-17T02:27:15.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbabfff700 1 --2- 172.21.15.19:0/4245693133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbac068db0 0x7fcbac1557b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009e60 tx=0x7fcba4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c28a3742fb4e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbaa7fc700 1 -- 172.21.15.19:0/4245693133 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400bb60 con 0x7fcbac068db0 2024-08-17T02:27:15.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbaa7fc700 1 -- 172.21.15.19:0/4245693133 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba400bcc0 con 0x7fcbac068db0 2024-08-17T02:27:15.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.747+0000 7fcbaa7fc700 1 -- 172.21.15.19:0/4245693133 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4011670 con 0x7fcbac068db0 2024-08-17T02:27:15.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.751+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/4245693133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbac068db0 msgr2=0x7fcbac1557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.751+0000 7fcbb0cd4700 1 --2- 172.21.15.19:0/4245693133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbac068db0 0x7fcbac1557b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009e60 tx=0x7fcba4009780 comp rx=0 tx=0).stop 2024-08-17T02:27:15.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.751+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/4245693133 shutdown_connections 2024-08-17T02:27:15.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.751+0000 7fcbb0cd4700 1 --2- 172.21.15.19:0/4245693133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbac068db0 0x7fcbac1557b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.751+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/4245693133 >> 172.21.15.19:0/4245693133 conn(0x7fcbac06d800 msgr2=0x7fcbac06dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.751+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/4245693133 shutdown_connections 2024-08-17T02:27:15.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.751+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/4245693133 wait complete. 2024-08-17T02:27:15.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.751+0000 7fcbb0cd4700 1 Processor -- start 2024-08-17T02:27:15.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbb0cd4700 1 -- start start 2024-08-17T02:27:15.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbb0cd4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbac068db0 0x7fcbac158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbb0cd4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbac0af4d0 0x7fcbac0a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbb0cd4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbac1553e0 0x7fcbac168370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbb0cd4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac14eb60 con 0x7fcbac0af4d0 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbb0cd4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac1688b0 con 0x7fcbac1553e0 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbb0cd4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac156d20 con 0x7fcbac068db0 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbaaffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbac0af4d0 0x7fcbac0a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbaaffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbac0af4d0 0x7fcbac0a7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39700/0 (socket says 172.21.15.19:39700) 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbaaffd700 1 -- 172.21.15.19:0/837618515 learned_addr learned my addr 172.21.15.19:0/837618515 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbab7fe700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbac068db0 0x7fcbac158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbabfff700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbac1553e0 0x7fcbac168370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbaaffd700 1 -- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbac068db0 msgr2=0x7fcbac158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbaaffd700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbac068db0 0x7fcbac158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbaaffd700 1 -- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbac1553e0 msgr2=0x7fcbac168370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbaaffd700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbac1553e0 0x7fcbac168370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbaaffd700 1 -- 172.21.15.19:0/837618515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4009a20 con 0x7fcbac0af4d0 2024-08-17T02:27:15.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbaaffd700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbac0af4d0 0x7fcbac0a7700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c5c0 tx=0x7fcb9c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcb937fe700 1 -- 172.21.15.19:0/837618515 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c011590 con 0x7fcbac0af4d0 2024-08-17T02:27:15.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcb937fe700 1 -- 172.21.15.19:0/837618515 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c011710 con 0x7fcbac0af4d0 2024-08-17T02:27:15.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac168ae0 con 0x7fcbac0af4d0 2024-08-17T02:27:15.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcb937fe700 1 -- 172.21.15.19:0/837618515 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c011ad0 con 0x7fcbac0af4d0 2024-08-17T02:27:15.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.755+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac1690a0 con 0x7fcbac0af4d0 2024-08-17T02:27:15.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.759+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac156af0 con 0x7fcbac0af4d0 2024-08-17T02:27:15.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.759+0000 7fcb937fe700 1 -- 172.21.15.19:0/837618515 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcb9c01b3b0 con 0x7fcbac0af4d0 2024-08-17T02:27:15.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.759+0000 7fcb937fe700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcb98060860 0x7fcb98062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:15.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.759+0000 7fcb937fe700 1 -- 172.21.15.19:0/837618515 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb9c07c060 con 0x7fcbac0af4d0 2024-08-17T02:27:15.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.759+0000 7fcbab7fe700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcb98060860 0x7fcb98062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:15.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.763+0000 7fcbab7fe700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcb98060860 0x7fcb98062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007fd0 tx=0x7fcba0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.771+0000 7fcb937fe700 1 -- 172.21.15.19:0/837618515 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcbac156af0 con 0x7fcbac0af4d0 2024-08-17T02:27:15.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.935+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbac156af0 con 0x7fcbac0af4d0 2024-08-17T02:27:15.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.935+0000 7fcb937fe700 1 -- 172.21.15.19:0/837618515 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fcbac156af0 con 0x7fcbac0af4d0 2024-08-17T02:27:15.941 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:15.941 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:27:14.217890+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:11.122666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:11.570819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcb98060860 msgr2=0x7fcb98062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcb98060860 0x7fcb98062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007fd0 tx=0x7fcba0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbac0af4d0 msgr2=0x7fcbac0a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbac0af4d0 0x7fcbac0a7700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c5c0 tx=0x7fcb9c00c8d0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 shutdown_connections 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcb98060860 0x7fcb98062d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbac1553e0 0x7fcbac168370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbac0af4d0 0x7fcbac0a7700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 --2- 172.21.15.19:0/837618515 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbac068db0 0x7fcbac158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 >> 172.21.15.19:0/837618515 conn(0x7fcbac06d800 msgr2=0x7fcbac14f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:15.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 shutdown_connections 2024-08-17T02:27:15.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:15.939+0000 7fcbb0cd4700 1 -- 172.21.15.19:0/837618515 wait complete. 2024-08-17T02:27:15.955 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:27:15.956 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:16.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 Processor -- start 2024-08-17T02:27:16.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 -- start start 2024-08-17T02:27:16.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feefc0a9430 0x7feefc0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc0b0270 con 0x7feefc0af030 2024-08-17T02:27:16.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc0af660 con 0x7feefc15d540 2024-08-17T02:27:16.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0af940 con 0x7feefc0a9430 2024-08-17T02:27:16.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7feefb7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feefc0af030 0x7feefc0a8d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50672/0 (socket says 172.21.15.19:50672) 2024-08-17T02:27:16.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7feefb7fe700 1 -- 172.21.15.19:0/2635516031 learned_addr learned my addr 172.21.15.19:0/2635516031 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:16.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef009b0700 1 --2- 172.21.15.19:0/2635516031 >> v2:172.21.15.19:3300/0 conn(0x7feefc0a9430 0x7feefc0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7feefaffd700 1 -- 172.21.15.19:0/2635516031 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508642209 0 0) 0x7feefc0b0270 con 0x7feefc0af030 2024-08-17T02:27:16.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7feefaffd700 1 -- 172.21.15.19:0/2635516031 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee8003570 con 0x7feefc0af030 2024-08-17T02:27:16.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef009b0700 1 -- 172.21.15.19:0/2635516031 >> v1:172.21.15.119:6789/0 conn(0x7feefc15d540 legacy=0x7feefc06e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef009b0700 1 -- 172.21.15.19:0/2635516031 >> v1:172.21.15.19:6789/0 conn(0x7feefc0af030 legacy=0x7feefc0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef009b0700 1 -- 172.21.15.19:0/2635516031 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc0afc20 con 0x7feefc0a9430 2024-08-17T02:27:16.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef009b0700 1 --2- 172.21.15.19:0/2635516031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc0a9430 0x7feefc0b0700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feeec0098e0 tx=0x7feeec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a85a4a74dee0e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7feefaffd700 1 -- 172.21.15.19:0/2635516031 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00b640 con 0x7feefc0a9430 2024-08-17T02:27:16.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7feefaffd700 1 -- 172.21.15.19:0/2635516031 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec00b7a0 con 0x7feefc0a9430 2024-08-17T02:27:16.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7feefaffd700 1 -- 172.21.15.19:0/2635516031 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00bb40 con 0x7feefc0a9430 2024-08-17T02:27:16.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 -- 172.21.15.19:0/2635516031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc0a9430 msgr2=0x7feefc0b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 --2- 172.21.15.19:0/2635516031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc0a9430 0x7feefc0b0700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feeec0098e0 tx=0x7feeec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 -- 172.21.15.19:0/2635516031 shutdown_connections 2024-08-17T02:27:16.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 --2- 172.21.15.19:0/2635516031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc0a9430 0x7feefc0b0700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 -- 172.21.15.19:0/2635516031 >> 172.21.15.19:0/2635516031 conn(0x7feefc066e00 msgr2=0x7feefc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.055+0000 7fef02413700 1 -- 172.21.15.19:0/2635516031 shutdown_connections 2024-08-17T02:27:16.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef02413700 1 -- 172.21.15.19:0/2635516031 wait complete. 2024-08-17T02:27:16.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef02413700 1 Processor -- start 2024-08-17T02:27:16.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef02413700 1 -- start start 2024-08-17T02:27:16.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef02413700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc0a9430 0x7feefc0ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef02413700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feefc0af030 0x7feefc170a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef02413700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc15d540 0x7feefc170fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef02413700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0cad60 con 0x7feefc15d540 2024-08-17T02:27:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef02413700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0ad640 con 0x7feefc0a9430 2024-08-17T02:27:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef02413700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc16e790 con 0x7feefc0af030 2024-08-17T02:27:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef009b0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc15d540 0x7feefc170fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7feefbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc0a9430 0x7feefc0ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7feefb7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feefc0af030 0x7feefc170a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef009b0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc15d540 0x7feefc170fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39720/0 (socket says 172.21.15.19:39720) 2024-08-17T02:27:16.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef009b0700 1 -- 172.21.15.19:0/2572421183 learned_addr learned my addr 172.21.15.19:0/2572421183 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:16.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef009b0700 1 -- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feefc0af030 msgr2=0x7feefc170a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef009b0700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feefc0af030 0x7feefc170a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef009b0700 1 -- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc0a9430 msgr2=0x7feefc0ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef009b0700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc0a9430 0x7feefc0ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.059+0000 7fef009b0700 1 -- 172.21.15.19:0/2572421183 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec009420 con 0x7feefc15d540 2024-08-17T02:27:16.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.063+0000 7fef009b0700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc15d540 0x7feefc170fd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feefc06f870 tx=0x7feeec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.063+0000 7feef3fff700 1 -- 172.21.15.19:0/2572421183 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00bb20 con 0x7feefc15d540 2024-08-17T02:27:16.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.063+0000 7feef3fff700 1 -- 172.21.15.19:0/2572421183 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec011420 con 0x7feefc15d540 2024-08-17T02:27:16.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.063+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc16ea70 con 0x7feefc15d540 2024-08-17T02:27:16.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.063+0000 7feef3fff700 1 -- 172.21.15.19:0/2572421183 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec0117a0 con 0x7feefc15d540 2024-08-17T02:27:16.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.063+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc16f0b0 con 0x7feefc15d540 2024-08-17T02:27:16.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.063+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc0645c0 con 0x7feefc15d540 2024-08-17T02:27:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.063+0000 7feef3fff700 1 -- 172.21.15.19:0/2572421183 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7feeec011b10 con 0x7feefc15d540 2024-08-17T02:27:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.063+0000 7feef3fff700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feedc060860 0x7feedc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.067+0000 7feef3fff700 1 -- 172.21.15.19:0/2572421183 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feeec07e840 con 0x7feefc15d540 2024-08-17T02:27:16.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.067+0000 7feefbfff700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feedc060860 0x7feedc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.067+0000 7feefbfff700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feedc060860 0x7feedc062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feee40039e0 tx=0x7feee4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.071+0000 7feef3fff700 1 -- 172.21.15.19:0/2572421183 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7feeec04ebf0 con 0x7feefc15d540 2024-08-17T02:27:16.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.235+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feefc06f360 con 0x7feedc060860 2024-08-17T02:27:16.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.251+0000 7feef3fff700 1 -- 172.21.15.19:0/2572421183 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251478 (secure 0 0 0) 0x7feefc06f360 con 0x7feedc060860 2024-08-17T02:27:16.259 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:16.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feedc060860 msgr2=0x7feedc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feedc060860 0x7feedc062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feee40039e0 tx=0x7feee4007ec0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc15d540 msgr2=0x7feefc170fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc15d540 0x7feefc170fd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feefc06f870 tx=0x7feeec017000 comp rx=0 tx=0).stop 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 shutdown_connections 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feedc060860 0x7feedc062d10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feefc15d540 0x7feefc170fd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feefc0af030 0x7feefc170a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 --2- 172.21.15.19:0/2572421183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feefc0a9430 0x7feefc0ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 >> 172.21.15.19:0/2572421183 conn(0x7feefc066e00 msgr2=0x7feefc098a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 shutdown_connections 2024-08-17T02:27:16.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.255+0000 7fef02413700 1 -- 172.21.15.19:0/2572421183 wait complete. 2024-08-17T02:27:16.262 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:27:16.279 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:27:14.777528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":28,"acting":28,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2382556,"kb_used_data":3648,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592164,"statfs":{"total":773094113280,"available":770654375936,"internally_reserved":0,"allocated":3735552,"data_stored":2116802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001220"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210810+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.205692+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:34.090013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211068+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.212093+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:14.425624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.212127+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.443496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210117+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211946+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:24.605432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210266+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210944+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209802+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209552+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:46.783236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209126+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:18:29.290649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211891+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:21.538305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-17T02:27:06.379283+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:27:06.379283+0000","last_peered":"2024-08-17T02:27:06.379283+0000","last_clean":"2024-08-17T02:27:06.379283+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:27:06.379283+0000","last_undegraded":"2024-08-17T02:27:06.379283+0000","last_fullsized":"2024-08-17T02:27:06.379283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":327680,"data_stored":121362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":327680,"data_stored":121362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":909312,"data_stored":705925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297664,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074176,"statfs":{"total":96636764160,"available":96331956224,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297680,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297684,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298248,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073592,"statfs":{"total":96636764160,"available":96331358208,"internally_reserved":0,"allocated":909312,"data_stored":705925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:16.283 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1c7e5700 1 Processor -- start 2024-08-17T02:27:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1c7e5700 1 -- start start 2024-08-17T02:27:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1c7e5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a140aa5f0 0x7f3a1406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1c7e5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 0x7f3a1406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1c7e5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140afc10 con 0x7f3a14155e50 2024-08-17T02:27:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1c7e5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140b10b0 con 0x7f3a140aa5f0 2024-08-17T02:27:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1c7e5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140aed20 con 0x7f3a14156220 2024-08-17T02:27:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1a581700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3a14155e50 0x7f3a140a9ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50680/0 (socket says 172.21.15.19:50680) 2024-08-17T02:27:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a19d80700 1 --2- 172.21.15.19:0/2681115325 >> v2:172.21.15.19:3300/0 conn(0x7f3a140aa5f0 0x7f3a1406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1a581700 1 -- 172.21.15.19:0/2681115325 learned_addr learned my addr 172.21.15.19:0/2681115325 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1ad82700 1 --2- 172.21.15.19:0/2681115325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 0x7f3a1406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1957f700 1 -- 172.21.15.19:0/2681115325 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223460418 0 0) 0x7f3a140afc10 con 0x7f3a14155e50 2024-08-17T02:27:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1957f700 1 -- 172.21.15.19:0/2681115325 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a00003570 con 0x7f3a14155e50 2024-08-17T02:27:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1957f700 1 -- 172.21.15.19:0/2681115325 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4102619482 0 0) 0x7f3a00003570 con 0x7f3a14155e50 2024-08-17T02:27:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a19d80700 1 -- 172.21.15.19:0/2681115325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 msgr2=0x7f3a1406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a19d80700 1 --2- 172.21.15.19:0/2681115325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 0x7f3a1406f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a19d80700 1 -- 172.21.15.19:0/2681115325 >> v1:172.21.15.19:6789/0 conn(0x7f3a14155e50 legacy=0x7f3a140a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a19d80700 1 -- 172.21.15.19:0/2681115325 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140af000 con 0x7f3a140aa5f0 2024-08-17T02:27:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a1ad82700 1 --2- 172.21.15.19:0/2681115325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 0x7f3a1406f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.387+0000 7f3a19d80700 1 --2- 172.21.15.19:0/2681115325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 0x7f3a1406ebe0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009e60 tx=0x7f3a10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14ed40d174fbc6a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1957f700 1 -- 172.21.15.19:0/2681115325 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000e070 con 0x7f3a140aa5f0 2024-08-17T02:27:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1957f700 1 -- 172.21.15.19:0/2681115325 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1000b7a0 con 0x7f3a140aa5f0 2024-08-17T02:27:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1957f700 1 -- 172.21.15.19:0/2681115325 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04001470 con 0x7f3a140aa5f0 2024-08-17T02:27:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/2681115325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 msgr2=0x7f3a1406ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 --2- 172.21.15.19:0/2681115325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 0x7f3a1406ebe0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009e60 tx=0x7f3a10009780 comp rx=0 tx=0).stop 2024-08-17T02:27:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/2681115325 shutdown_connections 2024-08-17T02:27:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 --2- 172.21.15.19:0/2681115325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 0x7f3a1406f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 --2- 172.21.15.19:0/2681115325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 0x7f3a1406ebe0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/2681115325 >> 172.21.15.19:0/2681115325 conn(0x7f3a14066e00 msgr2=0x7f3a14067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/2681115325 shutdown_connections 2024-08-17T02:27:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/2681115325 wait complete. 2024-08-17T02:27:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 Processor -- start 2024-08-17T02:27:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.391+0000 7f3a1c7e5700 1 -- start start 2024-08-17T02:27:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1c7e5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 0x7f3a14067400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1c7e5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14155e50 0x7f3a140988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1c7e5700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 0x7f3a14098e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1c7e5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14097d10 con 0x7f3a140aa5f0 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1c7e5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140c83a0 con 0x7f3a14155e50 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1c7e5700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140994c0 con 0x7f3a14156220 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1a581700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 0x7f3a14067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1a581700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 0x7f3a14067400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39738/0 (socket says 172.21.15.19:39738) 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1a581700 1 -- 172.21.15.19:0/1405713574 learned_addr learned my addr 172.21.15.19:0/1405713574 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a19d80700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14155e50 0x7f3a140988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1ad82700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 0x7f3a14098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1a581700 1 -- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 msgr2=0x7f3a14098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1a581700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 0x7f3a14098e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1a581700 1 -- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14155e50 msgr2=0x7f3a140988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1a581700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14155e50 0x7f3a140988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1a581700 1 -- 172.21.15.19:0/1405713574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c009420 con 0x7f3a140aa5f0 2024-08-17T02:27:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1a581700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 0x7f3a14067400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400eb70 tx=0x7f3a04001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a0a7fc700 1 -- 172.21.15.19:0/1405713574 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04007360 con 0x7f3a140aa5f0 2024-08-17T02:27:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a0a7fc700 1 -- 172.21.15.19:0/1405713574 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a040074e0 con 0x7f3a140aa5f0 2024-08-17T02:27:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a10009a20 con 0x7f3a140aa5f0 2024-08-17T02:27:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a0a7fc700 1 -- 172.21.15.19:0/1405713574 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400c8b0 con 0x7f3a140aa5f0 2024-08-17T02:27:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.395+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a140c8660 con 0x7f3a140aa5f0 2024-08-17T02:27:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.399+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a140645c0 con 0x7f3a140aa5f0 2024-08-17T02:27:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.399+0000 7f3a0a7fc700 1 -- 172.21.15.19:0/1405713574 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3a0400cc80 con 0x7f3a140aa5f0 2024-08-17T02:27:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.399+0000 7f3a0a7fc700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39f8060860 0x7f39f8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.399+0000 7f3a0a7fc700 1 -- 172.21.15.19:0/1405713574 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a0407f370 con 0x7f3a140aa5f0 2024-08-17T02:27:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.399+0000 7f3a19d80700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39f8060860 0x7f39f8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.399+0000 7f3a19d80700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39f8060860 0x7f39f8062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a140aa9c0 tx=0x7f3a10018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.403+0000 7f3a0a7fc700 1 -- 172.21.15.19:0/1405713574 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3a0404f840 con 0x7f3a140aa5f0 2024-08-17T02:27:16.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.567+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a140ae670 con 0x7f39f8060860 2024-08-17T02:27:16.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.583+0000 7f3a0a7fc700 1 -- 172.21.15.19:0/1405713574 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251478 (secure 0 0 0) 0x7f3a140ae670 con 0x7f39f8060860 2024-08-17T02:27:16.591 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39f8060860 msgr2=0x7f39f8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39f8060860 0x7f39f8062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a140aa9c0 tx=0x7f3a10018000 comp rx=0 tx=0).stop 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 msgr2=0x7f3a14067400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 0x7f3a14067400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400eb70 tx=0x7f3a04001b80 comp rx=0 tx=0).stop 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 shutdown_connections 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39f8060860 0x7f39f8062d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a14156220 0x7f3a14098e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a14155e50 0x7f3a140988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 --2- 172.21.15.19:0/1405713574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a140aa5f0 0x7f3a14067400 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 >> 172.21.15.19:0/1405713574 conn(0x7f3a14066e00 msgr2=0x7f3a140add70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 shutdown_connections 2024-08-17T02:27:16.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.587+0000 7f3a1c7e5700 1 -- 172.21.15.19:0/1405713574 wait complete. 2024-08-17T02:27:16.594 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:27:16.606 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:27:14.777528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":28,"acting":28,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":2382556,"kb_used_data":3648,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592164,"statfs":{"total":773094113280,"available":770654375936,"internally_reserved":0,"allocated":3735552,"data_stored":2116802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001220"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210810+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.205692+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:34.090013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211068+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.212093+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:14.425624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.212127+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.443496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210117+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211946+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:24.605432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210266+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210944+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209802+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209552+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:46.783236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209126+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:18:29.290649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211891+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:21.538305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.190380+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-08-17T02:27:06.379283+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:27:06.379283+0000","last_peered":"2024-08-17T02:27:06.379283+0000","last_clean":"2024-08-17T02:27:06.379283+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:27:06.379283+0000","last_undegraded":"2024-08-17T02:27:06.379283+0000","last_fullsized":"2024-08-17T02:27:06.379283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":327680,"data_stored":121362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":327680,"data_stored":121362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298252,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073588,"statfs":{"total":96636764160,"available":96331354112,"internally_reserved":0,"allocated":909312,"data_stored":705925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297664,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074176,"statfs":{"total":96636764160,"available":96331956224,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297680,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297684,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298248,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073592,"statfs":{"total":96636764160,"available":96331358208,"internally_reserved":0,"allocated":909312,"data_stored":705925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:16.610 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea4c9cc700 1 Processor -- start 2024-08-17T02:27:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea4c9cc700 1 -- start start 2024-08-17T02:27:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea4c9cc700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fea480b30f0 0x7fea480b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea4c9cc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fea480b0120 0x7fea481569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea4c9cc700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea480ae9b0 con 0x7fea480afca0 2024-08-17T02:27:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea4c9cc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480b1070 con 0x7fea480b0120 2024-08-17T02:27:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea4c9cc700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea480af810 con 0x7fea480b30f0 2024-08-17T02:27:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea47fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fea480b0120 0x7fea481569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea477fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fea480b30f0 0x7fea480b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea47fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fea480b0120 0x7fea481569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39746/0 (socket says 172.21.15.19:39746) 2024-08-17T02:27:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea47fff700 1 -- 172.21.15.19:0/3213270686 learned_addr learned my addr 172.21.15.19:0/3213270686 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea47fff700 1 -- 172.21.15.19:0/3213270686 >> v2:172.21.15.119:3300/0 conn(0x7fea480b30f0 msgr2=0x7fea480b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea47fff700 1 --2- 172.21.15.19:0/3213270686 >> v2:172.21.15.119:3300/0 conn(0x7fea480b30f0 0x7fea480b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea47fff700 1 -- 172.21.15.19:0/3213270686 >> v1:172.21.15.119:6789/0 conn(0x7fea480afca0 legacy=0x7fea480b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea47fff700 1 -- 172.21.15.19:0/3213270686 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea480aec00 con 0x7fea480b0120 2024-08-17T02:27:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.719+0000 7fea47fff700 1 --2- 172.21.15.19:0/3213270686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b0120 0x7fea481569b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fea4806e360 tx=0x7fea40009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdba2063b699c6a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea467fc700 1 -- 172.21.15.19:0/3213270686 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4000e070 con 0x7fea480b0120 2024-08-17T02:27:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea467fc700 1 -- 172.21.15.19:0/3213270686 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4000ba20 con 0x7fea480b0120 2024-08-17T02:27:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea467fc700 1 -- 172.21.15.19:0/3213270686 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea400092e0 con 0x7fea480b0120 2024-08-17T02:27:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 -- 172.21.15.19:0/3213270686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b0120 msgr2=0x7fea481569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 --2- 172.21.15.19:0/3213270686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b0120 0x7fea481569b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fea4806e360 tx=0x7fea40009840 comp rx=0 tx=0).stop 2024-08-17T02:27:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 -- 172.21.15.19:0/3213270686 shutdown_connections 2024-08-17T02:27:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 --2- 172.21.15.19:0/3213270686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b0120 0x7fea481569b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 --2- 172.21.15.19:0/3213270686 >> v2:172.21.15.119:3300/0 conn(0x7fea480b30f0 0x7fea480b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 -- 172.21.15.19:0/3213270686 >> 172.21.15.19:0/3213270686 conn(0x7fea480cdeb0 msgr2=0x7fea480ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 -- 172.21.15.19:0/3213270686 shutdown_connections 2024-08-17T02:27:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 -- 172.21.15.19:0/3213270686 wait complete. 2024-08-17T02:27:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 Processor -- start 2024-08-17T02:27:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.723+0000 7fea4c9cc700 1 -- start start 2024-08-17T02:27:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea4c9cc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea480afca0 0x7fea48153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea4c9cc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea480b0120 0x7fea48167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea4c9cc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b30f0 0x7fea48145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea4c9cc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea48168230 con 0x7fea480b30f0 2024-08-17T02:27:16.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea4c9cc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4815c140 con 0x7fea480afca0 2024-08-17T02:27:16.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea4c9cc700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea48145e50 con 0x7fea480b0120 2024-08-17T02:27:16.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea47fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b30f0 0x7fea48145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea47fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b30f0 0x7fea48145910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39760/0 (socket says 172.21.15.19:39760) 2024-08-17T02:27:16.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea47fff700 1 -- 172.21.15.19:0/1563517310 learned_addr learned my addr 172.21.15.19:0/1563517310 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:16.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea46ffd700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea480b0120 0x7fea48167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea477fe700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea480afca0 0x7fea48153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea47fff700 1 -- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea480b0120 msgr2=0x7fea48167cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea47fff700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea480b0120 0x7fea48167cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea47fff700 1 -- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea480afca0 msgr2=0x7fea48153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea47fff700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea480afca0 0x7fea48153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea47fff700 1 -- 172.21.15.19:0/1563517310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40009ae0 con 0x7fea480b30f0 2024-08-17T02:27:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea477fe700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea480afca0 0x7fea48153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea47fff700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b30f0 0x7fea48145910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fea40009880 tx=0x7fea40018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea2f7fe700 1 -- 172.21.15.19:0/1563517310 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40008b30 con 0x7fea480b30f0 2024-08-17T02:27:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea2f7fe700 1 -- 172.21.15.19:0/1563517310 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40008c90 con 0x7fea480b30f0 2024-08-17T02:27:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4815bb80 con 0x7fea480b30f0 2024-08-17T02:27:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea2f7fe700 1 -- 172.21.15.19:0/1563517310 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea400266b0 con 0x7fea480b30f0 2024-08-17T02:27:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.727+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4815c500 con 0x7fea480b30f0 2024-08-17T02:27:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.731+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea480638f0 con 0x7fea480b30f0 2024-08-17T02:27:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.731+0000 7fea2f7fe700 1 -- 172.21.15.19:0/1563517310 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fea40003040 con 0x7fea480b30f0 2024-08-17T02:27:16.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.731+0000 7fea2f7fe700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fea34060860 0x7fea34062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:16.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.731+0000 7fea2f7fe700 1 -- 172.21.15.19:0/1563517310 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea4007e9d0 con 0x7fea480b30f0 2024-08-17T02:27:16.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.731+0000 7fea477fe700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fea34060860 0x7fea34062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:16.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.731+0000 7fea477fe700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fea34060860 0x7fea34062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fea38009ce0 tx=0x7fea38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.743+0000 7fea2f7fe700 1 -- 172.21.15.19:0/1563517310 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fea4004ee20 con 0x7fea480b30f0 2024-08-17T02:27:16.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.903+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea480ae760 con 0x7fea34060860 2024-08-17T02:27:16.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.923+0000 7fea2f7fe700 1 -- 172.21.15.19:0/1563517310 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260299 (secure 0 0 0) 0x7fea480ae760 con 0x7fea34060860 2024-08-17T02:27:16.930 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:16.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fea34060860 msgr2=0x7fea34062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fea34060860 0x7fea34062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fea38009ce0 tx=0x7fea38008040 comp rx=0 tx=0).stop 2024-08-17T02:27:16.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b30f0 msgr2=0x7fea48145910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:16.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b30f0 0x7fea48145910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fea40009880 tx=0x7fea40018000 comp rx=0 tx=0).stop 2024-08-17T02:27:16.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 shutdown_connections 2024-08-17T02:27:16.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fea34060860 0x7fea34062d10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea480b30f0 0x7fea48145910 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea480b0120 0x7fea48167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 --2- 172.21.15.19:0/1563517310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea480afca0 0x7fea48153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:16.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 >> 172.21.15.19:0/1563517310 conn(0x7fea480cdeb0 msgr2=0x7fea480cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:16.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 shutdown_connections 2024-08-17T02:27:16.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:16.927+0000 7fea4c9cc700 1 -- 172.21.15.19:0/1563517310 wait complete. 2024-08-17T02:27:16.933 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:27:16.946 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-08-17T02:27:16.778196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":142,"acting":142,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382784,"kb_used_data":3916,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591936,"statfs":{"total":773094113280,"available":770654142464,"internally_reserved":0,"allocated":4009984,"data_stored":2243815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.574833"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.246907+0000","last_change":"2024-08-17T02:27:13.242833+0000","last_active":"2024-08-17T02:27:13.246907+0000","last_peered":"2024-08-17T02:27:13.246907+0000","last_clean":"2024-08-17T02:27:13.246907+0000","last_became_active":"2024-08-17T02:27:13.242536+0000","last_became_peered":"2024-08-17T02:27:13.242536+0000","last_unstale":"2024-08-17T02:27:13.246907+0000","last_undegraded":"2024-08-17T02:27:13.246907+0000","last_fullsized":"2024-08-17T02:27:13.246907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:29.067933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241762+0000","last_change":"2024-08-17T02:27:13.239546+0000","last_active":"2024-08-17T02:27:13.241762+0000","last_peered":"2024-08-17T02:27:13.241762+0000","last_clean":"2024-08-17T02:27:13.241762+0000","last_became_active":"2024-08-17T02:27:13.239284+0000","last_became_peered":"2024-08-17T02:27:13.239284+0000","last_unstale":"2024-08-17T02:27:13.241762+0000","last_undegraded":"2024-08-17T02:27:13.241762+0000","last_fullsized":"2024-08-17T02:27:13.241762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:23.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252216+0000","last_change":"2024-08-17T02:27:13.248893+0000","last_active":"2024-08-17T02:27:13.252216+0000","last_peered":"2024-08-17T02:27:13.252216+0000","last_clean":"2024-08-17T02:27:13.252216+0000","last_became_active":"2024-08-17T02:27:13.248603+0000","last_became_peered":"2024-08-17T02:27:13.248603+0000","last_unstale":"2024-08-17T02:27:13.252216+0000","last_undegraded":"2024-08-17T02:27:13.252216+0000","last_fullsized":"2024-08-17T02:27:13.252216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:42.696716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252379+0000","last_change":"2024-08-17T02:27:13.250161+0000","last_active":"2024-08-17T02:27:13.252379+0000","last_peered":"2024-08-17T02:27:13.252379+0000","last_clean":"2024-08-17T02:27:13.252379+0000","last_became_active":"2024-08-17T02:27:13.249894+0000","last_became_peered":"2024-08-17T02:27:13.249894+0000","last_unstale":"2024-08-17T02:27:13.252379+0000","last_undegraded":"2024-08-17T02:27:13.252379+0000","last_fullsized":"2024-08-17T02:27:13.252379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:23.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.243849+0000","last_change":"2024-08-17T02:27:13.241659+0000","last_active":"2024-08-17T02:27:13.243849+0000","last_peered":"2024-08-17T02:27:13.243849+0000","last_clean":"2024-08-17T02:27:13.243849+0000","last_became_active":"2024-08-17T02:27:13.241320+0000","last_became_peered":"2024-08-17T02:27:13.241320+0000","last_unstale":"2024-08-17T02:27:13.243849+0000","last_undegraded":"2024-08-17T02:27:13.243849+0000","last_fullsized":"2024-08-17T02:27:13.243849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:15:11.517561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.251963+0000","last_change":"2024-08-17T02:27:13.247943+0000","last_active":"2024-08-17T02:27:13.251963+0000","last_peered":"2024-08-17T02:27:13.251963+0000","last_clean":"2024-08-17T02:27:13.251963+0000","last_became_active":"2024-08-17T02:27:13.246153+0000","last_became_peered":"2024-08-17T02:27:13.246153+0000","last_unstale":"2024-08-17T02:27:13.251963+0000","last_undegraded":"2024-08-17T02:27:13.251963+0000","last_fullsized":"2024-08-17T02:27:13.251963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:58.769663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249519+0000","last_change":"2024-08-17T02:27:13.245414+0000","last_active":"2024-08-17T02:27:13.249519+0000","last_peered":"2024-08-17T02:27:13.249519+0000","last_clean":"2024-08-17T02:27:13.249519+0000","last_became_active":"2024-08-17T02:27:13.245109+0000","last_became_peered":"2024-08-17T02:27:13.245109+0000","last_unstale":"2024-08-17T02:27:13.249519+0000","last_undegraded":"2024-08-17T02:27:13.249519+0000","last_fullsized":"2024-08-17T02:27:13.249519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:12.139471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249626+0000","last_change":"2024-08-17T02:27:13.245575+0000","last_active":"2024-08-17T02:27:13.249626+0000","last_peered":"2024-08-17T02:27:13.249626+0000","last_clean":"2024-08-17T02:27:13.249626+0000","last_became_active":"2024-08-17T02:27:13.245306+0000","last_became_peered":"2024-08-17T02:27:13.245306+0000","last_unstale":"2024-08-17T02:27:13.249626+0000","last_undegraded":"2024-08-17T02:27:13.249626+0000","last_fullsized":"2024-08-17T02:27:13.249626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:49.380480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249384+0000","last_change":"2024-08-17T02:27:13.245904+0000","last_active":"2024-08-17T02:27:13.249384+0000","last_peered":"2024-08-17T02:27:13.249384+0000","last_clean":"2024-08-17T02:27:13.249384+0000","last_became_active":"2024-08-17T02:27:13.245626+0000","last_became_peered":"2024-08-17T02:27:13.245626+0000","last_unstale":"2024-08-17T02:27:13.249384+0000","last_undegraded":"2024-08-17T02:27:13.249384+0000","last_fullsized":"2024-08-17T02:27:13.249384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:43.344644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249136+0000","last_change":"2024-08-17T02:27:13.245033+0000","last_active":"2024-08-17T02:27:13.249136+0000","last_peered":"2024-08-17T02:27:13.249136+0000","last_clean":"2024-08-17T02:27:13.249136+0000","last_became_active":"2024-08-17T02:27:13.243797+0000","last_became_peered":"2024-08-17T02:27:13.243797+0000","last_unstale":"2024-08-17T02:27:13.249136+0000","last_undegraded":"2024-08-17T02:27:13.249136+0000","last_fullsized":"2024-08-17T02:27:13.249136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:25:02.364249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.242621+0000","last_change":"2024-08-17T02:27:13.236176+0000","last_active":"2024-08-17T02:27:13.242621+0000","last_peered":"2024-08-17T02:27:13.242621+0000","last_clean":"2024-08-17T02:27:13.242621+0000","last_became_active":"2024-08-17T02:27:13.235912+0000","last_became_peered":"2024-08-17T02:27:13.235912+0000","last_unstale":"2024-08-17T02:27:13.242621+0000","last_undegraded":"2024-08-17T02:27:13.242621+0000","last_fullsized":"2024-08-17T02:27:13.242621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:06.659613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249346+0000","last_change":"2024-08-17T02:27:13.244677+0000","last_active":"2024-08-17T02:27:13.249346+0000","last_peered":"2024-08-17T02:27:13.249346+0000","last_clean":"2024-08-17T02:27:13.249346+0000","last_became_active":"2024-08-17T02:27:13.244354+0000","last_became_peered":"2024-08-17T02:27:13.244354+0000","last_unstale":"2024-08-17T02:27:13.249346+0000","last_undegraded":"2024-08-17T02:27:13.249346+0000","last_fullsized":"2024-08-17T02:27:13.249346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:58:59.215561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247620+0000","last_change":"2024-08-17T02:27:13.242670+0000","last_active":"2024-08-17T02:27:13.247620+0000","last_peered":"2024-08-17T02:27:13.247620+0000","last_clean":"2024-08-17T02:27:13.247620+0000","last_became_active":"2024-08-17T02:27:13.242369+0000","last_became_peered":"2024-08-17T02:27:13.242369+0000","last_unstale":"2024-08-17T02:27:13.247620+0000","last_undegraded":"2024-08-17T02:27:13.247620+0000","last_fullsized":"2024-08-17T02:27:13.247620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:04.981661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241415+0000","last_change":"2024-08-17T02:27:13.238335+0000","last_active":"2024-08-17T02:27:13.241415+0000","last_peered":"2024-08-17T02:27:13.241415+0000","last_clean":"2024-08-17T02:27:13.241415+0000","last_became_active":"2024-08-17T02:27:13.238034+0000","last_became_peered":"2024-08-17T02:27:13.238034+0000","last_unstale":"2024-08-17T02:27:13.241415+0000","last_undegraded":"2024-08-17T02:27:13.241415+0000","last_fullsized":"2024-08-17T02:27:13.241415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:59.482871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.242073+0000","last_change":"2024-08-17T02:27:13.235368+0000","last_active":"2024-08-17T02:27:13.242073+0000","last_peered":"2024-08-17T02:27:13.242073+0000","last_clean":"2024-08-17T02:27:13.242073+0000","last_became_active":"2024-08-17T02:27:13.235056+0000","last_became_peered":"2024-08-17T02:27:13.235056+0000","last_unstale":"2024-08-17T02:27:13.242073+0000","last_undegraded":"2024-08-17T02:27:13.242073+0000","last_fullsized":"2024-08-17T02:27:13.242073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:35.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249387+0000","last_change":"2024-08-17T02:27:13.244838+0000","last_active":"2024-08-17T02:27:13.249387+0000","last_peered":"2024-08-17T02:27:13.249387+0000","last_clean":"2024-08-17T02:27:13.249387+0000","last_became_active":"2024-08-17T02:27:13.244506+0000","last_became_peered":"2024-08-17T02:27:13.244506+0000","last_unstale":"2024-08-17T02:27:13.249387+0000","last_undegraded":"2024-08-17T02:27:13.249387+0000","last_fullsized":"2024-08-17T02:27:13.249387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:59.482871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249298+0000","last_change":"2024-08-17T02:27:13.245329+0000","last_active":"2024-08-17T02:27:13.249298+0000","last_peered":"2024-08-17T02:27:13.249298+0000","last_clean":"2024-08-17T02:27:13.249298+0000","last_became_active":"2024-08-17T02:27:13.243920+0000","last_became_peered":"2024-08-17T02:27:13.243920+0000","last_unstale":"2024-08-17T02:27:13.249298+0000","last_undegraded":"2024-08-17T02:27:13.249298+0000","last_fullsized":"2024-08-17T02:27:13.249298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:59.482871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249681+0000","last_change":"2024-08-17T02:27:13.245374+0000","last_active":"2024-08-17T02:27:13.249681+0000","last_peered":"2024-08-17T02:27:13.249681+0000","last_clean":"2024-08-17T02:27:13.249681+0000","last_became_active":"2024-08-17T02:27:13.245113+0000","last_became_peered":"2024-08-17T02:27:13.245113+0000","last_unstale":"2024-08-17T02:27:13.249681+0000","last_undegraded":"2024-08-17T02:27:13.249681+0000","last_fullsized":"2024-08-17T02:27:13.249681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:32.120060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249364+0000","last_change":"2024-08-17T02:27:13.245331+0000","last_active":"2024-08-17T02:27:13.249364+0000","last_peered":"2024-08-17T02:27:13.249364+0000","last_clean":"2024-08-17T02:27:13.249364+0000","last_became_active":"2024-08-17T02:27:13.243905+0000","last_became_peered":"2024-08-17T02:27:13.243905+0000","last_unstale":"2024-08-17T02:27:13.249364+0000","last_undegraded":"2024-08-17T02:27:13.249364+0000","last_fullsized":"2024-08-17T02:27:13.249364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:07.371281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247590+0000","last_change":"2024-08-17T02:27:13.242465+0000","last_active":"2024-08-17T02:27:13.247590+0000","last_peered":"2024-08-17T02:27:13.247590+0000","last_clean":"2024-08-17T02:27:13.247590+0000","last_became_active":"2024-08-17T02:27:13.242159+0000","last_became_peered":"2024-08-17T02:27:13.242159+0000","last_unstale":"2024-08-17T02:27:13.247590+0000","last_undegraded":"2024-08-17T02:27:13.247590+0000","last_fullsized":"2024-08-17T02:27:13.247590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:32.120060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265274+0000","last_change":"2024-08-17T02:27:12.239872+0000","last_active":"2024-08-17T02:27:13.265274+0000","last_peered":"2024-08-17T02:27:13.265274+0000","last_clean":"2024-08-17T02:27:13.265274+0000","last_became_active":"2024-08-17T02:27:12.239546+0000","last_became_peered":"2024-08-17T02:27:12.239546+0000","last_unstale":"2024-08-17T02:27:13.265274+0000","last_undegraded":"2024-08-17T02:27:13.265274+0000","last_fullsized":"2024-08-17T02:27:13.265274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:52.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.246884+0000","last_change":"2024-08-17T02:27:13.240993+0000","last_active":"2024-08-17T02:27:13.246884+0000","last_peered":"2024-08-17T02:27:13.246884+0000","last_clean":"2024-08-17T02:27:13.246884+0000","last_became_active":"2024-08-17T02:27:13.240684+0000","last_became_peered":"2024-08-17T02:27:13.240684+0000","last_unstale":"2024-08-17T02:27:13.246884+0000","last_undegraded":"2024-08-17T02:27:13.246884+0000","last_fullsized":"2024-08-17T02:27:13.246884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:53.348532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.262636+0000","last_change":"2024-08-17T02:27:12.239317+0000","last_active":"2024-08-17T02:27:13.262636+0000","last_peered":"2024-08-17T02:27:13.262636+0000","last_clean":"2024-08-17T02:27:13.262636+0000","last_became_active":"2024-08-17T02:27:12.238976+0000","last_became_peered":"2024-08-17T02:27:12.238976+0000","last_unstale":"2024-08-17T02:27:13.262636+0000","last_undegraded":"2024-08-17T02:27:13.262636+0000","last_fullsized":"2024-08-17T02:27:13.262636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:49:23.095686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.243790+0000","last_change":"2024-08-17T02:27:13.240138+0000","last_active":"2024-08-17T02:27:13.243790+0000","last_peered":"2024-08-17T02:27:13.243790+0000","last_clean":"2024-08-17T02:27:13.243790+0000","last_became_active":"2024-08-17T02:27:13.239834+0000","last_became_peered":"2024-08-17T02:27:13.239834+0000","last_unstale":"2024-08-17T02:27:13.243790+0000","last_undegraded":"2024-08-17T02:27:13.243790+0000","last_fullsized":"2024-08-17T02:27:13.243790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:25:02.364249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210810+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.205692+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:34.090013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.251917+0000","last_change":"2024-08-17T02:27:13.246559+0000","last_active":"2024-08-17T02:27:13.251917+0000","last_peered":"2024-08-17T02:27:13.251917+0000","last_clean":"2024-08-17T02:27:13.251917+0000","last_became_active":"2024-08-17T02:27:13.246190+0000","last_became_peered":"2024-08-17T02:27:13.246190+0000","last_unstale":"2024-08-17T02:27:13.251917+0000","last_undegraded":"2024-08-17T02:27:13.251917+0000","last_fullsized":"2024-08-17T02:27:13.251917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:06.659613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.264719+0000","last_change":"2024-08-17T02:27:12.242600+0000","last_active":"2024-08-17T02:27:13.264719+0000","last_peered":"2024-08-17T02:27:13.264719+0000","last_clean":"2024-08-17T02:27:13.264719+0000","last_became_active":"2024-08-17T02:27:12.242068+0000","last_became_peered":"2024-08-17T02:27:12.242068+0000","last_unstale":"2024-08-17T02:27:13.264719+0000","last_undegraded":"2024-08-17T02:27:13.264719+0000","last_fullsized":"2024-08-17T02:27:13.264719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:52.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241468+0000","last_change":"2024-08-17T02:27:13.236477+0000","last_active":"2024-08-17T02:27:13.241468+0000","last_peered":"2024-08-17T02:27:13.241468+0000","last_clean":"2024-08-17T02:27:13.241468+0000","last_became_active":"2024-08-17T02:27:13.236212+0000","last_became_peered":"2024-08-17T02:27:13.236212+0000","last_unstale":"2024-08-17T02:27:13.241468+0000","last_undegraded":"2024-08-17T02:27:13.241468+0000","last_fullsized":"2024-08-17T02:27:13.241468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:58.769663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265009+0000","last_change":"2024-08-17T02:27:12.242373+0000","last_active":"2024-08-17T02:27:13.265009+0000","last_peered":"2024-08-17T02:27:13.265009+0000","last_clean":"2024-08-17T02:27:13.265009+0000","last_became_active":"2024-08-17T02:27:12.242025+0000","last_became_peered":"2024-08-17T02:27:12.242025+0000","last_unstale":"2024-08-17T02:27:13.265009+0000","last_undegraded":"2024-08-17T02:27:13.265009+0000","last_fullsized":"2024-08-17T02:27:13.265009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:11.084442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247571+0000","last_change":"2024-08-17T02:27:13.242571+0000","last_active":"2024-08-17T02:27:13.247571+0000","last_peered":"2024-08-17T02:27:13.247571+0000","last_clean":"2024-08-17T02:27:13.247571+0000","last_became_active":"2024-08-17T02:27:13.242310+0000","last_became_peered":"2024-08-17T02:27:13.242310+0000","last_unstale":"2024-08-17T02:27:13.247571+0000","last_undegraded":"2024-08-17T02:27:13.247571+0000","last_fullsized":"2024-08-17T02:27:13.247571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:42.696716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211068+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.230122+0000","last_change":"2024-08-17T02:27:12.236935+0000","last_active":"2024-08-17T02:27:13.230122+0000","last_peered":"2024-08-17T02:27:13.230122+0000","last_clean":"2024-08-17T02:27:13.230122+0000","last_became_active":"2024-08-17T02:27:12.236487+0000","last_became_peered":"2024-08-17T02:27:12.236487+0000","last_unstale":"2024-08-17T02:27:13.230122+0000","last_undegraded":"2024-08-17T02:27:13.230122+0000","last_fullsized":"2024-08-17T02:27:13.230122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:30.698821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247416+0000","last_change":"2024-08-17T02:27:13.242591+0000","last_active":"2024-08-17T02:27:13.247416+0000","last_peered":"2024-08-17T02:27:13.247416+0000","last_clean":"2024-08-17T02:27:13.247416+0000","last_became_active":"2024-08-17T02:27:13.242329+0000","last_became_peered":"2024-08-17T02:27:13.242329+0000","last_unstale":"2024-08-17T02:27:13.247416+0000","last_undegraded":"2024-08-17T02:27:13.247416+0000","last_fullsized":"2024-08-17T02:27:13.247416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:43.344644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.212093+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:14.425624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.223731+0000","last_change":"2024-08-17T02:27:12.236563+0000","last_active":"2024-08-17T02:27:13.223731+0000","last_peered":"2024-08-17T02:27:13.223731+0000","last_clean":"2024-08-17T02:27:13.223731+0000","last_became_active":"2024-08-17T02:27:12.235239+0000","last_became_peered":"2024-08-17T02:27:12.235239+0000","last_unstale":"2024-08-17T02:27:13.223731+0000","last_undegraded":"2024-08-17T02:27:13.223731+0000","last_fullsized":"2024-08-17T02:27:13.223731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:38.943779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265025+0000","last_change":"2024-08-17T02:27:12.241247+0000","last_active":"2024-08-17T02:27:13.265025+0000","last_peered":"2024-08-17T02:27:13.265025+0000","last_clean":"2024-08-17T02:27:13.265025+0000","last_became_active":"2024-08-17T02:27:12.240162+0000","last_became_peered":"2024-08-17T02:27:12.240162+0000","last_unstale":"2024-08-17T02:27:13.265025+0000","last_undegraded":"2024-08-17T02:27:13.265025+0000","last_fullsized":"2024-08-17T02:27:13.265025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:16:47.562823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241745+0000","last_change":"2024-08-17T02:27:13.239407+0000","last_active":"2024-08-17T02:27:13.241745+0000","last_peered":"2024-08-17T02:27:13.241745+0000","last_clean":"2024-08-17T02:27:13.241745+0000","last_became_active":"2024-08-17T02:27:13.239000+0000","last_became_peered":"2024-08-17T02:27:13.239000+0000","last_unstale":"2024-08-17T02:27:13.241745+0000","last_undegraded":"2024-08-17T02:27:13.241745+0000","last_fullsized":"2024-08-17T02:27:13.241745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:07.371281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.212127+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.443496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265164+0000","last_change":"2024-08-17T02:27:12.237053+0000","last_active":"2024-08-17T02:27:13.265164+0000","last_peered":"2024-08-17T02:27:13.265164+0000","last_clean":"2024-08-17T02:27:13.265164+0000","last_became_active":"2024-08-17T02:27:12.236599+0000","last_became_peered":"2024-08-17T02:27:12.236599+0000","last_unstale":"2024-08-17T02:27:13.265164+0000","last_undegraded":"2024-08-17T02:27:13.265164+0000","last_fullsized":"2024-08-17T02:27:13.265164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:23:59.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210117+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252084+0000","last_change":"2024-08-17T02:27:13.248472+0000","last_active":"2024-08-17T02:27:13.252084+0000","last_peered":"2024-08-17T02:27:13.252084+0000","last_clean":"2024-08-17T02:27:13.252084+0000","last_became_active":"2024-08-17T02:27:13.248166+0000","last_became_peered":"2024-08-17T02:27:13.248166+0000","last_unstale":"2024-08-17T02:27:13.252084+0000","last_undegraded":"2024-08-17T02:27:13.252084+0000","last_fullsized":"2024-08-17T02:27:13.252084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:35.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211946+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:24.605432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249661+0000","last_change":"2024-08-17T02:27:13.244692+0000","last_active":"2024-08-17T02:27:13.249661+0000","last_peered":"2024-08-17T02:27:13.249661+0000","last_clean":"2024-08-17T02:27:13.249661+0000","last_became_active":"2024-08-17T02:27:13.244391+0000","last_became_peered":"2024-08-17T02:27:13.244391+0000","last_unstale":"2024-08-17T02:27:13.249661+0000","last_undegraded":"2024-08-17T02:27:13.249661+0000","last_fullsized":"2024-08-17T02:27:13.249661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:04.981661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210266+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.235132+0000","last_change":"2024-08-17T02:27:13.233364+0000","last_active":"2024-08-17T02:27:13.235132+0000","last_peered":"2024-08-17T02:27:13.235132+0000","last_clean":"2024-08-17T02:27:13.235132+0000","last_became_active":"2024-08-17T02:27:13.233077+0000","last_became_peered":"2024-08-17T02:27:13.233077+0000","last_unstale":"2024-08-17T02:27:13.235132+0000","last_undegraded":"2024-08-17T02:27:13.235132+0000","last_fullsized":"2024-08-17T02:27:13.235132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:32.120060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210944+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241317+0000","last_change":"2024-08-17T02:27:13.234375+0000","last_active":"2024-08-17T02:27:13.241317+0000","last_peered":"2024-08-17T02:27:13.241317+0000","last_clean":"2024-08-17T02:27:13.241317+0000","last_became_active":"2024-08-17T02:27:13.234047+0000","last_became_peered":"2024-08-17T02:27:13.234047+0000","last_unstale":"2024-08-17T02:27:13.241317+0000","last_undegraded":"2024-08-17T02:27:13.241317+0000","last_fullsized":"2024-08-17T02:27:13.241317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:35.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265125+0000","last_change":"2024-08-17T02:27:12.234644+0000","last_active":"2024-08-17T02:27:13.265125+0000","last_peered":"2024-08-17T02:27:13.265125+0000","last_clean":"2024-08-17T02:27:13.265125+0000","last_became_active":"2024-08-17T02:27:12.234240+0000","last_became_peered":"2024-08-17T02:27:12.234240+0000","last_unstale":"2024-08-17T02:27:13.265125+0000","last_undegraded":"2024-08-17T02:27:13.265125+0000","last_fullsized":"2024-08-17T02:27:13.265125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:36.658841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.264446+0000","last_change":"2024-08-17T02:27:12.250495+0000","last_active":"2024-08-17T02:27:13.264446+0000","last_peered":"2024-08-17T02:27:13.264446+0000","last_clean":"2024-08-17T02:27:13.264446+0000","last_became_active":"2024-08-17T02:27:12.250176+0000","last_became_peered":"2024-08-17T02:27:12.250176+0000","last_unstale":"2024-08-17T02:27:13.264446+0000","last_undegraded":"2024-08-17T02:27:13.264446+0000","last_fullsized":"2024-08-17T02:27:13.264446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:29.181181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.230365+0000","last_change":"2024-08-17T02:27:12.242378+0000","last_active":"2024-08-17T02:27:13.230365+0000","last_peered":"2024-08-17T02:27:13.230365+0000","last_clean":"2024-08-17T02:27:13.230365+0000","last_became_active":"2024-08-17T02:27:12.242045+0000","last_became_peered":"2024-08-17T02:27:12.242045+0000","last_unstale":"2024-08-17T02:27:13.230365+0000","last_undegraded":"2024-08-17T02:27:13.230365+0000","last_fullsized":"2024-08-17T02:27:13.230365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:38.943779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.263298+0000","last_change":"2024-08-17T02:27:12.243465+0000","last_active":"2024-08-17T02:27:13.263298+0000","last_peered":"2024-08-17T02:27:13.263298+0000","last_clean":"2024-08-17T02:27:13.263298+0000","last_became_active":"2024-08-17T02:27:12.243136+0000","last_became_peered":"2024-08-17T02:27:12.243136+0000","last_unstale":"2024-08-17T02:27:13.263298+0000","last_undegraded":"2024-08-17T02:27:13.263298+0000","last_fullsized":"2024-08-17T02:27:13.263298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:30.698821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.236213+0000","last_change":"2024-08-17T02:27:12.245921+0000","last_active":"2024-08-17T02:27:13.236213+0000","last_peered":"2024-08-17T02:27:13.236213+0000","last_clean":"2024-08-17T02:27:13.236213+0000","last_became_active":"2024-08-17T02:27:12.245680+0000","last_became_peered":"2024-08-17T02:27:12.245680+0000","last_unstale":"2024-08-17T02:27:13.236213+0000","last_undegraded":"2024-08-17T02:27:13.236213+0000","last_fullsized":"2024-08-17T02:27:13.236213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:30.698821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.229456+0000","last_change":"2024-08-17T02:27:12.242935+0000","last_active":"2024-08-17T02:27:13.229456+0000","last_peered":"2024-08-17T02:27:13.229456+0000","last_clean":"2024-08-17T02:27:13.229456+0000","last_became_active":"2024-08-17T02:27:12.242603+0000","last_became_peered":"2024-08-17T02:27:12.242603+0000","last_unstale":"2024-08-17T02:27:13.229456+0000","last_undegraded":"2024-08-17T02:27:13.229456+0000","last_fullsized":"2024-08-17T02:27:13.229456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:50:39.060820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.251949+0000","last_change":"2024-08-17T02:27:13.246717+0000","last_active":"2024-08-17T02:27:13.251949+0000","last_peered":"2024-08-17T02:27:13.251949+0000","last_clean":"2024-08-17T02:27:13.251949+0000","last_became_active":"2024-08-17T02:27:13.246275+0000","last_became_peered":"2024-08-17T02:27:13.246275+0000","last_unstale":"2024-08-17T02:27:13.251949+0000","last_undegraded":"2024-08-17T02:27:13.251949+0000","last_fullsized":"2024-08-17T02:27:13.251949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:41.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.225945+0000","last_change":"2024-08-17T02:27:12.243640+0000","last_active":"2024-08-17T02:27:13.225945+0000","last_peered":"2024-08-17T02:27:13.225945+0000","last_clean":"2024-08-17T02:27:13.225945+0000","last_became_active":"2024-08-17T02:27:12.243306+0000","last_became_peered":"2024-08-17T02:27:12.243306+0000","last_unstale":"2024-08-17T02:27:13.225945+0000","last_undegraded":"2024-08-17T02:27:13.225945+0000","last_fullsized":"2024-08-17T02:27:13.225945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:17.249870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209802+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247384+0000","last_change":"2024-08-17T02:27:13.242361+0000","last_active":"2024-08-17T02:27:13.247384+0000","last_peered":"2024-08-17T02:27:13.247384+0000","last_clean":"2024-08-17T02:27:13.247384+0000","last_became_active":"2024-08-17T02:27:13.242077+0000","last_became_peered":"2024-08-17T02:27:13.242077+0000","last_unstale":"2024-08-17T02:27:13.247384+0000","last_undegraded":"2024-08-17T02:27:13.247384+0000","last_fullsized":"2024-08-17T02:27:13.247384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:26.640084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.223535+0000","last_change":"2024-08-17T02:27:12.241447+0000","last_active":"2024-08-17T02:27:13.223535+0000","last_peered":"2024-08-17T02:27:13.223535+0000","last_clean":"2024-08-17T02:27:13.223535+0000","last_became_active":"2024-08-17T02:27:12.241134+0000","last_became_peered":"2024-08-17T02:27:12.241134+0000","last_unstale":"2024-08-17T02:27:13.223535+0000","last_undegraded":"2024-08-17T02:27:13.223535+0000","last_fullsized":"2024-08-17T02:27:13.223535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:16.824567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.244773+0000","last_change":"2024-08-17T02:27:13.239048+0000","last_active":"2024-08-17T02:27:13.244773+0000","last_peered":"2024-08-17T02:27:13.244773+0000","last_clean":"2024-08-17T02:27:13.244773+0000","last_became_active":"2024-08-17T02:27:13.238741+0000","last_became_peered":"2024-08-17T02:27:13.238741+0000","last_unstale":"2024-08-17T02:27:13.244773+0000","last_undegraded":"2024-08-17T02:27:13.244773+0000","last_fullsized":"2024-08-17T02:27:13.244773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:07.219617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209552+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:46.783236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241656+0000","last_change":"2024-08-17T02:27:13.239592+0000","last_active":"2024-08-17T02:27:13.241656+0000","last_peered":"2024-08-17T02:27:13.241656+0000","last_clean":"2024-08-17T02:27:13.241656+0000","last_became_active":"2024-08-17T02:27:13.239326+0000","last_became_peered":"2024-08-17T02:27:13.239326+0000","last_unstale":"2024-08-17T02:27:13.241656+0000","last_undegraded":"2024-08-17T02:27:13.241656+0000","last_fullsized":"2024-08-17T02:27:13.241656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:07.219617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.222654+0000","last_change":"2024-08-17T02:27:12.233970+0000","last_active":"2024-08-17T02:27:13.222654+0000","last_peered":"2024-08-17T02:27:13.222654+0000","last_clean":"2024-08-17T02:27:13.222654+0000","last_became_active":"2024-08-17T02:27:12.233109+0000","last_became_peered":"2024-08-17T02:27:12.233109+0000","last_unstale":"2024-08-17T02:27:13.222654+0000","last_undegraded":"2024-08-17T02:27:13.222654+0000","last_fullsized":"2024-08-17T02:27:13.222654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:11.084442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.244832+0000","last_change":"2024-08-17T02:27:13.235899+0000","last_active":"2024-08-17T02:27:13.244832+0000","last_peered":"2024-08-17T02:27:13.244832+0000","last_clean":"2024-08-17T02:27:13.244832+0000","last_became_active":"2024-08-17T02:27:13.235378+0000","last_became_peered":"2024-08-17T02:27:13.235378+0000","last_unstale":"2024-08-17T02:27:13.244832+0000","last_undegraded":"2024-08-17T02:27:13.244832+0000","last_fullsized":"2024-08-17T02:27:13.244832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:53.348532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209126+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:18:29.290649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.229681+0000","last_change":"2024-08-17T02:27:12.236698+0000","last_active":"2024-08-17T02:27:13.229681+0000","last_peered":"2024-08-17T02:27:13.229681+0000","last_clean":"2024-08-17T02:27:13.229681+0000","last_became_active":"2024-08-17T02:27:12.236456+0000","last_became_peered":"2024-08-17T02:27:12.236456+0000","last_unstale":"2024-08-17T02:27:13.229681+0000","last_undegraded":"2024-08-17T02:27:13.229681+0000","last_fullsized":"2024-08-17T02:27:13.229681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:47.163723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249637+0000","last_change":"2024-08-17T02:27:13.247053+0000","last_active":"2024-08-17T02:27:13.249637+0000","last_peered":"2024-08-17T02:27:13.249637+0000","last_clean":"2024-08-17T02:27:13.249637+0000","last_became_active":"2024-08-17T02:27:13.246725+0000","last_became_peered":"2024-08-17T02:27:13.246725+0000","last_unstale":"2024-08-17T02:27:13.249637+0000","last_undegraded":"2024-08-17T02:27:13.249637+0000","last_fullsized":"2024-08-17T02:27:13.249637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:41.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211891+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:21.538305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249315+0000","last_change":"2024-08-17T02:27:13.245759+0000","last_active":"2024-08-17T02:27:13.249315+0000","last_peered":"2024-08-17T02:27:13.249315+0000","last_clean":"2024-08-17T02:27:13.249315+0000","last_became_active":"2024-08-17T02:27:13.245444+0000","last_became_peered":"2024-08-17T02:27:13.245444+0000","last_unstale":"2024-08-17T02:27:13.249315+0000","last_undegraded":"2024-08-17T02:27:13.249315+0000","last_fullsized":"2024-08-17T02:27:13.249315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:26.640084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.235882+0000","last_change":"2024-08-17T02:27:12.238075+0000","last_active":"2024-08-17T02:27:13.235882+0000","last_peered":"2024-08-17T02:27:13.235882+0000","last_clean":"2024-08-17T02:27:13.235882+0000","last_became_active":"2024-08-17T02:27:12.237796+0000","last_became_peered":"2024-08-17T02:27:12.237796+0000","last_unstale":"2024-08-17T02:27:13.235882+0000","last_undegraded":"2024-08-17T02:27:13.235882+0000","last_fullsized":"2024-08-17T02:27:13.235882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:11.084442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.239675+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:27:13.239675+0000","last_peered":"2024-08-17T02:27:13.239675+0000","last_clean":"2024-08-17T02:27:13.239675+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:27:13.239675+0000","last_undegraded":"2024-08-17T02:27:13.239675+0000","last_fullsized":"2024-08-17T02:27:13.239675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":76,"acting":76,"num_store_stats":5},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":327680,"data_stored":121362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":327680,"data_stored":121362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":962560,"data_stored":731126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1320000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0960000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":372736,"data_stored":141272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":372736,"data_stored":141328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":372736,"data_stored":140772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":958464,"data_stored":731036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:16.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-08-17T02:27:16.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-08-17T02:27:16.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-08-17T02:27:16.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-08-17T02:27:16.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-08-17T02:27:16.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.210810+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-08-17T02:27:16.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.205692+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T02:50:34.090013+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.211068+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.212093+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T10:24:14.425624+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-08-17T02:27:16.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-08-17T02:27:16.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-08-17T02:27:16.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.212127+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T08:34:51.443496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:16.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-08-17T02:27:16.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-08-17T02:27:16.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.210117+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.211946+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T11:49:24.605432+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.210266+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.210944+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-08-17T02:27:16.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.209802+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:27:16.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-08-17T02:27:16.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.209552+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T13:56:46.783236+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:27:16.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-08-17T02:27:16.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.209126+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:18:29.290649+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-17T02:27:16.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-08-17T02:27:16.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-08-17T02:27:12.200640+0000', 'last_change': '2024-08-17T02:27:12.200640+0000', 'last_active': '2024-08-17T02:27:12.200640+0000', 'last_peered': '2024-08-17T02:27:12.200640+0000', 'last_clean': '2024-08-17T02:27:12.200640+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:12.200640+0000', 'last_undegraded': '2024-08-17T02:27:12.200640+0000', 'last_fullsized': '2024-08-17T02:27:12.200640+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:12.200640+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-08-17T02:27:16.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-08-17T02:27:16.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:27:11.190380+0000', 'last_change': '2024-08-17T02:27:11.211891+0000', 'last_active': '2024-08-17T02:27:11.190380+0000', 'last_peered': '2024-08-17T02:27:11.190380+0000', 'last_clean': '2024-08-17T02:27:11.190380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:27:11.190380+0000', 'last_undegraded': '2024-08-17T02:27:11.190380+0000', 'last_fullsized': '2024-08-17T02:27:11.190380+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'last_clean_scrub_stamp': '2024-08-17T02:27:11.190380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T11:19:21.538305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-17T02:27:16.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:27:17.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8eee25700 1 Processor -- start 2024-08-17T02:27:17.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8eee25700 1 -- start start 2024-08-17T02:27:17.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8eee25700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8156f80 0x7ff8e80ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8eee25700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80adf50 con 0x7ff8e80ace80 2024-08-17T02:27:17.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8eee25700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80ae920 con 0x7ff8e806f040 2024-08-17T02:27:17.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8eee25700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80ad340 con 0x7ff8e8156f80 2024-08-17T02:27:17.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff8e80ace80 0x7ff8e8157350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50682/0 (socket says 172.21.15.19:50682) 2024-08-17T02:27:17.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e7fff700 1 -- 172.21.15.19:0/3470479449 learned_addr learned my addr 172.21.15.19:0/3470479449 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:17.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8ecbc1700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8156f80 0x7ff8e80ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567821858 0 0) 0x7ff8e80adf50 con 0x7ff8e80ace80 2024-08-17T02:27:17.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d0003570 con 0x7ff8e80ace80 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661520557 0 0) 0x7ff8e80ae920 con 0x7ff8e806f040 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e80adf50 con 0x7ff8e806f040 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934857279 0 0) 0x7ff8d0003570 con 0x7ff8e80ace80 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8156f80 msgr2=0x7ff8e80ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8156f80 0x7ff8e80ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 >> v1:172.21.15.119:6789/0 conn(0x7ff8e806f040 legacy=0x7ff8e80aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80ad620 con 0x7ff8e80ace80 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7ff8d80017f0 con 0x7ff8e80ace80 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 >> v1:172.21.15.19:6789/0 conn(0x7ff8e80ace80 legacy=0x7ff8e8157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8156f80 0x7ff8d0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d0004180 0x7ff8d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004d50 0x7ff8d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80ad340 con 0x7ff8d0004d50 2024-08-17T02:27:17.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d000bba0 con 0x7ff8d0004180 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.063+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d000bd60 con 0x7ff8e8156f80 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d0004180 0x7ff8d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8ecbc1700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8156f80 0x7ff8d0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8ed3c2700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004d50 0x7ff8d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e7fff700 1 -- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8156f80 msgr2=0x7ff8d0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e8156f80 0x7ff8d0003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e7fff700 1 -- 172.21.15.19:0/3470479449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004d50 msgr2=0x7ff8d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004d50 0x7ff8d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e7fff700 1 -- 172.21.15.19:0/3470479449 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0003570 con 0x7ff8d0004180 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d0004180 0x7ff8d0004810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800a8c0 tx=0x7ff8d8002190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f288ccba1c52686 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80070d0 con 0x7ff8d0004180 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8007230 con 0x7ff8d0004180 2024-08-17T02:27:17.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8e77fe700 1 -- 172.21.15.19:0/3470479449 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80075f0 con 0x7ff8d0004180 2024-08-17T02:27:17.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8eee25700 1 -- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d0004180 msgr2=0x7ff8d0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8eee25700 1 --2- 172.21.15.19:0/3470479449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8d0004180 0x7ff8d0004810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800a8c0 tx=0x7ff8d8002190 comp rx=0 tx=0).stop 2024-08-17T02:27:17.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8ed3c2700 1 -- 172.21.15.19:0/3470479449 reap_dead start 2024-08-17T02:27:17.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8eee25700 1 -- 172.21.15.19:0/3470479449 shutdown_connections 2024-08-17T02:27:17.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8eee25700 1 -- 172.21.15.19:0/3470479449 >> 172.21.15.19:0/3470479449 conn(0x7ff8e8066e00 msgr2=0x7ff8e8067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:17.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8eee25700 1 -- 172.21.15.19:0/3470479449 shutdown_connections 2024-08-17T02:27:17.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.067+0000 7ff8eee25700 1 -- 172.21.15.19:0/3470479449 wait complete. 2024-08-17T02:27:17.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.071+0000 7ff8eee25700 1 Processor -- start 2024-08-17T02:27:17.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.071+0000 7ff8eee25700 1 -- start start 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.071+0000 7ff8eee25700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004180 0x7ff8e8144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.071+0000 7ff8eee25700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e815d490 0x7ff8e815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.071+0000 7ff8eee25700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e815b470 0x7ff8e815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.071+0000 7ff8eee25700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e815aa40 con 0x7ff8d0004180 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.071+0000 7ff8eee25700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e815be00 con 0x7ff8e815d490 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.071+0000 7ff8eee25700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e815a1a0 con 0x7ff8e815b470 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.071+0000 7ff8ecbc1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004180 0x7ff8e8144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ecbc1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004180 0x7ff8e8144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39778/0 (socket says 172.21.15.19:39778) 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ecbc1700 1 -- 172.21.15.19:0/355671659 learned_addr learned my addr 172.21.15.19:0/355671659 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e815d490 0x7ff8e815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ed3c2700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e815b470 0x7ff8e815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ecbc1700 1 -- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e815b470 msgr2=0x7ff8e815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ecbc1700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e815b470 0x7ff8e815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ecbc1700 1 -- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e815d490 msgr2=0x7ff8e815d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ecbc1700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e815d490 0x7ff8e815d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ecbc1700 1 -- 172.21.15.19:0/355671659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e815a480 con 0x7ff8d0004180 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ed3c2700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e815b470 0x7ff8e815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8ecbc1700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004180 0x7ff8e8144770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc011d70 tx=0x7ff8dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/355671659 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc00fac0 con 0x7ff8d0004180 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/355671659 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc00fc20 con 0x7ff8d0004180 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e815a760 con 0x7ff8d0004180 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/355671659 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc014440 con 0x7ff8d0004180 2024-08-17T02:27:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.075+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e8159e50 con 0x7ff8d0004180 2024-08-17T02:27:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.079+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e80645c0 con 0x7ff8d0004180 2024-08-17T02:27:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.079+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/355671659 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff8dc014870 con 0x7ff8d0004180 2024-08-17T02:27:17.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.079+0000 7ff8e4ff9700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.079+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/355671659 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8dc018030 con 0x7ff8d0004180 2024-08-17T02:27:17.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.079+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.079+0000 7ff8e7fff700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80021d0 tx=0x7ff8d8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.083+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/355671659 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff8dc04d9e0 con 0x7ff8d0004180 2024-08-17T02:27:17.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.307+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff8e80ab080 con 0x7ff8d0004180 2024-08-17T02:27:17.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.311+0000 7ff8e4ff9700 1 -- 172.21.15.19:0/355671659 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2143 (secure 0 0 0) 0x7ff8dc022870 con 0x7ff8d0004180 2024-08-17T02:27:17.314 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:17.314 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":71,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1723861576,"num_in_osds":8,"osd_in_since":1723861567,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":58},{"state_name":"unknown","count":26},{"state_name":"creating+peering","count":13}],"num_pgs":97,"num_pools":3,"num_objects":11,"data_bytes":591132,"bytes_used":2439970816,"bytes_avail":770654142464,"bytes_total":773094113280,"unknown_pgs_ratio":0.2680412232875824,"inactive_pgs_ratio":0.1340206116437912,"write_bytes_sec":1653,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":34649}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-08-17T02:27:16.778455+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 msgr2=0x7ff8d4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80021d0 tx=0x7ff8d8016000 comp rx=0 tx=0).stop 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004180 msgr2=0x7ff8e8144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004180 0x7ff8e8144770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc011d70 tx=0x7ff8dc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 shutdown_connections 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff8d4060860 0x7ff8d4062d10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8e815b470 0x7ff8e815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8e815d490 0x7ff8e815d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 --2- 172.21.15.19:0/355671659 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d0004180 0x7ff8e8144770 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 >> 172.21.15.19:0/355671659 conn(0x7ff8e8066e00 msgr2=0x7ff8e80aa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 shutdown_connections 2024-08-17T02:27:17.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.315+0000 7ff8eee25700 1 -- 172.21.15.19:0/355671659 wait complete. 2024-08-17T02:27:17.335 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:27:17.335 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:17.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.435+0000 7fdd4759e700 1 Processor -- start 2024-08-17T02:27:17.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.435+0000 7fdd4759e700 1 -- start start 2024-08-17T02:27:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd48155d80 0x7fdd480aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480af420 0x7fdd480acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd480af850 con 0x7fdd480ad090 2024-08-17T02:27:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd480ad8a0 con 0x7fdd48155d80 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480adb80 con 0x7fdd480af420 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd48155d80 0x7fdd480aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd48155d80 0x7fdd480aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39782/0 (socket says 172.21.15.19:39782) 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4659c700 1 -- 172.21.15.19:0/4160028167 learned_addr learned my addr 172.21.15.19:0/4160028167 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd45d9b700 1 --2- 172.21.15.19:0/4160028167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480af420 0x7fdd480acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4659c700 1 -- 172.21.15.19:0/4160028167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480af420 msgr2=0x7fdd480acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4659c700 1 --2- 172.21.15.19:0/4160028167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480af420 0x7fdd480acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4659c700 1 -- 172.21.15.19:0/4160028167 >> v1:172.21.15.119:6789/0 conn(0x7fdd480ad090 legacy=0x7fdd481599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4659c700 1 -- 172.21.15.19:0/4160028167 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480ade60 con 0x7fdd48155d80 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4659c700 1 --2- 172.21.15.19:0/4160028167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd48155d80 0x7fdd480aeee0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdd380099e0 tx=0x7fdd38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad2f67115186303 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4559a700 1 -- 172.21.15.19:0/4160028167 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800b820 con 0x7fdd48155d80 2024-08-17T02:27:17.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4559a700 1 -- 172.21.15.19:0/4160028167 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3800b980 con 0x7fdd48155d80 2024-08-17T02:27:17.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4559a700 1 -- 172.21.15.19:0/4160028167 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800bd20 con 0x7fdd48155d80 2024-08-17T02:27:17.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 -- 172.21.15.19:0/4160028167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd48155d80 msgr2=0x7fdd480aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 --2- 172.21.15.19:0/4160028167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd48155d80 0x7fdd480aeee0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdd380099e0 tx=0x7fdd38009250 comp rx=0 tx=0).stop 2024-08-17T02:27:17.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 -- 172.21.15.19:0/4160028167 shutdown_connections 2024-08-17T02:27:17.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 --2- 172.21.15.19:0/4160028167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd480af420 0x7fdd480acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 --2- 172.21.15.19:0/4160028167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd48155d80 0x7fdd480aeee0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 -- 172.21.15.19:0/4160028167 >> 172.21.15.19:0/4160028167 conn(0x7fdd4806e070 msgr2=0x7fdd480b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:17.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 -- 172.21.15.19:0/4160028167 shutdown_connections 2024-08-17T02:27:17.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.439+0000 7fdd4759e700 1 -- 172.21.15.19:0/4160028167 wait complete. 2024-08-17T02:27:17.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.443+0000 7fdd4759e700 1 Processor -- start 2024-08-17T02:27:17.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.443+0000 7fdd4759e700 1 -- start start 2024-08-17T02:27:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd4759e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480ad090 0x7fdd48153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd4759e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd480af420 0x7fdd48142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd4759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd48155d80 0x7fdd4814c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd4759e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd481526d0 con 0x7fdd480af420 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd4759e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd481529b0 con 0x7fdd480ad090 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd4759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd48152c90 con 0x7fdd48155d80 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd45d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd480af420 0x7fdd48142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd45d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd480af420 0x7fdd48142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39792/0 (socket says 172.21.15.19:39792) 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd45d9b700 1 -- 172.21.15.19:0/857242471 learned_addr learned my addr 172.21.15.19:0/857242471 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd4659c700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480ad090 0x7fdd48153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd46d9d700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd48155d80 0x7fdd4814c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd45d9b700 1 -- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd48155d80 msgr2=0x7fdd4814c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd45d9b700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd48155d80 0x7fdd4814c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd45d9b700 1 -- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480ad090 msgr2=0x7fdd48153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd45d9b700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480ad090 0x7fdd48153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd45d9b700 1 -- 172.21.15.19:0/857242471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd380094f0 con 0x7fdd480af420 2024-08-17T02:27:17.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd45d9b700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd480af420 0x7fdd48142520 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00ec80 tx=0x7fdd3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd367fc700 1 -- 172.21.15.19:0/857242471 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c00c850 con 0x7fdd480af420 2024-08-17T02:27:17.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd367fc700 1 -- 172.21.15.19:0/857242471 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c00c9b0 con 0x7fdd480af420 2024-08-17T02:27:17.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd48152f70 con 0x7fdd480af420 2024-08-17T02:27:17.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd367fc700 1 -- 172.21.15.19:0/857242471 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c00cd50 con 0x7fdd480af420 2024-08-17T02:27:17.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.447+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd48152380 con 0x7fdd480af420 2024-08-17T02:27:17.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.451+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd480638f0 con 0x7fdd480af420 2024-08-17T02:27:17.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.451+0000 7fdd367fc700 1 -- 172.21.15.19:0/857242471 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdd3c013680 con 0x7fdd480af420 2024-08-17T02:27:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.451+0000 7fdd367fc700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd28060860 0x7fdd28062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.451+0000 7fdd367fc700 1 -- 172.21.15.19:0/857242471 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd3c07d1e0 con 0x7fdd480af420 2024-08-17T02:27:17.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.451+0000 7fdd4659c700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd28060860 0x7fdd28062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.451+0000 7fdd4659c700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd28060860 0x7fdd28062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd380099e0 tx=0x7fdd38017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.459+0000 7fdd367fc700 1 -- 172.21.15.19:0/857242471 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fdd3c04d590 con 0x7fdd480af420 2024-08-17T02:27:17.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.623+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd48067f10 con 0x7fdd28060860 2024-08-17T02:27:17.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.643+0000 7fdd367fc700 1 -- 172.21.15.19:0/857242471 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260299 (secure 0 0 0) 0x7fdd48067f10 con 0x7fdd28060860 2024-08-17T02:27:17.650 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd28060860 msgr2=0x7fdd28062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd28060860 0x7fdd28062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdd380099e0 tx=0x7fdd38017000 comp rx=0 tx=0).stop 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd480af420 msgr2=0x7fdd48142520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd480af420 0x7fdd48142520 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00ec80 tx=0x7fdd3c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 shutdown_connections 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdd28060860 0x7fdd28062d10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd48155d80 0x7fdd4814c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd480af420 0x7fdd48142520 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 --2- 172.21.15.19:0/857242471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd480ad090 0x7fdd48153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 >> 172.21.15.19:0/857242471 conn(0x7fdd4806e070 msgr2=0x7fdd4814c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 shutdown_connections 2024-08-17T02:27:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:17.647+0000 7fdd4759e700 1 -- 172.21.15.19:0/857242471 wait complete. 2024-08-17T02:27:17.654 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:27:17.666 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-08-17T02:27:16.778196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":142,"acting":142,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382784,"kb_used_data":3916,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591936,"statfs":{"total":773094113280,"available":770654142464,"internally_reserved":0,"allocated":4009984,"data_stored":2243815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.574833"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.246907+0000","last_change":"2024-08-17T02:27:13.242833+0000","last_active":"2024-08-17T02:27:13.246907+0000","last_peered":"2024-08-17T02:27:13.246907+0000","last_clean":"2024-08-17T02:27:13.246907+0000","last_became_active":"2024-08-17T02:27:13.242536+0000","last_became_peered":"2024-08-17T02:27:13.242536+0000","last_unstale":"2024-08-17T02:27:13.246907+0000","last_undegraded":"2024-08-17T02:27:13.246907+0000","last_fullsized":"2024-08-17T02:27:13.246907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:29.067933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241762+0000","last_change":"2024-08-17T02:27:13.239546+0000","last_active":"2024-08-17T02:27:13.241762+0000","last_peered":"2024-08-17T02:27:13.241762+0000","last_clean":"2024-08-17T02:27:13.241762+0000","last_became_active":"2024-08-17T02:27:13.239284+0000","last_became_peered":"2024-08-17T02:27:13.239284+0000","last_unstale":"2024-08-17T02:27:13.241762+0000","last_undegraded":"2024-08-17T02:27:13.241762+0000","last_fullsized":"2024-08-17T02:27:13.241762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:23.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252216+0000","last_change":"2024-08-17T02:27:13.248893+0000","last_active":"2024-08-17T02:27:13.252216+0000","last_peered":"2024-08-17T02:27:13.252216+0000","last_clean":"2024-08-17T02:27:13.252216+0000","last_became_active":"2024-08-17T02:27:13.248603+0000","last_became_peered":"2024-08-17T02:27:13.248603+0000","last_unstale":"2024-08-17T02:27:13.252216+0000","last_undegraded":"2024-08-17T02:27:13.252216+0000","last_fullsized":"2024-08-17T02:27:13.252216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:42.696716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252379+0000","last_change":"2024-08-17T02:27:13.250161+0000","last_active":"2024-08-17T02:27:13.252379+0000","last_peered":"2024-08-17T02:27:13.252379+0000","last_clean":"2024-08-17T02:27:13.252379+0000","last_became_active":"2024-08-17T02:27:13.249894+0000","last_became_peered":"2024-08-17T02:27:13.249894+0000","last_unstale":"2024-08-17T02:27:13.252379+0000","last_undegraded":"2024-08-17T02:27:13.252379+0000","last_fullsized":"2024-08-17T02:27:13.252379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:23.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.243849+0000","last_change":"2024-08-17T02:27:13.241659+0000","last_active":"2024-08-17T02:27:13.243849+0000","last_peered":"2024-08-17T02:27:13.243849+0000","last_clean":"2024-08-17T02:27:13.243849+0000","last_became_active":"2024-08-17T02:27:13.241320+0000","last_became_peered":"2024-08-17T02:27:13.241320+0000","last_unstale":"2024-08-17T02:27:13.243849+0000","last_undegraded":"2024-08-17T02:27:13.243849+0000","last_fullsized":"2024-08-17T02:27:13.243849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:15:11.517561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.251963+0000","last_change":"2024-08-17T02:27:13.247943+0000","last_active":"2024-08-17T02:27:13.251963+0000","last_peered":"2024-08-17T02:27:13.251963+0000","last_clean":"2024-08-17T02:27:13.251963+0000","last_became_active":"2024-08-17T02:27:13.246153+0000","last_became_peered":"2024-08-17T02:27:13.246153+0000","last_unstale":"2024-08-17T02:27:13.251963+0000","last_undegraded":"2024-08-17T02:27:13.251963+0000","last_fullsized":"2024-08-17T02:27:13.251963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:58.769663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249519+0000","last_change":"2024-08-17T02:27:13.245414+0000","last_active":"2024-08-17T02:27:13.249519+0000","last_peered":"2024-08-17T02:27:13.249519+0000","last_clean":"2024-08-17T02:27:13.249519+0000","last_became_active":"2024-08-17T02:27:13.245109+0000","last_became_peered":"2024-08-17T02:27:13.245109+0000","last_unstale":"2024-08-17T02:27:13.249519+0000","last_undegraded":"2024-08-17T02:27:13.249519+0000","last_fullsized":"2024-08-17T02:27:13.249519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:12.139471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249626+0000","last_change":"2024-08-17T02:27:13.245575+0000","last_active":"2024-08-17T02:27:13.249626+0000","last_peered":"2024-08-17T02:27:13.249626+0000","last_clean":"2024-08-17T02:27:13.249626+0000","last_became_active":"2024-08-17T02:27:13.245306+0000","last_became_peered":"2024-08-17T02:27:13.245306+0000","last_unstale":"2024-08-17T02:27:13.249626+0000","last_undegraded":"2024-08-17T02:27:13.249626+0000","last_fullsized":"2024-08-17T02:27:13.249626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:49.380480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249384+0000","last_change":"2024-08-17T02:27:13.245904+0000","last_active":"2024-08-17T02:27:13.249384+0000","last_peered":"2024-08-17T02:27:13.249384+0000","last_clean":"2024-08-17T02:27:13.249384+0000","last_became_active":"2024-08-17T02:27:13.245626+0000","last_became_peered":"2024-08-17T02:27:13.245626+0000","last_unstale":"2024-08-17T02:27:13.249384+0000","last_undegraded":"2024-08-17T02:27:13.249384+0000","last_fullsized":"2024-08-17T02:27:13.249384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:43.344644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249136+0000","last_change":"2024-08-17T02:27:13.245033+0000","last_active":"2024-08-17T02:27:13.249136+0000","last_peered":"2024-08-17T02:27:13.249136+0000","last_clean":"2024-08-17T02:27:13.249136+0000","last_became_active":"2024-08-17T02:27:13.243797+0000","last_became_peered":"2024-08-17T02:27:13.243797+0000","last_unstale":"2024-08-17T02:27:13.249136+0000","last_undegraded":"2024-08-17T02:27:13.249136+0000","last_fullsized":"2024-08-17T02:27:13.249136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:25:02.364249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.242621+0000","last_change":"2024-08-17T02:27:13.236176+0000","last_active":"2024-08-17T02:27:13.242621+0000","last_peered":"2024-08-17T02:27:13.242621+0000","last_clean":"2024-08-17T02:27:13.242621+0000","last_became_active":"2024-08-17T02:27:13.235912+0000","last_became_peered":"2024-08-17T02:27:13.235912+0000","last_unstale":"2024-08-17T02:27:13.242621+0000","last_undegraded":"2024-08-17T02:27:13.242621+0000","last_fullsized":"2024-08-17T02:27:13.242621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:06.659613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249346+0000","last_change":"2024-08-17T02:27:13.244677+0000","last_active":"2024-08-17T02:27:13.249346+0000","last_peered":"2024-08-17T02:27:13.249346+0000","last_clean":"2024-08-17T02:27:13.249346+0000","last_became_active":"2024-08-17T02:27:13.244354+0000","last_became_peered":"2024-08-17T02:27:13.244354+0000","last_unstale":"2024-08-17T02:27:13.249346+0000","last_undegraded":"2024-08-17T02:27:13.249346+0000","last_fullsized":"2024-08-17T02:27:13.249346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:58:59.215561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247620+0000","last_change":"2024-08-17T02:27:13.242670+0000","last_active":"2024-08-17T02:27:13.247620+0000","last_peered":"2024-08-17T02:27:13.247620+0000","last_clean":"2024-08-17T02:27:13.247620+0000","last_became_active":"2024-08-17T02:27:13.242369+0000","last_became_peered":"2024-08-17T02:27:13.242369+0000","last_unstale":"2024-08-17T02:27:13.247620+0000","last_undegraded":"2024-08-17T02:27:13.247620+0000","last_fullsized":"2024-08-17T02:27:13.247620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:04.981661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241415+0000","last_change":"2024-08-17T02:27:13.238335+0000","last_active":"2024-08-17T02:27:13.241415+0000","last_peered":"2024-08-17T02:27:13.241415+0000","last_clean":"2024-08-17T02:27:13.241415+0000","last_became_active":"2024-08-17T02:27:13.238034+0000","last_became_peered":"2024-08-17T02:27:13.238034+0000","last_unstale":"2024-08-17T02:27:13.241415+0000","last_undegraded":"2024-08-17T02:27:13.241415+0000","last_fullsized":"2024-08-17T02:27:13.241415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:59.482871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.242073+0000","last_change":"2024-08-17T02:27:13.235368+0000","last_active":"2024-08-17T02:27:13.242073+0000","last_peered":"2024-08-17T02:27:13.242073+0000","last_clean":"2024-08-17T02:27:13.242073+0000","last_became_active":"2024-08-17T02:27:13.235056+0000","last_became_peered":"2024-08-17T02:27:13.235056+0000","last_unstale":"2024-08-17T02:27:13.242073+0000","last_undegraded":"2024-08-17T02:27:13.242073+0000","last_fullsized":"2024-08-17T02:27:13.242073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:35.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249387+0000","last_change":"2024-08-17T02:27:13.244838+0000","last_active":"2024-08-17T02:27:13.249387+0000","last_peered":"2024-08-17T02:27:13.249387+0000","last_clean":"2024-08-17T02:27:13.249387+0000","last_became_active":"2024-08-17T02:27:13.244506+0000","last_became_peered":"2024-08-17T02:27:13.244506+0000","last_unstale":"2024-08-17T02:27:13.249387+0000","last_undegraded":"2024-08-17T02:27:13.249387+0000","last_fullsized":"2024-08-17T02:27:13.249387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:59.482871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249298+0000","last_change":"2024-08-17T02:27:13.245329+0000","last_active":"2024-08-17T02:27:13.249298+0000","last_peered":"2024-08-17T02:27:13.249298+0000","last_clean":"2024-08-17T02:27:13.249298+0000","last_became_active":"2024-08-17T02:27:13.243920+0000","last_became_peered":"2024-08-17T02:27:13.243920+0000","last_unstale":"2024-08-17T02:27:13.249298+0000","last_undegraded":"2024-08-17T02:27:13.249298+0000","last_fullsized":"2024-08-17T02:27:13.249298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:59.482871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249681+0000","last_change":"2024-08-17T02:27:13.245374+0000","last_active":"2024-08-17T02:27:13.249681+0000","last_peered":"2024-08-17T02:27:13.249681+0000","last_clean":"2024-08-17T02:27:13.249681+0000","last_became_active":"2024-08-17T02:27:13.245113+0000","last_became_peered":"2024-08-17T02:27:13.245113+0000","last_unstale":"2024-08-17T02:27:13.249681+0000","last_undegraded":"2024-08-17T02:27:13.249681+0000","last_fullsized":"2024-08-17T02:27:13.249681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:32.120060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249364+0000","last_change":"2024-08-17T02:27:13.245331+0000","last_active":"2024-08-17T02:27:13.249364+0000","last_peered":"2024-08-17T02:27:13.249364+0000","last_clean":"2024-08-17T02:27:13.249364+0000","last_became_active":"2024-08-17T02:27:13.243905+0000","last_became_peered":"2024-08-17T02:27:13.243905+0000","last_unstale":"2024-08-17T02:27:13.249364+0000","last_undegraded":"2024-08-17T02:27:13.249364+0000","last_fullsized":"2024-08-17T02:27:13.249364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:07.371281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247590+0000","last_change":"2024-08-17T02:27:13.242465+0000","last_active":"2024-08-17T02:27:13.247590+0000","last_peered":"2024-08-17T02:27:13.247590+0000","last_clean":"2024-08-17T02:27:13.247590+0000","last_became_active":"2024-08-17T02:27:13.242159+0000","last_became_peered":"2024-08-17T02:27:13.242159+0000","last_unstale":"2024-08-17T02:27:13.247590+0000","last_undegraded":"2024-08-17T02:27:13.247590+0000","last_fullsized":"2024-08-17T02:27:13.247590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:32.120060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265274+0000","last_change":"2024-08-17T02:27:12.239872+0000","last_active":"2024-08-17T02:27:13.265274+0000","last_peered":"2024-08-17T02:27:13.265274+0000","last_clean":"2024-08-17T02:27:13.265274+0000","last_became_active":"2024-08-17T02:27:12.239546+0000","last_became_peered":"2024-08-17T02:27:12.239546+0000","last_unstale":"2024-08-17T02:27:13.265274+0000","last_undegraded":"2024-08-17T02:27:13.265274+0000","last_fullsized":"2024-08-17T02:27:13.265274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:52.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.246884+0000","last_change":"2024-08-17T02:27:13.240993+0000","last_active":"2024-08-17T02:27:13.246884+0000","last_peered":"2024-08-17T02:27:13.246884+0000","last_clean":"2024-08-17T02:27:13.246884+0000","last_became_active":"2024-08-17T02:27:13.240684+0000","last_became_peered":"2024-08-17T02:27:13.240684+0000","last_unstale":"2024-08-17T02:27:13.246884+0000","last_undegraded":"2024-08-17T02:27:13.246884+0000","last_fullsized":"2024-08-17T02:27:13.246884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:53.348532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.262636+0000","last_change":"2024-08-17T02:27:12.239317+0000","last_active":"2024-08-17T02:27:13.262636+0000","last_peered":"2024-08-17T02:27:13.262636+0000","last_clean":"2024-08-17T02:27:13.262636+0000","last_became_active":"2024-08-17T02:27:12.238976+0000","last_became_peered":"2024-08-17T02:27:12.238976+0000","last_unstale":"2024-08-17T02:27:13.262636+0000","last_undegraded":"2024-08-17T02:27:13.262636+0000","last_fullsized":"2024-08-17T02:27:13.262636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:49:23.095686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.243790+0000","last_change":"2024-08-17T02:27:13.240138+0000","last_active":"2024-08-17T02:27:13.243790+0000","last_peered":"2024-08-17T02:27:13.243790+0000","last_clean":"2024-08-17T02:27:13.243790+0000","last_became_active":"2024-08-17T02:27:13.239834+0000","last_became_peered":"2024-08-17T02:27:13.239834+0000","last_unstale":"2024-08-17T02:27:13.243790+0000","last_undegraded":"2024-08-17T02:27:13.243790+0000","last_fullsized":"2024-08-17T02:27:13.243790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:25:02.364249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210810+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.205692+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:34.090013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.251917+0000","last_change":"2024-08-17T02:27:13.246559+0000","last_active":"2024-08-17T02:27:13.251917+0000","last_peered":"2024-08-17T02:27:13.251917+0000","last_clean":"2024-08-17T02:27:13.251917+0000","last_became_active":"2024-08-17T02:27:13.246190+0000","last_became_peered":"2024-08-17T02:27:13.246190+0000","last_unstale":"2024-08-17T02:27:13.251917+0000","last_undegraded":"2024-08-17T02:27:13.251917+0000","last_fullsized":"2024-08-17T02:27:13.251917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:06.659613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.264719+0000","last_change":"2024-08-17T02:27:12.242600+0000","last_active":"2024-08-17T02:27:13.264719+0000","last_peered":"2024-08-17T02:27:13.264719+0000","last_clean":"2024-08-17T02:27:13.264719+0000","last_became_active":"2024-08-17T02:27:12.242068+0000","last_became_peered":"2024-08-17T02:27:12.242068+0000","last_unstale":"2024-08-17T02:27:13.264719+0000","last_undegraded":"2024-08-17T02:27:13.264719+0000","last_fullsized":"2024-08-17T02:27:13.264719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:52.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241468+0000","last_change":"2024-08-17T02:27:13.236477+0000","last_active":"2024-08-17T02:27:13.241468+0000","last_peered":"2024-08-17T02:27:13.241468+0000","last_clean":"2024-08-17T02:27:13.241468+0000","last_became_active":"2024-08-17T02:27:13.236212+0000","last_became_peered":"2024-08-17T02:27:13.236212+0000","last_unstale":"2024-08-17T02:27:13.241468+0000","last_undegraded":"2024-08-17T02:27:13.241468+0000","last_fullsized":"2024-08-17T02:27:13.241468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:58.769663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265009+0000","last_change":"2024-08-17T02:27:12.242373+0000","last_active":"2024-08-17T02:27:13.265009+0000","last_peered":"2024-08-17T02:27:13.265009+0000","last_clean":"2024-08-17T02:27:13.265009+0000","last_became_active":"2024-08-17T02:27:12.242025+0000","last_became_peered":"2024-08-17T02:27:12.242025+0000","last_unstale":"2024-08-17T02:27:13.265009+0000","last_undegraded":"2024-08-17T02:27:13.265009+0000","last_fullsized":"2024-08-17T02:27:13.265009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:11.084442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247571+0000","last_change":"2024-08-17T02:27:13.242571+0000","last_active":"2024-08-17T02:27:13.247571+0000","last_peered":"2024-08-17T02:27:13.247571+0000","last_clean":"2024-08-17T02:27:13.247571+0000","last_became_active":"2024-08-17T02:27:13.242310+0000","last_became_peered":"2024-08-17T02:27:13.242310+0000","last_unstale":"2024-08-17T02:27:13.247571+0000","last_undegraded":"2024-08-17T02:27:13.247571+0000","last_fullsized":"2024-08-17T02:27:13.247571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:42.696716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211068+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.230122+0000","last_change":"2024-08-17T02:27:12.236935+0000","last_active":"2024-08-17T02:27:13.230122+0000","last_peered":"2024-08-17T02:27:13.230122+0000","last_clean":"2024-08-17T02:27:13.230122+0000","last_became_active":"2024-08-17T02:27:12.236487+0000","last_became_peered":"2024-08-17T02:27:12.236487+0000","last_unstale":"2024-08-17T02:27:13.230122+0000","last_undegraded":"2024-08-17T02:27:13.230122+0000","last_fullsized":"2024-08-17T02:27:13.230122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:30.698821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247416+0000","last_change":"2024-08-17T02:27:13.242591+0000","last_active":"2024-08-17T02:27:13.247416+0000","last_peered":"2024-08-17T02:27:13.247416+0000","last_clean":"2024-08-17T02:27:13.247416+0000","last_became_active":"2024-08-17T02:27:13.242329+0000","last_became_peered":"2024-08-17T02:27:13.242329+0000","last_unstale":"2024-08-17T02:27:13.247416+0000","last_undegraded":"2024-08-17T02:27:13.247416+0000","last_fullsized":"2024-08-17T02:27:13.247416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:43.344644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.212093+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:14.425624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.223731+0000","last_change":"2024-08-17T02:27:12.236563+0000","last_active":"2024-08-17T02:27:13.223731+0000","last_peered":"2024-08-17T02:27:13.223731+0000","last_clean":"2024-08-17T02:27:13.223731+0000","last_became_active":"2024-08-17T02:27:12.235239+0000","last_became_peered":"2024-08-17T02:27:12.235239+0000","last_unstale":"2024-08-17T02:27:13.223731+0000","last_undegraded":"2024-08-17T02:27:13.223731+0000","last_fullsized":"2024-08-17T02:27:13.223731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:38.943779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265025+0000","last_change":"2024-08-17T02:27:12.241247+0000","last_active":"2024-08-17T02:27:13.265025+0000","last_peered":"2024-08-17T02:27:13.265025+0000","last_clean":"2024-08-17T02:27:13.265025+0000","last_became_active":"2024-08-17T02:27:12.240162+0000","last_became_peered":"2024-08-17T02:27:12.240162+0000","last_unstale":"2024-08-17T02:27:13.265025+0000","last_undegraded":"2024-08-17T02:27:13.265025+0000","last_fullsized":"2024-08-17T02:27:13.265025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:16:47.562823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241745+0000","last_change":"2024-08-17T02:27:13.239407+0000","last_active":"2024-08-17T02:27:13.241745+0000","last_peered":"2024-08-17T02:27:13.241745+0000","last_clean":"2024-08-17T02:27:13.241745+0000","last_became_active":"2024-08-17T02:27:13.239000+0000","last_became_peered":"2024-08-17T02:27:13.239000+0000","last_unstale":"2024-08-17T02:27:13.241745+0000","last_undegraded":"2024-08-17T02:27:13.241745+0000","last_fullsized":"2024-08-17T02:27:13.241745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:07.371281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.212127+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.443496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265164+0000","last_change":"2024-08-17T02:27:12.237053+0000","last_active":"2024-08-17T02:27:13.265164+0000","last_peered":"2024-08-17T02:27:13.265164+0000","last_clean":"2024-08-17T02:27:13.265164+0000","last_became_active":"2024-08-17T02:27:12.236599+0000","last_became_peered":"2024-08-17T02:27:12.236599+0000","last_unstale":"2024-08-17T02:27:13.265164+0000","last_undegraded":"2024-08-17T02:27:13.265164+0000","last_fullsized":"2024-08-17T02:27:13.265164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:23:59.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210117+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:01.243747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252084+0000","last_change":"2024-08-17T02:27:13.248472+0000","last_active":"2024-08-17T02:27:13.252084+0000","last_peered":"2024-08-17T02:27:13.252084+0000","last_clean":"2024-08-17T02:27:13.252084+0000","last_became_active":"2024-08-17T02:27:13.248166+0000","last_became_peered":"2024-08-17T02:27:13.248166+0000","last_unstale":"2024-08-17T02:27:13.252084+0000","last_undegraded":"2024-08-17T02:27:13.252084+0000","last_fullsized":"2024-08-17T02:27:13.252084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:35.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211946+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:24.605432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249661+0000","last_change":"2024-08-17T02:27:13.244692+0000","last_active":"2024-08-17T02:27:13.249661+0000","last_peered":"2024-08-17T02:27:13.249661+0000","last_clean":"2024-08-17T02:27:13.249661+0000","last_became_active":"2024-08-17T02:27:13.244391+0000","last_became_peered":"2024-08-17T02:27:13.244391+0000","last_unstale":"2024-08-17T02:27:13.249661+0000","last_undegraded":"2024-08-17T02:27:13.249661+0000","last_fullsized":"2024-08-17T02:27:13.249661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:04.981661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210266+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.235132+0000","last_change":"2024-08-17T02:27:13.233364+0000","last_active":"2024-08-17T02:27:13.235132+0000","last_peered":"2024-08-17T02:27:13.235132+0000","last_clean":"2024-08-17T02:27:13.235132+0000","last_became_active":"2024-08-17T02:27:13.233077+0000","last_became_peered":"2024-08-17T02:27:13.233077+0000","last_unstale":"2024-08-17T02:27:13.235132+0000","last_undegraded":"2024-08-17T02:27:13.235132+0000","last_fullsized":"2024-08-17T02:27:13.235132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:32.120060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.210944+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:21.979721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241317+0000","last_change":"2024-08-17T02:27:13.234375+0000","last_active":"2024-08-17T02:27:13.241317+0000","last_peered":"2024-08-17T02:27:13.241317+0000","last_clean":"2024-08-17T02:27:13.241317+0000","last_became_active":"2024-08-17T02:27:13.234047+0000","last_became_peered":"2024-08-17T02:27:13.234047+0000","last_unstale":"2024-08-17T02:27:13.241317+0000","last_undegraded":"2024-08-17T02:27:13.241317+0000","last_fullsized":"2024-08-17T02:27:13.241317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:35.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265125+0000","last_change":"2024-08-17T02:27:12.234644+0000","last_active":"2024-08-17T02:27:13.265125+0000","last_peered":"2024-08-17T02:27:13.265125+0000","last_clean":"2024-08-17T02:27:13.265125+0000","last_became_active":"2024-08-17T02:27:12.234240+0000","last_became_peered":"2024-08-17T02:27:12.234240+0000","last_unstale":"2024-08-17T02:27:13.265125+0000","last_undegraded":"2024-08-17T02:27:13.265125+0000","last_fullsized":"2024-08-17T02:27:13.265125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:36.658841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.264446+0000","last_change":"2024-08-17T02:27:12.250495+0000","last_active":"2024-08-17T02:27:13.264446+0000","last_peered":"2024-08-17T02:27:13.264446+0000","last_clean":"2024-08-17T02:27:13.264446+0000","last_became_active":"2024-08-17T02:27:12.250176+0000","last_became_peered":"2024-08-17T02:27:12.250176+0000","last_unstale":"2024-08-17T02:27:13.264446+0000","last_undegraded":"2024-08-17T02:27:13.264446+0000","last_fullsized":"2024-08-17T02:27:13.264446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:29.181181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.230365+0000","last_change":"2024-08-17T02:27:12.242378+0000","last_active":"2024-08-17T02:27:13.230365+0000","last_peered":"2024-08-17T02:27:13.230365+0000","last_clean":"2024-08-17T02:27:13.230365+0000","last_became_active":"2024-08-17T02:27:12.242045+0000","last_became_peered":"2024-08-17T02:27:12.242045+0000","last_unstale":"2024-08-17T02:27:13.230365+0000","last_undegraded":"2024-08-17T02:27:13.230365+0000","last_fullsized":"2024-08-17T02:27:13.230365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:38.943779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.263298+0000","last_change":"2024-08-17T02:27:12.243465+0000","last_active":"2024-08-17T02:27:13.263298+0000","last_peered":"2024-08-17T02:27:13.263298+0000","last_clean":"2024-08-17T02:27:13.263298+0000","last_became_active":"2024-08-17T02:27:12.243136+0000","last_became_peered":"2024-08-17T02:27:12.243136+0000","last_unstale":"2024-08-17T02:27:13.263298+0000","last_undegraded":"2024-08-17T02:27:13.263298+0000","last_fullsized":"2024-08-17T02:27:13.263298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:30.698821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.236213+0000","last_change":"2024-08-17T02:27:12.245921+0000","last_active":"2024-08-17T02:27:13.236213+0000","last_peered":"2024-08-17T02:27:13.236213+0000","last_clean":"2024-08-17T02:27:13.236213+0000","last_became_active":"2024-08-17T02:27:12.245680+0000","last_became_peered":"2024-08-17T02:27:12.245680+0000","last_unstale":"2024-08-17T02:27:13.236213+0000","last_undegraded":"2024-08-17T02:27:13.236213+0000","last_fullsized":"2024-08-17T02:27:13.236213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:30.698821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.229456+0000","last_change":"2024-08-17T02:27:12.242935+0000","last_active":"2024-08-17T02:27:13.229456+0000","last_peered":"2024-08-17T02:27:13.229456+0000","last_clean":"2024-08-17T02:27:13.229456+0000","last_became_active":"2024-08-17T02:27:12.242603+0000","last_became_peered":"2024-08-17T02:27:12.242603+0000","last_unstale":"2024-08-17T02:27:13.229456+0000","last_undegraded":"2024-08-17T02:27:13.229456+0000","last_fullsized":"2024-08-17T02:27:13.229456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:50:39.060820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.251949+0000","last_change":"2024-08-17T02:27:13.246717+0000","last_active":"2024-08-17T02:27:13.251949+0000","last_peered":"2024-08-17T02:27:13.251949+0000","last_clean":"2024-08-17T02:27:13.251949+0000","last_became_active":"2024-08-17T02:27:13.246275+0000","last_became_peered":"2024-08-17T02:27:13.246275+0000","last_unstale":"2024-08-17T02:27:13.251949+0000","last_undegraded":"2024-08-17T02:27:13.251949+0000","last_fullsized":"2024-08-17T02:27:13.251949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:41.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.225945+0000","last_change":"2024-08-17T02:27:12.243640+0000","last_active":"2024-08-17T02:27:13.225945+0000","last_peered":"2024-08-17T02:27:13.225945+0000","last_clean":"2024-08-17T02:27:13.225945+0000","last_became_active":"2024-08-17T02:27:12.243306+0000","last_became_peered":"2024-08-17T02:27:12.243306+0000","last_unstale":"2024-08-17T02:27:13.225945+0000","last_undegraded":"2024-08-17T02:27:13.225945+0000","last_fullsized":"2024-08-17T02:27:13.225945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:17.249870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209802+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:06.709116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247384+0000","last_change":"2024-08-17T02:27:13.242361+0000","last_active":"2024-08-17T02:27:13.247384+0000","last_peered":"2024-08-17T02:27:13.247384+0000","last_clean":"2024-08-17T02:27:13.247384+0000","last_became_active":"2024-08-17T02:27:13.242077+0000","last_became_peered":"2024-08-17T02:27:13.242077+0000","last_unstale":"2024-08-17T02:27:13.247384+0000","last_undegraded":"2024-08-17T02:27:13.247384+0000","last_fullsized":"2024-08-17T02:27:13.247384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:26.640084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.223535+0000","last_change":"2024-08-17T02:27:12.241447+0000","last_active":"2024-08-17T02:27:13.223535+0000","last_peered":"2024-08-17T02:27:13.223535+0000","last_clean":"2024-08-17T02:27:13.223535+0000","last_became_active":"2024-08-17T02:27:12.241134+0000","last_became_peered":"2024-08-17T02:27:12.241134+0000","last_unstale":"2024-08-17T02:27:13.223535+0000","last_undegraded":"2024-08-17T02:27:13.223535+0000","last_fullsized":"2024-08-17T02:27:13.223535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:16.824567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.244773+0000","last_change":"2024-08-17T02:27:13.239048+0000","last_active":"2024-08-17T02:27:13.244773+0000","last_peered":"2024-08-17T02:27:13.244773+0000","last_clean":"2024-08-17T02:27:13.244773+0000","last_became_active":"2024-08-17T02:27:13.238741+0000","last_became_peered":"2024-08-17T02:27:13.238741+0000","last_unstale":"2024-08-17T02:27:13.244773+0000","last_undegraded":"2024-08-17T02:27:13.244773+0000","last_fullsized":"2024-08-17T02:27:13.244773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:07.219617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209552+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:46.783236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241656+0000","last_change":"2024-08-17T02:27:13.239592+0000","last_active":"2024-08-17T02:27:13.241656+0000","last_peered":"2024-08-17T02:27:13.241656+0000","last_clean":"2024-08-17T02:27:13.241656+0000","last_became_active":"2024-08-17T02:27:13.239326+0000","last_became_peered":"2024-08-17T02:27:13.239326+0000","last_unstale":"2024-08-17T02:27:13.241656+0000","last_undegraded":"2024-08-17T02:27:13.241656+0000","last_fullsized":"2024-08-17T02:27:13.241656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:07.219617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.222654+0000","last_change":"2024-08-17T02:27:12.233970+0000","last_active":"2024-08-17T02:27:13.222654+0000","last_peered":"2024-08-17T02:27:13.222654+0000","last_clean":"2024-08-17T02:27:13.222654+0000","last_became_active":"2024-08-17T02:27:12.233109+0000","last_became_peered":"2024-08-17T02:27:12.233109+0000","last_unstale":"2024-08-17T02:27:13.222654+0000","last_undegraded":"2024-08-17T02:27:13.222654+0000","last_fullsized":"2024-08-17T02:27:13.222654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:11.084442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.244832+0000","last_change":"2024-08-17T02:27:13.235899+0000","last_active":"2024-08-17T02:27:13.244832+0000","last_peered":"2024-08-17T02:27:13.244832+0000","last_clean":"2024-08-17T02:27:13.244832+0000","last_became_active":"2024-08-17T02:27:13.235378+0000","last_became_peered":"2024-08-17T02:27:13.235378+0000","last_unstale":"2024-08-17T02:27:13.244832+0000","last_undegraded":"2024-08-17T02:27:13.244832+0000","last_fullsized":"2024-08-17T02:27:13.244832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:53.348532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.209126+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:18:29.290649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:27:12.200640+0000","last_change":"2024-08-17T02:27:12.200640+0000","last_active":"2024-08-17T02:27:12.200640+0000","last_peered":"2024-08-17T02:27:12.200640+0000","last_clean":"2024-08-17T02:27:12.200640+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:12.200640+0000","last_undegraded":"2024-08-17T02:27:12.200640+0000","last_fullsized":"2024-08-17T02:27:12.200640+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.229681+0000","last_change":"2024-08-17T02:27:12.236698+0000","last_active":"2024-08-17T02:27:13.229681+0000","last_peered":"2024-08-17T02:27:13.229681+0000","last_clean":"2024-08-17T02:27:13.229681+0000","last_became_active":"2024-08-17T02:27:12.236456+0000","last_became_peered":"2024-08-17T02:27:12.236456+0000","last_unstale":"2024-08-17T02:27:13.229681+0000","last_undegraded":"2024-08-17T02:27:13.229681+0000","last_fullsized":"2024-08-17T02:27:13.229681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:47.163723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249637+0000","last_change":"2024-08-17T02:27:13.247053+0000","last_active":"2024-08-17T02:27:13.249637+0000","last_peered":"2024-08-17T02:27:13.249637+0000","last_clean":"2024-08-17T02:27:13.249637+0000","last_became_active":"2024-08-17T02:27:13.246725+0000","last_became_peered":"2024-08-17T02:27:13.246725+0000","last_unstale":"2024-08-17T02:27:13.249637+0000","last_undegraded":"2024-08-17T02:27:13.249637+0000","last_fullsized":"2024-08-17T02:27:13.249637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:41.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:27:11.190380+0000","last_change":"2024-08-17T02:27:11.211891+0000","last_active":"2024-08-17T02:27:11.190380+0000","last_peered":"2024-08-17T02:27:11.190380+0000","last_clean":"2024-08-17T02:27:11.190380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:27:11.190380+0000","last_undegraded":"2024-08-17T02:27:11.190380+0000","last_fullsized":"2024-08-17T02:27:11.190380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:21.538305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249315+0000","last_change":"2024-08-17T02:27:13.245759+0000","last_active":"2024-08-17T02:27:13.249315+0000","last_peered":"2024-08-17T02:27:13.249315+0000","last_clean":"2024-08-17T02:27:13.249315+0000","last_became_active":"2024-08-17T02:27:13.245444+0000","last_became_peered":"2024-08-17T02:27:13.245444+0000","last_unstale":"2024-08-17T02:27:13.249315+0000","last_undegraded":"2024-08-17T02:27:13.249315+0000","last_fullsized":"2024-08-17T02:27:13.249315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:26.640084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.235882+0000","last_change":"2024-08-17T02:27:12.238075+0000","last_active":"2024-08-17T02:27:13.235882+0000","last_peered":"2024-08-17T02:27:13.235882+0000","last_clean":"2024-08-17T02:27:13.235882+0000","last_became_active":"2024-08-17T02:27:12.237796+0000","last_became_peered":"2024-08-17T02:27:12.237796+0000","last_unstale":"2024-08-17T02:27:13.235882+0000","last_undegraded":"2024-08-17T02:27:13.235882+0000","last_fullsized":"2024-08-17T02:27:13.235882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:11.084442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.239675+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:27:13.239675+0000","last_peered":"2024-08-17T02:27:13.239675+0000","last_clean":"2024-08-17T02:27:13.239675+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:27:13.239675+0000","last_undegraded":"2024-08-17T02:27:13.239675+0000","last_fullsized":"2024-08-17T02:27:13.239675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":76,"acting":76,"num_store_stats":5},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":315392,"data_stored":115557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":327680,"data_stored":121362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297676,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074164,"statfs":{"total":96636764160,"available":96331943936,"internally_reserved":0,"allocated":327680,"data_stored":121362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":962560,"data_stored":731126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1320000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0960000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":372736,"data_stored":141272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":372736,"data_stored":141328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":372736,"data_stored":140772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":958464,"data_stored":731036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:18.194 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-08-17T02:27:18.187+0000 7ff5d3181700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:20.670 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:20.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f177359e700 1 Processor -- start 2024-08-17T02:27:20.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f177359e700 1 -- start start 2024-08-17T02:27:20.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f177359e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1774155390 0x7f1774155760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f177359e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17740682a0 0x7f1774068b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f177359e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177406b6d0 con 0x7f17740c96c0 2024-08-17T02:27:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f177359e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1774068700 con 0x7f17740682a0 2024-08-17T02:27:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f177359e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177406b3f0 con 0x7f1774155390 2024-08-17T02:27:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f1771d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17740682a0 0x7f1774068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f1771d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17740682a0 0x7f1774068b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56520/0 (socket says 172.21.15.19:56520) 2024-08-17T02:27:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f1771d9b700 1 -- 172.21.15.19:0/4170420238 learned_addr learned my addr 172.21.15.19:0/4170420238 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f177259c700 1 --2- 172.21.15.19:0/4170420238 >> v2:172.21.15.119:3300/0 conn(0x7f1774155390 0x7f1774155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f1771d9b700 1 -- 172.21.15.19:0/4170420238 >> v2:172.21.15.119:3300/0 conn(0x7f1774155390 msgr2=0x7f1774155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f177159a700 1 -- 172.21.15.19:0/4170420238 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780336408 0 0) 0x7f177406b6d0 con 0x7f17740c96c0 2024-08-17T02:27:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f1771d9b700 1 --2- 172.21.15.19:0/4170420238 >> v2:172.21.15.119:3300/0 conn(0x7f1774155390 0x7f1774155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.787+0000 7f1771d9b700 1 -- 172.21.15.19:0/4170420238 >> v1:172.21.15.119:6789/0 conn(0x7f17740c96c0 legacy=0x7f17740c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f1771d9b700 1 -- 172.21.15.19:0/4170420238 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740677c0 con 0x7f17740682a0 2024-08-17T02:27:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f1771d9b700 1 --2- 172.21.15.19:0/4170420238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17740682a0 0x7f1774068b30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f17740cd650 tx=0x7f1768009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afe4092688cd16 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177159a700 1 -- 172.21.15.19:0/4170420238 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768009e70 con 0x7f17740682a0 2024-08-17T02:27:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177159a700 1 -- 172.21.15.19:0/4170420238 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176800b860 con 0x7f17740682a0 2024-08-17T02:27:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177159a700 1 -- 172.21.15.19:0/4170420238 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176800bc00 con 0x7f17740682a0 2024-08-17T02:27:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177359e700 1 -- 172.21.15.19:0/4170420238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17740682a0 msgr2=0x7f1774068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177359e700 1 --2- 172.21.15.19:0/4170420238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17740682a0 0x7f1774068b30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f17740cd650 tx=0x7f1768009250 comp rx=0 tx=0).stop 2024-08-17T02:27:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177359e700 1 -- 172.21.15.19:0/4170420238 shutdown_connections 2024-08-17T02:27:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177359e700 1 --2- 172.21.15.19:0/4170420238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17740682a0 0x7f1774068b30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177359e700 1 --2- 172.21.15.19:0/4170420238 >> v2:172.21.15.119:3300/0 conn(0x7f1774155390 0x7f1774155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177359e700 1 -- 172.21.15.19:0/4170420238 >> 172.21.15.19:0/4170420238 conn(0x7f17740ccfc0 msgr2=0x7f17740c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177359e700 1 -- 172.21.15.19:0/4170420238 shutdown_connections 2024-08-17T02:27:20.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.791+0000 7f177359e700 1 -- 172.21.15.19:0/4170420238 wait complete. 2024-08-17T02:27:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f177359e700 1 Processor -- start 2024-08-17T02:27:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f177359e700 1 -- start start 2024-08-17T02:27:20.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f177359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17740682a0 0x7f1774148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f177359e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17740c96c0 0x7f1774169a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f177359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1774155390 0x7f1774152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f177359e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177414e0c0 con 0x7f1774155390 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f177359e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177414d4b0 con 0x7f17740c96c0 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f177359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177414d790 con 0x7f17740682a0 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f1772d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1774155390 0x7f1774152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f1772d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1774155390 0x7f1774152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56524/0 (socket says 172.21.15.19:56524) 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f1772d9d700 1 -- 172.21.15.19:0/2863540378 learned_addr learned my addr 172.21.15.19:0/2863540378 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f177259c700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17740682a0 0x7f1774148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.795+0000 7f1771d9b700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17740c96c0 0x7f1774169a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f1772d9d700 1 -- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17740682a0 msgr2=0x7f1774148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f1772d9d700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17740682a0 0x7f1774148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f1772d9d700 1 -- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17740c96c0 msgr2=0x7f1774169a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f1772d9d700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17740c96c0 0x7f1774169a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f1772d9d700 1 -- 172.21.15.19:0/2863540378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680094f0 con 0x7f1774155390 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f1772d9d700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1774155390 0x7f1774152f00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f176c00c860 tx=0x7f176c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f17627fc700 1 -- 172.21.15.19:0/2863540378 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c012630 con 0x7f1774155390 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f17627fc700 1 -- 172.21.15.19:0/2863540378 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0127b0 con 0x7f1774155390 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177414da70 con 0x7f1774155390 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f17627fc700 1 -- 172.21.15.19:0/2863540378 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c012b70 con 0x7f1774155390 2024-08-17T02:27:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177414e550 con 0x7f1774155390 2024-08-17T02:27:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177414def0 con 0x7f1774155390 2024-08-17T02:27:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f17627fc700 1 -- 172.21.15.19:0/2863540378 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f176c01b400 con 0x7f1774155390 2024-08-17T02:27:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f17627fc700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1754060860 0x7f1754062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.799+0000 7f17627fc700 1 -- 172.21.15.19:0/2863540378 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f176c07ce00 con 0x7f1774155390 2024-08-17T02:27:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.803+0000 7f177259c700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1754060860 0x7f1754062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.803+0000 7f177259c700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1754060860 0x7f1754062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1764009db0 tx=0x7f17640091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.807+0000 7f17627fc700 1 -- 172.21.15.19:0/2863540378 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f176c04d250 con 0x7f1774155390 2024-08-17T02:27:20.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.967+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17740638f0 con 0x7f1754060860 2024-08-17T02:27:20.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.983+0000 7f17627fc700 1 -- 172.21.15.19:0/2863540378 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264519 (secure 0 0 0) 0x7f17740638f0 con 0x7f1754060860 2024-08-17T02:27:20.991 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1754060860 msgr2=0x7f1754062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1754060860 0x7f1754062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1764009db0 tx=0x7f17640091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1774155390 msgr2=0x7f1774152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1774155390 0x7f1774152f00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f176c00c860 tx=0x7f176c001670 comp rx=0 tx=0).stop 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 shutdown_connections 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1754060860 0x7f1754062d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1774155390 0x7f1774152f00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17740c96c0 0x7f1774169a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 --2- 172.21.15.19:0/2863540378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17740682a0 0x7f1774148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 >> 172.21.15.19:0/2863540378 conn(0x7f17740ccfc0 msgr2=0x7f17740ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 shutdown_connections 2024-08-17T02:27:20.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:20.987+0000 7f177359e700 1 -- 172.21.15.19:0/2863540378 wait complete. 2024-08-17T02:27:20.995 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:27:21.007 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-08-17T02:27:20.779757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382944,"kb_used_data":4072,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591776,"statfs":{"total":773094113280,"available":770653978624,"internally_reserved":0,"allocated":4169728,"data_stored":2310756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002903"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.246907+0000","last_change":"2024-08-17T02:27:13.242833+0000","last_active":"2024-08-17T02:27:13.246907+0000","last_peered":"2024-08-17T02:27:13.246907+0000","last_clean":"2024-08-17T02:27:13.246907+0000","last_became_active":"2024-08-17T02:27:13.242536+0000","last_became_peered":"2024-08-17T02:27:13.242536+0000","last_unstale":"2024-08-17T02:27:13.246907+0000","last_undegraded":"2024-08-17T02:27:13.246907+0000","last_fullsized":"2024-08-17T02:27:13.246907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:38:29.067933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.248008+0000","last_change":"2024-08-17T02:27:13.242026+0000","last_active":"2024-08-17T02:27:13.248008+0000","last_peered":"2024-08-17T02:27:13.248008+0000","last_clean":"2024-08-17T02:27:13.248008+0000","last_became_active":"2024-08-17T02:27:13.240250+0000","last_became_peered":"2024-08-17T02:27:13.240250+0000","last_unstale":"2024-08-17T02:27:13.248008+0000","last_undegraded":"2024-08-17T02:27:13.248008+0000","last_fullsized":"2024-08-17T02:27:13.248008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:58.183390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241762+0000","last_change":"2024-08-17T02:27:13.239546+0000","last_active":"2024-08-17T02:27:13.241762+0000","last_peered":"2024-08-17T02:27:13.241762+0000","last_clean":"2024-08-17T02:27:13.241762+0000","last_became_active":"2024-08-17T02:27:13.239284+0000","last_became_peered":"2024-08-17T02:27:13.239284+0000","last_unstale":"2024-08-17T02:27:13.241762+0000","last_undegraded":"2024-08-17T02:27:13.241762+0000","last_fullsized":"2024-08-17T02:27:13.241762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:23.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241103+0000","last_change":"2024-08-17T02:27:13.236846+0000","last_active":"2024-08-17T02:27:13.241103+0000","last_peered":"2024-08-17T02:27:13.241103+0000","last_clean":"2024-08-17T02:27:13.241103+0000","last_became_active":"2024-08-17T02:27:13.236418+0000","last_became_peered":"2024-08-17T02:27:13.236418+0000","last_unstale":"2024-08-17T02:27:13.241103+0000","last_undegraded":"2024-08-17T02:27:13.241103+0000","last_fullsized":"2024-08-17T02:27:13.241103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:08.014483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252115+0000","last_change":"2024-08-17T02:27:13.245546+0000","last_active":"2024-08-17T02:27:13.252115+0000","last_peered":"2024-08-17T02:27:13.252115+0000","last_clean":"2024-08-17T02:27:13.252115+0000","last_became_active":"2024-08-17T02:27:13.245190+0000","last_became_peered":"2024-08-17T02:27:13.245190+0000","last_unstale":"2024-08-17T02:27:13.252115+0000","last_undegraded":"2024-08-17T02:27:13.252115+0000","last_fullsized":"2024-08-17T02:27:13.252115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:16.744057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247936+0000","last_change":"2024-08-17T02:27:13.243714+0000","last_active":"2024-08-17T02:27:13.247936+0000","last_peered":"2024-08-17T02:27:13.247936+0000","last_clean":"2024-08-17T02:27:13.247936+0000","last_became_active":"2024-08-17T02:27:13.243344+0000","last_became_peered":"2024-08-17T02:27:13.243344+0000","last_unstale":"2024-08-17T02:27:13.247936+0000","last_undegraded":"2024-08-17T02:27:13.247936+0000","last_fullsized":"2024-08-17T02:27:13.247936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:16.812004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252216+0000","last_change":"2024-08-17T02:27:13.248893+0000","last_active":"2024-08-17T02:27:13.252216+0000","last_peered":"2024-08-17T02:27:13.252216+0000","last_clean":"2024-08-17T02:27:13.252216+0000","last_became_active":"2024-08-17T02:27:13.248603+0000","last_became_peered":"2024-08-17T02:27:13.248603+0000","last_unstale":"2024-08-17T02:27:13.252216+0000","last_undegraded":"2024-08-17T02:27:13.252216+0000","last_fullsized":"2024-08-17T02:27:13.252216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:42.696716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252379+0000","last_change":"2024-08-17T02:27:13.250161+0000","last_active":"2024-08-17T02:27:13.252379+0000","last_peered":"2024-08-17T02:27:13.252379+0000","last_clean":"2024-08-17T02:27:13.252379+0000","last_became_active":"2024-08-17T02:27:13.249894+0000","last_became_peered":"2024-08-17T02:27:13.249894+0000","last_unstale":"2024-08-17T02:27:13.252379+0000","last_undegraded":"2024-08-17T02:27:13.252379+0000","last_fullsized":"2024-08-17T02:27:13.252379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:23.385939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.243849+0000","last_change":"2024-08-17T02:27:13.241659+0000","last_active":"2024-08-17T02:27:13.243849+0000","last_peered":"2024-08-17T02:27:13.243849+0000","last_clean":"2024-08-17T02:27:13.243849+0000","last_became_active":"2024-08-17T02:27:13.241320+0000","last_became_peered":"2024-08-17T02:27:13.241320+0000","last_unstale":"2024-08-17T02:27:13.243849+0000","last_undegraded":"2024-08-17T02:27:13.243849+0000","last_fullsized":"2024-08-17T02:27:13.243849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:15:11.517561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247440+0000","last_change":"2024-08-17T02:27:13.240863+0000","last_active":"2024-08-17T02:27:13.247440+0000","last_peered":"2024-08-17T02:27:13.247440+0000","last_clean":"2024-08-17T02:27:13.247440+0000","last_became_active":"2024-08-17T02:27:13.240307+0000","last_became_peered":"2024-08-17T02:27:13.240307+0000","last_unstale":"2024-08-17T02:27:13.247440+0000","last_undegraded":"2024-08-17T02:27:13.247440+0000","last_fullsized":"2024-08-17T02:27:13.247440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:59.702789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.251963+0000","last_change":"2024-08-17T02:27:13.247943+0000","last_active":"2024-08-17T02:27:13.251963+0000","last_peered":"2024-08-17T02:27:13.251963+0000","last_clean":"2024-08-17T02:27:13.251963+0000","last_became_active":"2024-08-17T02:27:13.246153+0000","last_became_peered":"2024-08-17T02:27:13.246153+0000","last_unstale":"2024-08-17T02:27:13.251963+0000","last_undegraded":"2024-08-17T02:27:13.251963+0000","last_fullsized":"2024-08-17T02:27:13.251963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:58.769663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249519+0000","last_change":"2024-08-17T02:27:13.245414+0000","last_active":"2024-08-17T02:27:13.249519+0000","last_peered":"2024-08-17T02:27:13.249519+0000","last_clean":"2024-08-17T02:27:13.249519+0000","last_became_active":"2024-08-17T02:27:13.245109+0000","last_became_peered":"2024-08-17T02:27:13.245109+0000","last_unstale":"2024-08-17T02:27:13.249519+0000","last_undegraded":"2024-08-17T02:27:13.249519+0000","last_fullsized":"2024-08-17T02:27:13.249519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:12.139471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247533+0000","last_change":"2024-08-17T02:27:13.238931+0000","last_active":"2024-08-17T02:27:13.247533+0000","last_peered":"2024-08-17T02:27:13.247533+0000","last_clean":"2024-08-17T02:27:13.247533+0000","last_became_active":"2024-08-17T02:27:13.238640+0000","last_became_peered":"2024-08-17T02:27:13.238640+0000","last_unstale":"2024-08-17T02:27:13.247533+0000","last_undegraded":"2024-08-17T02:27:13.247533+0000","last_fullsized":"2024-08-17T02:27:13.247533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:22.989981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247958+0000","last_change":"2024-08-17T02:27:13.243912+0000","last_active":"2024-08-17T02:27:13.247958+0000","last_peered":"2024-08-17T02:27:13.247958+0000","last_clean":"2024-08-17T02:27:13.247958+0000","last_became_active":"2024-08-17T02:27:13.243180+0000","last_became_peered":"2024-08-17T02:27:13.243180+0000","last_unstale":"2024-08-17T02:27:13.247958+0000","last_undegraded":"2024-08-17T02:27:13.247958+0000","last_fullsized":"2024-08-17T02:27:13.247958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:09:59.702789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249626+0000","last_change":"2024-08-17T02:27:13.245575+0000","last_active":"2024-08-17T02:27:13.249626+0000","last_peered":"2024-08-17T02:27:13.249626+0000","last_clean":"2024-08-17T02:27:13.249626+0000","last_became_active":"2024-08-17T02:27:13.245306+0000","last_became_peered":"2024-08-17T02:27:13.245306+0000","last_unstale":"2024-08-17T02:27:13.249626+0000","last_undegraded":"2024-08-17T02:27:13.249626+0000","last_fullsized":"2024-08-17T02:27:13.249626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:49.380480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249384+0000","last_change":"2024-08-17T02:27:13.245904+0000","last_active":"2024-08-17T02:27:13.249384+0000","last_peered":"2024-08-17T02:27:13.249384+0000","last_clean":"2024-08-17T02:27:13.249384+0000","last_became_active":"2024-08-17T02:27:13.245626+0000","last_became_peered":"2024-08-17T02:27:13.245626+0000","last_unstale":"2024-08-17T02:27:13.249384+0000","last_undegraded":"2024-08-17T02:27:13.249384+0000","last_fullsized":"2024-08-17T02:27:13.249384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:43.344644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249136+0000","last_change":"2024-08-17T02:27:13.245033+0000","last_active":"2024-08-17T02:27:13.249136+0000","last_peered":"2024-08-17T02:27:13.249136+0000","last_clean":"2024-08-17T02:27:13.249136+0000","last_became_active":"2024-08-17T02:27:13.243797+0000","last_became_peered":"2024-08-17T02:27:13.243797+0000","last_unstale":"2024-08-17T02:27:13.249136+0000","last_undegraded":"2024-08-17T02:27:13.249136+0000","last_fullsized":"2024-08-17T02:27:13.249136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:25:02.364249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.248032+0000","last_change":"2024-08-17T02:27:13.243482+0000","last_active":"2024-08-17T02:27:13.248032+0000","last_peered":"2024-08-17T02:27:13.248032+0000","last_clean":"2024-08-17T02:27:13.248032+0000","last_became_active":"2024-08-17T02:27:13.240719+0000","last_became_peered":"2024-08-17T02:27:13.240719+0000","last_unstale":"2024-08-17T02:27:13.248032+0000","last_undegraded":"2024-08-17T02:27:13.248032+0000","last_fullsized":"2024-08-17T02:27:13.248032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:49.284556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.250620+0000","last_change":"2024-08-17T02:27:13.246121+0000","last_active":"2024-08-17T02:27:13.250620+0000","last_peered":"2024-08-17T02:27:13.250620+0000","last_clean":"2024-08-17T02:27:13.250620+0000","last_became_active":"2024-08-17T02:27:13.244678+0000","last_became_peered":"2024-08-17T02:27:13.244678+0000","last_unstale":"2024-08-17T02:27:13.250620+0000","last_undegraded":"2024-08-17T02:27:13.250620+0000","last_fullsized":"2024-08-17T02:27:13.250620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:07:33.776246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247778+0000","last_change":"2024-08-17T02:27:13.239817+0000","last_active":"2024-08-17T02:27:13.247778+0000","last_peered":"2024-08-17T02:27:13.247778+0000","last_clean":"2024-08-17T02:27:13.247778+0000","last_became_active":"2024-08-17T02:27:13.239506+0000","last_became_peered":"2024-08-17T02:27:13.239506+0000","last_unstale":"2024-08-17T02:27:13.247778+0000","last_undegraded":"2024-08-17T02:27:13.247778+0000","last_fullsized":"2024-08-17T02:27:13.247778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:22.548566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.242621+0000","last_change":"2024-08-17T02:27:13.236176+0000","last_active":"2024-08-17T02:27:13.242621+0000","last_peered":"2024-08-17T02:27:13.242621+0000","last_clean":"2024-08-17T02:27:13.242621+0000","last_became_active":"2024-08-17T02:27:13.235912+0000","last_became_peered":"2024-08-17T02:27:13.235912+0000","last_unstale":"2024-08-17T02:27:13.242621+0000","last_undegraded":"2024-08-17T02:27:13.242621+0000","last_fullsized":"2024-08-17T02:27:13.242621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:06.659613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249346+0000","last_change":"2024-08-17T02:27:13.244677+0000","last_active":"2024-08-17T02:27:13.249346+0000","last_peered":"2024-08-17T02:27:13.249346+0000","last_clean":"2024-08-17T02:27:13.249346+0000","last_became_active":"2024-08-17T02:27:13.244354+0000","last_became_peered":"2024-08-17T02:27:13.244354+0000","last_unstale":"2024-08-17T02:27:13.249346+0000","last_undegraded":"2024-08-17T02:27:13.249346+0000","last_fullsized":"2024-08-17T02:27:13.249346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:58:59.215561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247620+0000","last_change":"2024-08-17T02:27:13.242670+0000","last_active":"2024-08-17T02:27:13.247620+0000","last_peered":"2024-08-17T02:27:13.247620+0000","last_clean":"2024-08-17T02:27:13.247620+0000","last_became_active":"2024-08-17T02:27:13.242369+0000","last_became_peered":"2024-08-17T02:27:13.242369+0000","last_unstale":"2024-08-17T02:27:13.247620+0000","last_undegraded":"2024-08-17T02:27:13.247620+0000","last_fullsized":"2024-08-17T02:27:13.247620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:04.981661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241415+0000","last_change":"2024-08-17T02:27:13.238335+0000","last_active":"2024-08-17T02:27:13.241415+0000","last_peered":"2024-08-17T02:27:13.241415+0000","last_clean":"2024-08-17T02:27:13.241415+0000","last_became_active":"2024-08-17T02:27:13.238034+0000","last_became_peered":"2024-08-17T02:27:13.238034+0000","last_unstale":"2024-08-17T02:27:13.241415+0000","last_undegraded":"2024-08-17T02:27:13.241415+0000","last_fullsized":"2024-08-17T02:27:13.241415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:59.482871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.250535+0000","last_change":"2024-08-17T02:27:13.245710+0000","last_active":"2024-08-17T02:27:13.250535+0000","last_peered":"2024-08-17T02:27:13.250535+0000","last_clean":"2024-08-17T02:27:13.250535+0000","last_became_active":"2024-08-17T02:27:13.245274+0000","last_became_peered":"2024-08-17T02:27:13.245274+0000","last_unstale":"2024-08-17T02:27:13.250535+0000","last_undegraded":"2024-08-17T02:27:13.250535+0000","last_fullsized":"2024-08-17T02:27:13.250535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:44:15.133733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.253857+0000","last_change":"2024-08-17T02:27:13.248326+0000","last_active":"2024-08-17T02:27:13.253857+0000","last_peered":"2024-08-17T02:27:13.253857+0000","last_clean":"2024-08-17T02:27:13.253857+0000","last_became_active":"2024-08-17T02:27:13.248004+0000","last_became_peered":"2024-08-17T02:27:13.248004+0000","last_unstale":"2024-08-17T02:27:13.253857+0000","last_undegraded":"2024-08-17T02:27:13.253857+0000","last_fullsized":"2024-08-17T02:27:13.253857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:35:20.047228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.250485+0000","last_change":"2024-08-17T02:27:13.244603+0000","last_active":"2024-08-17T02:27:13.250485+0000","last_peered":"2024-08-17T02:27:13.250485+0000","last_clean":"2024-08-17T02:27:13.250485+0000","last_became_active":"2024-08-17T02:27:13.243777+0000","last_became_peered":"2024-08-17T02:27:13.243777+0000","last_unstale":"2024-08-17T02:27:13.250485+0000","last_undegraded":"2024-08-17T02:27:13.250485+0000","last_fullsized":"2024-08-17T02:27:13.250485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:45.030748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.242073+0000","last_change":"2024-08-17T02:27:13.235368+0000","last_active":"2024-08-17T02:27:13.242073+0000","last_peered":"2024-08-17T02:27:13.242073+0000","last_clean":"2024-08-17T02:27:13.242073+0000","last_became_active":"2024-08-17T02:27:13.235056+0000","last_became_peered":"2024-08-17T02:27:13.235056+0000","last_unstale":"2024-08-17T02:27:13.242073+0000","last_undegraded":"2024-08-17T02:27:13.242073+0000","last_fullsized":"2024-08-17T02:27:13.242073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:35.785891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249387+0000","last_change":"2024-08-17T02:27:13.244838+0000","last_active":"2024-08-17T02:27:13.249387+0000","last_peered":"2024-08-17T02:27:13.249387+0000","last_clean":"2024-08-17T02:27:13.249387+0000","last_became_active":"2024-08-17T02:27:13.244506+0000","last_became_peered":"2024-08-17T02:27:13.244506+0000","last_unstale":"2024-08-17T02:27:13.249387+0000","last_undegraded":"2024-08-17T02:27:13.249387+0000","last_fullsized":"2024-08-17T02:27:13.249387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:59.482871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249298+0000","last_change":"2024-08-17T02:27:13.245329+0000","last_active":"2024-08-17T02:27:13.249298+0000","last_peered":"2024-08-17T02:27:13.249298+0000","last_clean":"2024-08-17T02:27:13.249298+0000","last_became_active":"2024-08-17T02:27:13.243920+0000","last_became_peered":"2024-08-17T02:27:13.243920+0000","last_unstale":"2024-08-17T02:27:13.249298+0000","last_undegraded":"2024-08-17T02:27:13.249298+0000","last_fullsized":"2024-08-17T02:27:13.249298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:59.482871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249681+0000","last_change":"2024-08-17T02:27:13.245374+0000","last_active":"2024-08-17T02:27:13.249681+0000","last_peered":"2024-08-17T02:27:13.249681+0000","last_clean":"2024-08-17T02:27:13.249681+0000","last_became_active":"2024-08-17T02:27:13.245113+0000","last_became_peered":"2024-08-17T02:27:13.245113+0000","last_unstale":"2024-08-17T02:27:13.249681+0000","last_undegraded":"2024-08-17T02:27:13.249681+0000","last_fullsized":"2024-08-17T02:27:13.249681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:32.120060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249364+0000","last_change":"2024-08-17T02:27:13.245331+0000","last_active":"2024-08-17T02:27:13.249364+0000","last_peered":"2024-08-17T02:27:13.249364+0000","last_clean":"2024-08-17T02:27:13.249364+0000","last_became_active":"2024-08-17T02:27:13.243905+0000","last_became_peered":"2024-08-17T02:27:13.243905+0000","last_unstale":"2024-08-17T02:27:13.249364+0000","last_undegraded":"2024-08-17T02:27:13.249364+0000","last_fullsized":"2024-08-17T02:27:13.249364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:07.371281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247590+0000","last_change":"2024-08-17T02:27:13.242465+0000","last_active":"2024-08-17T02:27:13.247590+0000","last_peered":"2024-08-17T02:27:13.247590+0000","last_clean":"2024-08-17T02:27:13.247590+0000","last_became_active":"2024-08-17T02:27:13.242159+0000","last_became_peered":"2024-08-17T02:27:13.242159+0000","last_unstale":"2024-08-17T02:27:13.247590+0000","last_undegraded":"2024-08-17T02:27:13.247590+0000","last_fullsized":"2024-08-17T02:27:13.247590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:32.120060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265274+0000","last_change":"2024-08-17T02:27:12.239872+0000","last_active":"2024-08-17T02:27:13.265274+0000","last_peered":"2024-08-17T02:27:13.265274+0000","last_clean":"2024-08-17T02:27:13.265274+0000","last_became_active":"2024-08-17T02:27:12.239546+0000","last_became_peered":"2024-08-17T02:27:12.239546+0000","last_unstale":"2024-08-17T02:27:13.265274+0000","last_undegraded":"2024-08-17T02:27:13.265274+0000","last_fullsized":"2024-08-17T02:27:13.265274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:52.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.246884+0000","last_change":"2024-08-17T02:27:13.240993+0000","last_active":"2024-08-17T02:27:13.246884+0000","last_peered":"2024-08-17T02:27:13.246884+0000","last_clean":"2024-08-17T02:27:13.246884+0000","last_became_active":"2024-08-17T02:27:13.240684+0000","last_became_peered":"2024-08-17T02:27:13.240684+0000","last_unstale":"2024-08-17T02:27:13.246884+0000","last_undegraded":"2024-08-17T02:27:13.246884+0000","last_fullsized":"2024-08-17T02:27:13.246884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:53.348532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.262636+0000","last_change":"2024-08-17T02:27:12.239317+0000","last_active":"2024-08-17T02:27:13.262636+0000","last_peered":"2024-08-17T02:27:13.262636+0000","last_clean":"2024-08-17T02:27:13.262636+0000","last_became_active":"2024-08-17T02:27:12.238976+0000","last_became_peered":"2024-08-17T02:27:12.238976+0000","last_unstale":"2024-08-17T02:27:13.262636+0000","last_undegraded":"2024-08-17T02:27:13.262636+0000","last_fullsized":"2024-08-17T02:27:13.262636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:49:23.095686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.243790+0000","last_change":"2024-08-17T02:27:13.240138+0000","last_active":"2024-08-17T02:27:13.243790+0000","last_peered":"2024-08-17T02:27:13.243790+0000","last_clean":"2024-08-17T02:27:13.243790+0000","last_became_active":"2024-08-17T02:27:13.239834+0000","last_became_peered":"2024-08-17T02:27:13.239834+0000","last_unstale":"2024-08-17T02:27:13.243790+0000","last_undegraded":"2024-08-17T02:27:13.243790+0000","last_fullsized":"2024-08-17T02:27:13.243790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:25:02.364249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265414+0000","last_change":"2024-08-17T02:27:12.244949+0000","last_active":"2024-08-17T02:27:13.265414+0000","last_peered":"2024-08-17T02:27:13.265414+0000","last_clean":"2024-08-17T02:27:13.265414+0000","last_became_active":"2024-08-17T02:27:12.244608+0000","last_became_peered":"2024-08-17T02:27:12.244608+0000","last_unstale":"2024-08-17T02:27:13.265414+0000","last_undegraded":"2024-08-17T02:27:13.265414+0000","last_fullsized":"2024-08-17T02:27:13.265414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:23:57.924674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.250464+0000","last_change":"2024-08-17T02:27:13.243898+0000","last_active":"2024-08-17T02:27:13.250464+0000","last_peered":"2024-08-17T02:27:13.250464+0000","last_clean":"2024-08-17T02:27:13.250464+0000","last_became_active":"2024-08-17T02:27:13.241953+0000","last_became_peered":"2024-08-17T02:27:13.241953+0000","last_unstale":"2024-08-17T02:27:13.250464+0000","last_undegraded":"2024-08-17T02:27:13.250464+0000","last_fullsized":"2024-08-17T02:27:13.250464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:12.774687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.263340+0000","last_change":"2024-08-17T02:27:12.244302+0000","last_active":"2024-08-17T02:27:13.263340+0000","last_peered":"2024-08-17T02:27:13.263340+0000","last_clean":"2024-08-17T02:27:13.263340+0000","last_became_active":"2024-08-17T02:27:12.243935+0000","last_became_peered":"2024-08-17T02:27:12.243935+0000","last_unstale":"2024-08-17T02:27:13.263340+0000","last_undegraded":"2024-08-17T02:27:13.263340+0000","last_fullsized":"2024-08-17T02:27:13.263340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:35:24.527859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.251917+0000","last_change":"2024-08-17T02:27:13.246559+0000","last_active":"2024-08-17T02:27:13.251917+0000","last_peered":"2024-08-17T02:27:13.251917+0000","last_clean":"2024-08-17T02:27:13.251917+0000","last_became_active":"2024-08-17T02:27:13.246190+0000","last_became_peered":"2024-08-17T02:27:13.246190+0000","last_unstale":"2024-08-17T02:27:13.251917+0000","last_undegraded":"2024-08-17T02:27:13.251917+0000","last_fullsized":"2024-08-17T02:27:13.251917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:06.659613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.264719+0000","last_change":"2024-08-17T02:27:12.242600+0000","last_active":"2024-08-17T02:27:13.264719+0000","last_peered":"2024-08-17T02:27:13.264719+0000","last_clean":"2024-08-17T02:27:13.264719+0000","last_became_active":"2024-08-17T02:27:12.242068+0000","last_became_peered":"2024-08-17T02:27:12.242068+0000","last_unstale":"2024-08-17T02:27:13.264719+0000","last_undegraded":"2024-08-17T02:27:13.264719+0000","last_fullsized":"2024-08-17T02:27:13.264719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:48:52.974225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241468+0000","last_change":"2024-08-17T02:27:13.236477+0000","last_active":"2024-08-17T02:27:13.241468+0000","last_peered":"2024-08-17T02:27:13.241468+0000","last_clean":"2024-08-17T02:27:13.241468+0000","last_became_active":"2024-08-17T02:27:13.236212+0000","last_became_peered":"2024-08-17T02:27:13.236212+0000","last_unstale":"2024-08-17T02:27:13.241468+0000","last_undegraded":"2024-08-17T02:27:13.241468+0000","last_fullsized":"2024-08-17T02:27:13.241468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:17:58.769663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265009+0000","last_change":"2024-08-17T02:27:12.242373+0000","last_active":"2024-08-17T02:27:13.265009+0000","last_peered":"2024-08-17T02:27:13.265009+0000","last_clean":"2024-08-17T02:27:13.265009+0000","last_became_active":"2024-08-17T02:27:12.242025+0000","last_became_peered":"2024-08-17T02:27:12.242025+0000","last_unstale":"2024-08-17T02:27:13.265009+0000","last_undegraded":"2024-08-17T02:27:13.265009+0000","last_fullsized":"2024-08-17T02:27:13.265009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:11.084442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247571+0000","last_change":"2024-08-17T02:27:13.242571+0000","last_active":"2024-08-17T02:27:13.247571+0000","last_peered":"2024-08-17T02:27:13.247571+0000","last_clean":"2024-08-17T02:27:13.247571+0000","last_became_active":"2024-08-17T02:27:13.242310+0000","last_became_peered":"2024-08-17T02:27:13.242310+0000","last_unstale":"2024-08-17T02:27:13.247571+0000","last_undegraded":"2024-08-17T02:27:13.247571+0000","last_fullsized":"2024-08-17T02:27:13.247571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:42.696716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.238463+0000","last_change":"2024-08-17T02:27:12.248773+0000","last_active":"2024-08-17T02:27:13.238463+0000","last_peered":"2024-08-17T02:27:13.238463+0000","last_clean":"2024-08-17T02:27:13.238463+0000","last_became_active":"2024-08-17T02:27:12.248480+0000","last_became_peered":"2024-08-17T02:27:12.248480+0000","last_unstale":"2024-08-17T02:27:13.238463+0000","last_undegraded":"2024-08-17T02:27:13.238463+0000","last_fullsized":"2024-08-17T02:27:13.238463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:30:18.306501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247491+0000","last_change":"2024-08-17T02:27:13.241473+0000","last_active":"2024-08-17T02:27:13.247491+0000","last_peered":"2024-08-17T02:27:13.247491+0000","last_clean":"2024-08-17T02:27:13.247491+0000","last_became_active":"2024-08-17T02:27:13.241173+0000","last_became_peered":"2024-08-17T02:27:13.241173+0000","last_unstale":"2024-08-17T02:27:13.247491+0000","last_undegraded":"2024-08-17T02:27:13.247491+0000","last_fullsized":"2024-08-17T02:27:13.247491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:49.284556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.230122+0000","last_change":"2024-08-17T02:27:12.236935+0000","last_active":"2024-08-17T02:27:13.230122+0000","last_peered":"2024-08-17T02:27:13.230122+0000","last_clean":"2024-08-17T02:27:13.230122+0000","last_became_active":"2024-08-17T02:27:12.236487+0000","last_became_peered":"2024-08-17T02:27:12.236487+0000","last_unstale":"2024-08-17T02:27:13.230122+0000","last_undegraded":"2024-08-17T02:27:13.230122+0000","last_fullsized":"2024-08-17T02:27:13.230122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:30.698821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247416+0000","last_change":"2024-08-17T02:27:13.242591+0000","last_active":"2024-08-17T02:27:13.247416+0000","last_peered":"2024-08-17T02:27:13.247416+0000","last_clean":"2024-08-17T02:27:13.247416+0000","last_became_active":"2024-08-17T02:27:13.242329+0000","last_became_peered":"2024-08-17T02:27:13.242329+0000","last_unstale":"2024-08-17T02:27:13.247416+0000","last_undegraded":"2024-08-17T02:27:13.247416+0000","last_fullsized":"2024-08-17T02:27:13.247416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:20:43.344644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241387+0000","last_change":"2024-08-17T02:27:12.244685+0000","last_active":"2024-08-17T02:27:13.241387+0000","last_peered":"2024-08-17T02:27:13.241387+0000","last_clean":"2024-08-17T02:27:13.241387+0000","last_became_active":"2024-08-17T02:27:12.244261+0000","last_became_peered":"2024-08-17T02:27:12.244261+0000","last_unstale":"2024-08-17T02:27:13.241387+0000","last_undegraded":"2024-08-17T02:27:13.241387+0000","last_fullsized":"2024-08-17T02:27:13.241387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:56.708256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247824+0000","last_change":"2024-08-17T02:27:13.242859+0000","last_active":"2024-08-17T02:27:13.247824+0000","last_peered":"2024-08-17T02:27:13.247824+0000","last_clean":"2024-08-17T02:27:13.247824+0000","last_became_active":"2024-08-17T02:27:13.242567+0000","last_became_peered":"2024-08-17T02:27:13.242567+0000","last_unstale":"2024-08-17T02:27:13.247824+0000","last_undegraded":"2024-08-17T02:27:13.247824+0000","last_fullsized":"2024-08-17T02:27:13.247824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:23:36.588876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.223731+0000","last_change":"2024-08-17T02:27:12.236563+0000","last_active":"2024-08-17T02:27:13.223731+0000","last_peered":"2024-08-17T02:27:13.223731+0000","last_clean":"2024-08-17T02:27:13.223731+0000","last_became_active":"2024-08-17T02:27:12.235239+0000","last_became_peered":"2024-08-17T02:27:12.235239+0000","last_unstale":"2024-08-17T02:27:13.223731+0000","last_undegraded":"2024-08-17T02:27:13.223731+0000","last_fullsized":"2024-08-17T02:27:13.223731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:38.943779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252189+0000","last_change":"2024-08-17T02:27:13.247242+0000","last_active":"2024-08-17T02:27:13.252189+0000","last_peered":"2024-08-17T02:27:13.252189+0000","last_clean":"2024-08-17T02:27:13.252189+0000","last_became_active":"2024-08-17T02:27:13.247009+0000","last_became_peered":"2024-08-17T02:27:13.247009+0000","last_unstale":"2024-08-17T02:27:13.252189+0000","last_undegraded":"2024-08-17T02:27:13.252189+0000","last_fullsized":"2024-08-17T02:27:13.252189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:27.830765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265025+0000","last_change":"2024-08-17T02:27:12.241247+0000","last_active":"2024-08-17T02:27:13.265025+0000","last_peered":"2024-08-17T02:27:13.265025+0000","last_clean":"2024-08-17T02:27:13.265025+0000","last_became_active":"2024-08-17T02:27:12.240162+0000","last_became_peered":"2024-08-17T02:27:12.240162+0000","last_unstale":"2024-08-17T02:27:13.265025+0000","last_undegraded":"2024-08-17T02:27:13.265025+0000","last_fullsized":"2024-08-17T02:27:13.265025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:16:47.562823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241745+0000","last_change":"2024-08-17T02:27:13.239407+0000","last_active":"2024-08-17T02:27:13.241745+0000","last_peered":"2024-08-17T02:27:13.241745+0000","last_clean":"2024-08-17T02:27:13.241745+0000","last_became_active":"2024-08-17T02:27:13.239000+0000","last_became_peered":"2024-08-17T02:27:13.239000+0000","last_unstale":"2024-08-17T02:27:13.241745+0000","last_undegraded":"2024-08-17T02:27:13.241745+0000","last_fullsized":"2024-08-17T02:27:13.241745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:53:07.371281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.267842+0000","last_change":"2024-08-17T02:27:12.244152+0000","last_active":"2024-08-17T02:27:13.267842+0000","last_peered":"2024-08-17T02:27:13.267842+0000","last_clean":"2024-08-17T02:27:13.267842+0000","last_became_active":"2024-08-17T02:27:12.243798+0000","last_became_peered":"2024-08-17T02:27:12.243798+0000","last_unstale":"2024-08-17T02:27:13.267842+0000","last_undegraded":"2024-08-17T02:27:13.267842+0000","last_fullsized":"2024-08-17T02:27:13.267842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:49:44.575201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247702+0000","last_change":"2024-08-17T02:27:13.242357+0000","last_active":"2024-08-17T02:27:13.247702+0000","last_peered":"2024-08-17T02:27:13.247702+0000","last_clean":"2024-08-17T02:27:13.247702+0000","last_became_active":"2024-08-17T02:27:13.241792+0000","last_became_peered":"2024-08-17T02:27:13.241792+0000","last_unstale":"2024-08-17T02:27:13.247702+0000","last_undegraded":"2024-08-17T02:27:13.247702+0000","last_fullsized":"2024-08-17T02:27:13.247702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:47:19.677150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265164+0000","last_change":"2024-08-17T02:27:12.237053+0000","last_active":"2024-08-17T02:27:13.265164+0000","last_peered":"2024-08-17T02:27:13.265164+0000","last_clean":"2024-08-17T02:27:13.265164+0000","last_became_active":"2024-08-17T02:27:12.236599+0000","last_became_peered":"2024-08-17T02:27:12.236599+0000","last_unstale":"2024-08-17T02:27:13.265164+0000","last_undegraded":"2024-08-17T02:27:13.265164+0000","last_fullsized":"2024-08-17T02:27:13.265164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:23:59.943932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.246687+0000","last_change":"2024-08-17T02:27:13.240160+0000","last_active":"2024-08-17T02:27:13.246687+0000","last_peered":"2024-08-17T02:27:13.246687+0000","last_clean":"2024-08-17T02:27:13.246687+0000","last_became_active":"2024-08-17T02:27:13.239869+0000","last_became_peered":"2024-08-17T02:27:13.239869+0000","last_unstale":"2024-08-17T02:27:13.246687+0000","last_undegraded":"2024-08-17T02:27:13.246687+0000","last_fullsized":"2024-08-17T02:27:13.246687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:37.777419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.234867+0000","last_change":"2024-08-17T02:27:12.243359+0000","last_active":"2024-08-17T02:27:13.234867+0000","last_peered":"2024-08-17T02:27:13.234867+0000","last_clean":"2024-08-17T02:27:13.234867+0000","last_became_active":"2024-08-17T02:27:12.243141+0000","last_became_peered":"2024-08-17T02:27:12.243141+0000","last_unstale":"2024-08-17T02:27:13.234867+0000","last_undegraded":"2024-08-17T02:27:13.234867+0000","last_fullsized":"2024-08-17T02:27:13.234867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:21.538305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.252084+0000","last_change":"2024-08-17T02:27:13.248472+0000","last_active":"2024-08-17T02:27:13.252084+0000","last_peered":"2024-08-17T02:27:13.252084+0000","last_clean":"2024-08-17T02:27:13.252084+0000","last_became_active":"2024-08-17T02:27:13.248166+0000","last_became_peered":"2024-08-17T02:27:13.248166+0000","last_unstale":"2024-08-17T02:27:13.252084+0000","last_undegraded":"2024-08-17T02:27:13.252084+0000","last_fullsized":"2024-08-17T02:27:13.252084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:35.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.238368+0000","last_change":"2024-08-17T02:27:12.244878+0000","last_active":"2024-08-17T02:27:13.238368+0000","last_peered":"2024-08-17T02:27:13.238368+0000","last_clean":"2024-08-17T02:27:13.238368+0000","last_became_active":"2024-08-17T02:27:12.244494+0000","last_became_peered":"2024-08-17T02:27:12.244494+0000","last_unstale":"2024-08-17T02:27:13.238368+0000","last_undegraded":"2024-08-17T02:27:13.238368+0000","last_fullsized":"2024-08-17T02:27:13.238368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:39:59.025081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249661+0000","last_change":"2024-08-17T02:27:13.244692+0000","last_active":"2024-08-17T02:27:13.249661+0000","last_peered":"2024-08-17T02:27:13.249661+0000","last_clean":"2024-08-17T02:27:13.249661+0000","last_became_active":"2024-08-17T02:27:13.244391+0000","last_became_peered":"2024-08-17T02:27:13.244391+0000","last_unstale":"2024-08-17T02:27:13.249661+0000","last_undegraded":"2024-08-17T02:27:13.249661+0000","last_fullsized":"2024-08-17T02:27:13.249661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:04.981661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265950+0000","last_change":"2024-08-17T02:27:12.241748+0000","last_active":"2024-08-17T02:27:13.265950+0000","last_peered":"2024-08-17T02:27:13.265950+0000","last_clean":"2024-08-17T02:27:13.265950+0000","last_became_active":"2024-08-17T02:27:12.241151+0000","last_became_peered":"2024-08-17T02:27:12.241151+0000","last_unstale":"2024-08-17T02:27:13.265950+0000","last_undegraded":"2024-08-17T02:27:13.265950+0000","last_fullsized":"2024-08-17T02:27:13.265950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:21.061193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.235132+0000","last_change":"2024-08-17T02:27:13.233364+0000","last_active":"2024-08-17T02:27:13.235132+0000","last_peered":"2024-08-17T02:27:13.235132+0000","last_clean":"2024-08-17T02:27:13.235132+0000","last_became_active":"2024-08-17T02:27:13.233077+0000","last_became_peered":"2024-08-17T02:27:13.233077+0000","last_unstale":"2024-08-17T02:27:13.235132+0000","last_undegraded":"2024-08-17T02:27:13.235132+0000","last_fullsized":"2024-08-17T02:27:13.235132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:30:32.120060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.262810+0000","last_change":"2024-08-17T02:27:12.240523+0000","last_active":"2024-08-17T02:27:13.262810+0000","last_peered":"2024-08-17T02:27:13.262810+0000","last_clean":"2024-08-17T02:27:13.262810+0000","last_became_active":"2024-08-17T02:27:12.240189+0000","last_became_peered":"2024-08-17T02:27:12.240189+0000","last_unstale":"2024-08-17T02:27:13.262810+0000","last_undegraded":"2024-08-17T02:27:13.262810+0000","last_fullsized":"2024-08-17T02:27:13.262810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:31.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241317+0000","last_change":"2024-08-17T02:27:13.234375+0000","last_active":"2024-08-17T02:27:13.241317+0000","last_peered":"2024-08-17T02:27:13.241317+0000","last_clean":"2024-08-17T02:27:13.241317+0000","last_became_active":"2024-08-17T02:27:13.234047+0000","last_became_peered":"2024-08-17T02:27:13.234047+0000","last_unstale":"2024-08-17T02:27:13.241317+0000","last_undegraded":"2024-08-17T02:27:13.241317+0000","last_fullsized":"2024-08-17T02:27:13.241317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:35.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.265125+0000","last_change":"2024-08-17T02:27:12.234644+0000","last_active":"2024-08-17T02:27:13.265125+0000","last_peered":"2024-08-17T02:27:13.265125+0000","last_clean":"2024-08-17T02:27:13.265125+0000","last_became_active":"2024-08-17T02:27:12.234240+0000","last_became_peered":"2024-08-17T02:27:12.234240+0000","last_unstale":"2024-08-17T02:27:13.265125+0000","last_undegraded":"2024-08-17T02:27:13.265125+0000","last_fullsized":"2024-08-17T02:27:13.265125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:22:36.658841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241085+0000","last_change":"2024-08-17T02:27:13.236699+0000","last_active":"2024-08-17T02:27:13.241085+0000","last_peered":"2024-08-17T02:27:13.241085+0000","last_clean":"2024-08-17T02:27:13.241085+0000","last_became_active":"2024-08-17T02:27:13.236114+0000","last_became_peered":"2024-08-17T02:27:13.236114+0000","last_unstale":"2024-08-17T02:27:13.241085+0000","last_undegraded":"2024-08-17T02:27:13.241085+0000","last_fullsized":"2024-08-17T02:27:13.241085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:23:36.588876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.264446+0000","last_change":"2024-08-17T02:27:12.250495+0000","last_active":"2024-08-17T02:27:13.264446+0000","last_peered":"2024-08-17T02:27:13.264446+0000","last_clean":"2024-08-17T02:27:13.264446+0000","last_became_active":"2024-08-17T02:27:12.250176+0000","last_became_peered":"2024-08-17T02:27:12.250176+0000","last_unstale":"2024-08-17T02:27:13.264446+0000","last_undegraded":"2024-08-17T02:27:13.264446+0000","last_fullsized":"2024-08-17T02:27:13.264446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:35:29.181181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247740+0000","last_change":"2024-08-17T02:27:13.240755+0000","last_active":"2024-08-17T02:27:13.247740+0000","last_peered":"2024-08-17T02:27:13.247740+0000","last_clean":"2024-08-17T02:27:13.247740+0000","last_became_active":"2024-08-17T02:27:13.240454+0000","last_became_peered":"2024-08-17T02:27:13.240454+0000","last_unstale":"2024-08-17T02:27:13.247740+0000","last_undegraded":"2024-08-17T02:27:13.247740+0000","last_fullsized":"2024-08-17T02:27:13.247740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:21:07.719376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.230365+0000","last_change":"2024-08-17T02:27:12.242378+0000","last_active":"2024-08-17T02:27:13.230365+0000","last_peered":"2024-08-17T02:27:13.230365+0000","last_clean":"2024-08-17T02:27:13.230365+0000","last_became_active":"2024-08-17T02:27:12.242045+0000","last_became_peered":"2024-08-17T02:27:12.242045+0000","last_unstale":"2024-08-17T02:27:13.230365+0000","last_undegraded":"2024-08-17T02:27:13.230365+0000","last_fullsized":"2024-08-17T02:27:13.230365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:42:38.943779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247678+0000","last_change":"2024-08-17T02:27:13.239587+0000","last_active":"2024-08-17T02:27:13.247678+0000","last_peered":"2024-08-17T02:27:13.247678+0000","last_clean":"2024-08-17T02:27:13.247678+0000","last_became_active":"2024-08-17T02:27:13.239263+0000","last_became_peered":"2024-08-17T02:27:13.239263+0000","last_unstale":"2024-08-17T02:27:13.247678+0000","last_undegraded":"2024-08-17T02:27:13.247678+0000","last_fullsized":"2024-08-17T02:27:13.247678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:15.435885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.263298+0000","last_change":"2024-08-17T02:27:12.243465+0000","last_active":"2024-08-17T02:27:13.263298+0000","last_peered":"2024-08-17T02:27:13.263298+0000","last_clean":"2024-08-17T02:27:13.263298+0000","last_became_active":"2024-08-17T02:27:12.243136+0000","last_became_peered":"2024-08-17T02:27:12.243136+0000","last_unstale":"2024-08-17T02:27:13.263298+0000","last_undegraded":"2024-08-17T02:27:13.263298+0000","last_fullsized":"2024-08-17T02:27:13.263298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:30.698821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.242585+0000","last_change":"2024-08-17T02:27:13.237090+0000","last_active":"2024-08-17T02:27:13.242585+0000","last_peered":"2024-08-17T02:27:13.242585+0000","last_clean":"2024-08-17T02:27:13.242585+0000","last_became_active":"2024-08-17T02:27:13.236780+0000","last_became_peered":"2024-08-17T02:27:13.236780+0000","last_unstale":"2024-08-17T02:27:13.242585+0000","last_undegraded":"2024-08-17T02:27:13.242585+0000","last_fullsized":"2024-08-17T02:27:13.242585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:47.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.236213+0000","last_change":"2024-08-17T02:27:12.245921+0000","last_active":"2024-08-17T02:27:13.236213+0000","last_peered":"2024-08-17T02:27:13.236213+0000","last_clean":"2024-08-17T02:27:13.236213+0000","last_became_active":"2024-08-17T02:27:12.245680+0000","last_became_peered":"2024-08-17T02:27:12.245680+0000","last_unstale":"2024-08-17T02:27:13.236213+0000","last_undegraded":"2024-08-17T02:27:13.236213+0000","last_fullsized":"2024-08-17T02:27:13.236213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:30.698821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247808+0000","last_change":"2024-08-17T02:27:13.240121+0000","last_active":"2024-08-17T02:27:13.247808+0000","last_peered":"2024-08-17T02:27:13.247808+0000","last_clean":"2024-08-17T02:27:13.247808+0000","last_became_active":"2024-08-17T02:27:13.239837+0000","last_became_peered":"2024-08-17T02:27:13.239837+0000","last_unstale":"2024-08-17T02:27:13.247808+0000","last_undegraded":"2024-08-17T02:27:13.247808+0000","last_fullsized":"2024-08-17T02:27:13.247808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:02.254007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.229456+0000","last_change":"2024-08-17T02:27:12.242935+0000","last_active":"2024-08-17T02:27:13.229456+0000","last_peered":"2024-08-17T02:27:13.229456+0000","last_clean":"2024-08-17T02:27:13.229456+0000","last_became_active":"2024-08-17T02:27:12.242603+0000","last_became_peered":"2024-08-17T02:27:12.242603+0000","last_unstale":"2024-08-17T02:27:13.229456+0000","last_undegraded":"2024-08-17T02:27:13.229456+0000","last_fullsized":"2024-08-17T02:27:13.229456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:50:39.060820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.251949+0000","last_change":"2024-08-17T02:27:13.246717+0000","last_active":"2024-08-17T02:27:13.251949+0000","last_peered":"2024-08-17T02:27:13.251949+0000","last_clean":"2024-08-17T02:27:13.251949+0000","last_became_active":"2024-08-17T02:27:13.246275+0000","last_became_peered":"2024-08-17T02:27:13.246275+0000","last_unstale":"2024-08-17T02:27:13.251949+0000","last_undegraded":"2024-08-17T02:27:13.251949+0000","last_fullsized":"2024-08-17T02:27:13.251949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:41.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.225945+0000","last_change":"2024-08-17T02:27:12.243640+0000","last_active":"2024-08-17T02:27:13.225945+0000","last_peered":"2024-08-17T02:27:13.225945+0000","last_clean":"2024-08-17T02:27:13.225945+0000","last_became_active":"2024-08-17T02:27:12.243306+0000","last_became_peered":"2024-08-17T02:27:12.243306+0000","last_unstale":"2024-08-17T02:27:13.225945+0000","last_undegraded":"2024-08-17T02:27:13.225945+0000","last_fullsized":"2024-08-17T02:27:13.225945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:17.249870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.242765+0000","last_change":"2024-08-17T02:27:13.235803+0000","last_active":"2024-08-17T02:27:13.242765+0000","last_peered":"2024-08-17T02:27:13.242765+0000","last_clean":"2024-08-17T02:27:13.242765+0000","last_became_active":"2024-08-17T02:27:13.235523+0000","last_became_peered":"2024-08-17T02:27:13.235523+0000","last_unstale":"2024-08-17T02:27:13.242765+0000","last_undegraded":"2024-08-17T02:27:13.242765+0000","last_fullsized":"2024-08-17T02:27:13.242765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:52:44.209374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.260895+0000","last_change":"2024-08-17T02:27:12.241368+0000","last_active":"2024-08-17T02:27:13.260895+0000","last_peered":"2024-08-17T02:27:13.260895+0000","last_clean":"2024-08-17T02:27:13.260895+0000","last_became_active":"2024-08-17T02:27:12.241151+0000","last_became_peered":"2024-08-17T02:27:12.241151+0000","last_unstale":"2024-08-17T02:27:13.260895+0000","last_undegraded":"2024-08-17T02:27:13.260895+0000","last_fullsized":"2024-08-17T02:27:13.260895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:51.443496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.247384+0000","last_change":"2024-08-17T02:27:13.242361+0000","last_active":"2024-08-17T02:27:13.247384+0000","last_peered":"2024-08-17T02:27:13.247384+0000","last_clean":"2024-08-17T02:27:13.247384+0000","last_became_active":"2024-08-17T02:27:13.242077+0000","last_became_peered":"2024-08-17T02:27:13.242077+0000","last_unstale":"2024-08-17T02:27:13.247384+0000","last_undegraded":"2024-08-17T02:27:13.247384+0000","last_fullsized":"2024-08-17T02:27:13.247384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:26.640084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.223535+0000","last_change":"2024-08-17T02:27:12.241447+0000","last_active":"2024-08-17T02:27:13.223535+0000","last_peered":"2024-08-17T02:27:13.223535+0000","last_clean":"2024-08-17T02:27:13.223535+0000","last_became_active":"2024-08-17T02:27:12.241134+0000","last_became_peered":"2024-08-17T02:27:12.241134+0000","last_unstale":"2024-08-17T02:27:13.223535+0000","last_undegraded":"2024-08-17T02:27:13.223535+0000","last_fullsized":"2024-08-17T02:27:13.223535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:25:16.824567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.244773+0000","last_change":"2024-08-17T02:27:13.239048+0000","last_active":"2024-08-17T02:27:13.244773+0000","last_peered":"2024-08-17T02:27:13.244773+0000","last_clean":"2024-08-17T02:27:13.244773+0000","last_became_active":"2024-08-17T02:27:13.238741+0000","last_became_peered":"2024-08-17T02:27:13.238741+0000","last_unstale":"2024-08-17T02:27:13.244773+0000","last_undegraded":"2024-08-17T02:27:13.244773+0000","last_fullsized":"2024-08-17T02:27:13.244773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:07.219617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.232133+0000","last_change":"2024-08-17T02:27:12.248919+0000","last_active":"2024-08-17T02:27:13.232133+0000","last_peered":"2024-08-17T02:27:13.232133+0000","last_clean":"2024-08-17T02:27:13.232133+0000","last_became_active":"2024-08-17T02:27:12.248614+0000","last_became_peered":"2024-08-17T02:27:12.248614+0000","last_unstale":"2024-08-17T02:27:13.232133+0000","last_undegraded":"2024-08-17T02:27:13.232133+0000","last_fullsized":"2024-08-17T02:27:13.232133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:24.605432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.241656+0000","last_change":"2024-08-17T02:27:13.239592+0000","last_active":"2024-08-17T02:27:13.241656+0000","last_peered":"2024-08-17T02:27:13.241656+0000","last_clean":"2024-08-17T02:27:13.241656+0000","last_became_active":"2024-08-17T02:27:13.239326+0000","last_became_peered":"2024-08-17T02:27:13.239326+0000","last_unstale":"2024-08-17T02:27:13.241656+0000","last_undegraded":"2024-08-17T02:27:13.241656+0000","last_fullsized":"2024-08-17T02:27:13.241656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:07.219617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.222654+0000","last_change":"2024-08-17T02:27:12.233970+0000","last_active":"2024-08-17T02:27:13.222654+0000","last_peered":"2024-08-17T02:27:13.222654+0000","last_clean":"2024-08-17T02:27:13.222654+0000","last_became_active":"2024-08-17T02:27:12.233109+0000","last_became_peered":"2024-08-17T02:27:12.233109+0000","last_unstale":"2024-08-17T02:27:13.222654+0000","last_undegraded":"2024-08-17T02:27:13.222654+0000","last_fullsized":"2024-08-17T02:27:13.222654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:11.084442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.244832+0000","last_change":"2024-08-17T02:27:13.235899+0000","last_active":"2024-08-17T02:27:13.244832+0000","last_peered":"2024-08-17T02:27:13.244832+0000","last_clean":"2024-08-17T02:27:13.244832+0000","last_became_active":"2024-08-17T02:27:13.235378+0000","last_became_peered":"2024-08-17T02:27:13.235378+0000","last_unstale":"2024-08-17T02:27:13.244832+0000","last_undegraded":"2024-08-17T02:27:13.244832+0000","last_fullsized":"2024-08-17T02:27:13.244832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:05:53.348532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.234970+0000","last_change":"2024-08-17T02:27:12.243081+0000","last_active":"2024-08-17T02:27:13.234970+0000","last_peered":"2024-08-17T02:27:13.234970+0000","last_clean":"2024-08-17T02:27:13.234970+0000","last_became_active":"2024-08-17T02:27:12.242799+0000","last_became_peered":"2024-08-17T02:27:12.242799+0000","last_unstale":"2024-08-17T02:27:13.234970+0000","last_undegraded":"2024-08-17T02:27:13.234970+0000","last_fullsized":"2024-08-17T02:27:13.234970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:14.425624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.246114+0000","last_change":"2024-08-17T02:27:13.241787+0000","last_active":"2024-08-17T02:27:13.246114+0000","last_peered":"2024-08-17T02:27:13.246114+0000","last_clean":"2024-08-17T02:27:13.246114+0000","last_became_active":"2024-08-17T02:27:13.241491+0000","last_became_peered":"2024-08-17T02:27:13.241491+0000","last_unstale":"2024-08-17T02:27:13.246114+0000","last_undegraded":"2024-08-17T02:27:13.246114+0000","last_fullsized":"2024-08-17T02:27:13.246114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:20:44.565587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.229681+0000","last_change":"2024-08-17T02:27:12.236698+0000","last_active":"2024-08-17T02:27:13.229681+0000","last_peered":"2024-08-17T02:27:13.229681+0000","last_clean":"2024-08-17T02:27:13.229681+0000","last_became_active":"2024-08-17T02:27:12.236456+0000","last_became_peered":"2024-08-17T02:27:12.236456+0000","last_unstale":"2024-08-17T02:27:13.229681+0000","last_undegraded":"2024-08-17T02:27:13.229681+0000","last_fullsized":"2024-08-17T02:27:13.229681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:47.163723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249637+0000","last_change":"2024-08-17T02:27:13.247053+0000","last_active":"2024-08-17T02:27:13.249637+0000","last_peered":"2024-08-17T02:27:13.249637+0000","last_clean":"2024-08-17T02:27:13.249637+0000","last_became_active":"2024-08-17T02:27:13.246725+0000","last_became_peered":"2024-08-17T02:27:13.246725+0000","last_unstale":"2024-08-17T02:27:13.249637+0000","last_undegraded":"2024-08-17T02:27:13.249637+0000","last_fullsized":"2024-08-17T02:27:13.249637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:51:41.678401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.237429+0000","last_change":"2024-08-17T02:27:12.244265+0000","last_active":"2024-08-17T02:27:13.237429+0000","last_peered":"2024-08-17T02:27:13.237429+0000","last_clean":"2024-08-17T02:27:13.237429+0000","last_became_active":"2024-08-17T02:27:12.243980+0000","last_became_peered":"2024-08-17T02:27:12.243980+0000","last_unstale":"2024-08-17T02:27:13.237429+0000","last_undegraded":"2024-08-17T02:27:13.237429+0000","last_fullsized":"2024-08-17T02:27:13.237429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:56:31.933965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.249315+0000","last_change":"2024-08-17T02:27:13.245759+0000","last_active":"2024-08-17T02:27:13.249315+0000","last_peered":"2024-08-17T02:27:13.249315+0000","last_clean":"2024-08-17T02:27:13.249315+0000","last_became_active":"2024-08-17T02:27:13.245444+0000","last_became_peered":"2024-08-17T02:27:13.245444+0000","last_unstale":"2024-08-17T02:27:13.249315+0000","last_undegraded":"2024-08-17T02:27:13.249315+0000","last_fullsized":"2024-08-17T02:27:13.249315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:12.200640+0000","last_clean_scrub_stamp":"2024-08-17T02:27:12.200640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:26.640084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.235882+0000","last_change":"2024-08-17T02:27:12.238075+0000","last_active":"2024-08-17T02:27:13.235882+0000","last_peered":"2024-08-17T02:27:13.235882+0000","last_clean":"2024-08-17T02:27:13.235882+0000","last_became_active":"2024-08-17T02:27:12.237796+0000","last_became_peered":"2024-08-17T02:27:12.237796+0000","last_unstale":"2024-08-17T02:27:13.235882+0000","last_undegraded":"2024-08-17T02:27:13.235882+0000","last_fullsized":"2024-08-17T02:27:13.235882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:11.190380+0000","last_clean_scrub_stamp":"2024-08-17T02:27:11.190380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:11.084442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:27:13.239675+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:27:13.239675+0000","last_peered":"2024-08-17T02:27:13.239675+0000","last_clean":"2024-08-17T02:27:13.239675+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:27:13.239675+0000","last_undegraded":"2024-08-17T02:27:13.239675+0000","last_fullsized":"2024-08-17T02:27:13.239675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":380928,"data_stored":142242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":140738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297736,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074104,"statfs":{"total":96636764160,"available":96331882496,"internally_reserved":0,"allocated":380928,"data_stored":142242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":962560,"data_stored":731126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1320000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0960000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":372736,"data_stored":141272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":372736,"data_stored":141328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":372736,"data_stored":140772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":958464,"data_stored":731036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:21.011 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:27:21.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:27:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.127+0000 7f15f6e51700 1 Processor -- start 2024-08-17T02:27:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.127+0000 7f15f6e51700 1 -- start start 2024-08-17T02:27:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f15f00aee40 0x7f15f00686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00b0a50 con 0x7f15f01592c0 2024-08-17T02:27:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00afe40 con 0x7f15f0158ef0 2024-08-17T02:27:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f00afc50 con 0x7f15f00aee40 2024-08-17T02:27:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6650700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f15f01592c0 0x7f15f00b0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41634/0 (socket says 172.21.15.19:41634) 2024-08-17T02:27:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6650700 1 -- 172.21.15.19:0/1856219725 learned_addr learned my addr 172.21.15.19:0/1856219725 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f564e700 1 --2- 172.21.15.19:0/1856219725 >> v2:172.21.15.119:3300/0 conn(0x7f15f00aee40 0x7f15f00686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f4e4d700 1 -- 172.21.15.19:0/1856219725 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093566428 0 0) 0x7f15f00b0a50 con 0x7f15f01592c0 2024-08-17T02:27:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f4e4d700 1 -- 172.21.15.19:0/1856219725 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15dc003570 con 0x7f15f01592c0 2024-08-17T02:27:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f564e700 1 -- 172.21.15.19:0/1856219725 >> v1:172.21.15.119:6789/0 conn(0x7f15f0158ef0 legacy=0x7f15f00af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f564e700 1 -- 172.21.15.19:0/1856219725 >> v1:172.21.15.19:6789/0 conn(0x7f15f01592c0 legacy=0x7f15f00b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f564e700 1 -- 172.21.15.19:0/1856219725 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00b0120 con 0x7f15f00aee40 2024-08-17T02:27:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f564e700 1 --2- 172.21.15.19:0/1856219725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f00aee40 0x7f15f00686a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f15e40098e0 tx=0x7f15e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d8e446638214da2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f4e4d700 1 -- 172.21.15.19:0/1856219725 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400b640 con 0x7f15f00aee40 2024-08-17T02:27:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f4e4d700 1 -- 172.21.15.19:0/1856219725 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400b7a0 con 0x7f15f00aee40 2024-08-17T02:27:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f4e4d700 1 -- 172.21.15.19:0/1856219725 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400bb40 con 0x7f15f00aee40 2024-08-17T02:27:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 -- 172.21.15.19:0/1856219725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f00aee40 msgr2=0x7f15f00686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 --2- 172.21.15.19:0/1856219725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f00aee40 0x7f15f00686a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f15e40098e0 tx=0x7f15e40091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 -- 172.21.15.19:0/1856219725 shutdown_connections 2024-08-17T02:27:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 --2- 172.21.15.19:0/1856219725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f00aee40 0x7f15f00686a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 -- 172.21.15.19:0/1856219725 >> 172.21.15.19:0/1856219725 conn(0x7f15f006e2f0 msgr2=0x7f15f006b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 -- 172.21.15.19:0/1856219725 shutdown_connections 2024-08-17T02:27:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.131+0000 7f15f6e51700 1 -- 172.21.15.19:0/1856219725 wait complete. 2024-08-17T02:27:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f6e51700 1 Processor -- start 2024-08-17T02:27:21.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f6e51700 1 -- start start 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f6e51700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f00aee40 0x7f15f00ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f6e51700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f0158ef0 0x7f15f0154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f6e51700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15f01592c0 0x7f15f015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f6e51700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00c16d0 con 0x7f15f00aee40 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f6e51700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00c96e0 con 0x7f15f0158ef0 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f6e51700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f00ca540 con 0x7f15f01592c0 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f5e4f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f00aee40 0x7f15f00ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f5e4f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f00aee40 0x7f15f00ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56534/0 (socket says 172.21.15.19:56534) 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f5e4f700 1 -- 172.21.15.19:0/2834516831 learned_addr learned my addr 172.21.15.19:0/2834516831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f564e700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f0158ef0 0x7f15f0154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.135+0000 7f15f6650700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15f01592c0 0x7f15f015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f564e700 1 -- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15f01592c0 msgr2=0x7f15f015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f564e700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15f01592c0 0x7f15f015a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f564e700 1 -- 172.21.15.19:0/2834516831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f00aee40 msgr2=0x7f15f00ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f564e700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f00aee40 0x7f15f00ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f564e700 1 -- 172.21.15.19:0/2834516831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e4009420 con 0x7f15f0158ef0 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f5e4f700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f00aee40 0x7f15f00ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f564e700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f0158ef0 0x7f15f0154fe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f15e4016000 tx=0x7f15e4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15e1ffb700 1 -- 172.21.15.19:0/2834516831 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4000d10 con 0x7f15f0158ef0 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15e1ffb700 1 -- 172.21.15.19:0/2834516831 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400bb20 con 0x7f15f0158ef0 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f00c9930 con 0x7f15f0158ef0 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15e1ffb700 1 -- 172.21.15.19:0/2834516831 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4011650 con 0x7f15f0158ef0 2024-08-17T02:27:21.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f00c9cc0 con 0x7f15f0158ef0 2024-08-17T02:27:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f00ca6b0 con 0x7f15f0158ef0 2024-08-17T02:27:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15e1ffb700 1 -- 172.21.15.19:0/2834516831 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f15e40119c0 con 0x7f15f0158ef0 2024-08-17T02:27:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15e1ffb700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f15d4060890 0x7f15d4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.139+0000 7f15e1ffb700 1 -- 172.21.15.19:0/2834516831 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f15e407e0c0 con 0x7f15f0158ef0 2024-08-17T02:27:21.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.143+0000 7f15f5e4f700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f15d4060890 0x7f15d4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.143+0000 7f15f5e4f700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f15d4060890 0x7f15d4062d40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f15ec001e90 tx=0x7f15ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.151+0000 7f15e1ffb700 1 -- 172.21.15.19:0/2834516831 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f15e404e510 con 0x7f15f0158ef0 2024-08-17T02:27:21.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.379+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f15f0063950 con 0x7f15f0158ef0 2024-08-17T02:27:21.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15e1ffb700 1 -- 172.21.15.19:0/2834516831 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f15e4051b30 con 0x7f15f0158ef0 2024-08-17T02:27:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f15d4060890 msgr2=0x7f15d4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f15d4060890 0x7f15d4062d40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f15ec001e90 tx=0x7f15ec009040 comp rx=0 tx=0).stop 2024-08-17T02:27:21.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f0158ef0 msgr2=0x7f15f0154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f0158ef0 0x7f15f0154fe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f15e4016000 tx=0x7f15e4017000 comp rx=0 tx=0).stop 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 shutdown_connections 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f15d4060890 0x7f15d4062d40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15f01592c0 0x7f15f015a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f0158ef0 0x7f15f0154fe0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 --2- 172.21.15.19:0/2834516831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f00aee40 0x7f15f00ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.391+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 >> 172.21.15.19:0/2834516831 conn(0x7f15f006e2f0 msgr2=0x7f15f01571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.395+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 shutdown_connections 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.395+0000 7f15f6e51700 1 -- 172.21.15.19:0/2834516831 wait complete. 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-08-17T02:27:21.412 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:21.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.511+0000 7fb0eadb2700 1 Processor -- start 2024-08-17T02:27:21.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.511+0000 7fb0eadb2700 1 -- start start 2024-08-17T02:27:21.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.511+0000 7fb0eadb2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 0x7fb0e406b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.511+0000 7fb0eadb2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e415a920 con 0x7fb0e415b240 2024-08-17T02:27:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.511+0000 7fb0eadb2700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e406c2f0 con 0x7fb0e4151370 2024-08-17T02:27:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.511+0000 7fb0eadb2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e406c780 con 0x7fb0e4151740 2024-08-17T02:27:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.511+0000 7fb0e95af700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb0e415b240 0x7fb0e406a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41646/0 (socket says 172.21.15.19:41646) 2024-08-17T02:27:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.511+0000 7fb0e95af700 1 -- 172.21.15.19:0/3811913507 learned_addr learned my addr 172.21.15.19:0/3811913507 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:21.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.511+0000 7fb0ea5b1700 1 --2- 172.21.15.19:0/3811913507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 0x7fb0e406b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0e8dae700 1 -- 172.21.15.19:0/3811913507 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073022433 0 0) 0x7fb0e0001490 con 0x7fb0e415b240 2024-08-17T02:27:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0e8dae700 1 -- 172.21.15.19:0/3811913507 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0cc003570 con 0x7fb0e415b240 2024-08-17T02:27:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0e8dae700 1 -- 172.21.15.19:0/3811913507 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272470632 0 0) 0x7fb0e406c2f0 con 0x7fb0e4151370 2024-08-17T02:27:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0e8dae700 1 -- 172.21.15.19:0/3811913507 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e0001490 con 0x7fb0e4151370 2024-08-17T02:27:21.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0ea5b1700 1 -- 172.21.15.19:0/3811913507 >> v1:172.21.15.119:6789/0 conn(0x7fb0e4151370 legacy=0x7fb0e415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0ea5b1700 1 -- 172.21.15.19:0/3811913507 >> v1:172.21.15.19:6789/0 conn(0x7fb0e415b240 legacy=0x7fb0e406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0ea5b1700 1 -- 172.21.15.19:0/3811913507 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e406b6e0 con 0x7fb0e4151740 2024-08-17T02:27:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0ea5b1700 1 --2- 172.21.15.19:0/3811913507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 0x7fb0e406b0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009910 tx=0x7fb0dc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae94b87a917d12a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0e8dae700 1 -- 172.21.15.19:0/3811913507 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc011630 con 0x7fb0e4151740 2024-08-17T02:27:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0e8dae700 1 -- 172.21.15.19:0/3811913507 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc011790 con 0x7fb0e4151740 2024-08-17T02:27:21.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0e8dae700 1 -- 172.21.15.19:0/3811913507 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc011b10 con 0x7fb0e4151740 2024-08-17T02:27:21.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0eadb2700 1 -- 172.21.15.19:0/3811913507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 msgr2=0x7fb0e406b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0eadb2700 1 --2- 172.21.15.19:0/3811913507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 0x7fb0e406b0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009910 tx=0x7fb0dc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0eadb2700 1 -- 172.21.15.19:0/3811913507 shutdown_connections 2024-08-17T02:27:21.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0eadb2700 1 --2- 172.21.15.19:0/3811913507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 0x7fb0e406b0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0eadb2700 1 -- 172.21.15.19:0/3811913507 >> 172.21.15.19:0/3811913507 conn(0x7fb0e406cc40 msgr2=0x7fb0e406d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0eadb2700 1 -- 172.21.15.19:0/3811913507 shutdown_connections 2024-08-17T02:27:21.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.515+0000 7fb0eadb2700 1 -- 172.21.15.19:0/3811913507 wait complete. 2024-08-17T02:27:21.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.519+0000 7fb0eadb2700 1 Processor -- start 2024-08-17T02:27:21.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.519+0000 7fb0eadb2700 1 -- start start 2024-08-17T02:27:21.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.519+0000 7fb0eadb2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e4151370 0x7fb0e414bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.519+0000 7fb0eadb2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 0x7fb0e4167090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.519+0000 7fb0eadb2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0e415b240 0x7fb0e414e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0eadb2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e4157610 con 0x7fb0e415b240 2024-08-17T02:27:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0eadb2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e416ac10 con 0x7fb0e4151370 2024-08-17T02:27:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0eadb2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e416aef0 con 0x7fb0e4151740 2024-08-17T02:27:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0ea5b1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0e415b240 0x7fb0e414e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0ea5b1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0e415b240 0x7fb0e414e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56542/0 (socket says 172.21.15.19:56542) 2024-08-17T02:27:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0ea5b1700 1 -- 172.21.15.19:0/2796569635 learned_addr learned my addr 172.21.15.19:0/2796569635 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0e9db0700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e4151370 0x7fb0e414bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0e95af700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 0x7fb0e4167090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0ea5b1700 1 -- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 msgr2=0x7fb0e4167090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0ea5b1700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 0x7fb0e4167090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0ea5b1700 1 -- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e4151370 msgr2=0x7fb0e414bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0ea5b1700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e4151370 0x7fb0e414bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0ea5b1700 1 -- 172.21.15.19:0/2796569635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc009420 con 0x7fb0e415b240 2024-08-17T02:27:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0ea5b1700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0e415b240 0x7fb0e414e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb0e406fbb0 tx=0x7fb0dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0d9ffb700 1 -- 172.21.15.19:0/2796569635 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc011b10 con 0x7fb0e415b240 2024-08-17T02:27:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0d9ffb700 1 -- 172.21.15.19:0/2796569635 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc025400 con 0x7fb0e415b240 2024-08-17T02:27:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e416b1d0 con 0x7fb0e415b240 2024-08-17T02:27:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0d9ffb700 1 -- 172.21.15.19:0/2796569635 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0257e0 con 0x7fb0e415b240 2024-08-17T02:27:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e41595c0 con 0x7fb0e415b240 2024-08-17T02:27:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.523+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e41577c0 con 0x7fb0e415b240 2024-08-17T02:27:21.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.527+0000 7fb0d9ffb700 1 -- 172.21.15.19:0/2796569635 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb0dc02e440 con 0x7fb0e415b240 2024-08-17T02:27:21.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.527+0000 7fb0d9ffb700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0d0060860 0x7fb0d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.527+0000 7fb0d9ffb700 1 -- 172.21.15.19:0/2796569635 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0dc07e4c0 con 0x7fb0e415b240 2024-08-17T02:27:21.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.527+0000 7fb0e9db0700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0d0060860 0x7fb0d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.527+0000 7fb0e9db0700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0d0060860 0x7fb0d0062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4007fd0 tx=0x7fb0d4007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.535+0000 7fb0d9ffb700 1 -- 172.21.15.19:0/2796569635 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb0e41577c0 con 0x7fb0e415b240 2024-08-17T02:27:21.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.735+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0e40638f0 con 0x7fb0e415b240 2024-08-17T02:27:21.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.735+0000 7fb0d9ffb700 1 -- 172.21.15.19:0/2796569635 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fb0dc04e910 con 0x7fb0e415b240 2024-08-17T02:27:21.742 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:21.742 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34643,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:12.591455+0000","modified":"2024-08-17T02:27:15.252576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34649":{"gid":34649,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/363347157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":363347157},{"type":"v1","addr":"172.21.15.19:6835","nonce":363347157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:27:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0d0060860 msgr2=0x7fb0d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0d0060860 0x7fb0d0062d10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4007fd0 tx=0x7fb0d4007d30 comp rx=0 tx=0).stop 2024-08-17T02:27:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0e415b240 msgr2=0x7fb0e414e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0e415b240 0x7fb0e414e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb0e406fbb0 tx=0x7fb0dc017000 comp rx=0 tx=0).stop 2024-08-17T02:27:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 shutdown_connections 2024-08-17T02:27:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0d0060860 0x7fb0d0062d10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0e415b240 0x7fb0e414e320 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0e4151740 0x7fb0e4167090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 --2- 172.21.15.19:0/2796569635 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0e4151370 0x7fb0e414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 >> 172.21.15.19:0/2796569635 conn(0x7fb0e406cc40 msgr2=0x7fb0e406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 shutdown_connections 2024-08-17T02:27:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:21.739+0000 7fb0eadb2700 1 -- 172.21.15.19:0/2796569635 wait complete. 2024-08-17T02:27:21.746 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 13 2024-08-17T02:27:22.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:27:12.591455+0000', 'modified': '2024-08-17T02:27:15.252576+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34649}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34649': {'gid': 34649, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6835/363347157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 363347157}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 363347157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:27:22.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:27:22.159 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:27:22.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.275+0000 7f2dae16b700 1 Processor -- start 2024-08-17T02:27:22.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.275+0000 7f2dae16b700 1 -- start start 2024-08-17T02:27:22.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2dae16b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da8156e80 0x7f2da80686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2dae16b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2da8068be0 0x7f2da80ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2dae16b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da80cbf60 con 0x7f2da80cab60 2024-08-17T02:27:22.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2dae16b700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da8069030 con 0x7f2da8068be0 2024-08-17T02:27:22.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2dae16b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80cb350 con 0x7f2da8156e80 2024-08-17T02:27:22.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2da80cab60 0x7f2da815acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41660/0 (socket says 172.21.15.19:41660) 2024-08-17T02:27:22.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da7fff700 1 -- 172.21.15.19:0/3908876630 learned_addr learned my addr 172.21.15.19:0/3908876630 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:22.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/3908876630 >> v2:172.21.15.119:3300/0 conn(0x7f2da8068be0 0x7f2da80ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da77fe700 1 --2- 172.21.15.19:0/3908876630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da8156e80 0x7f2da80686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da67fc700 1 -- 172.21.15.19:0/3908876630 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228436307 0 0) 0x7f2da80cbf60 con 0x7f2da80cab60 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da67fc700 1 -- 172.21.15.19:0/3908876630 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d90003570 con 0x7f2da80cab60 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da6ffd700 1 -- 172.21.15.19:0/3908876630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da8156e80 msgr2=0x7f2da80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/3908876630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da8156e80 0x7f2da80686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da6ffd700 1 -- 172.21.15.19:0/3908876630 >> v1:172.21.15.19:6789/0 conn(0x7f2da80cab60 legacy=0x7f2da815acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da6ffd700 1 -- 172.21.15.19:0/3908876630 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da80cb630 con 0x7f2da8068be0 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/3908876630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2da8068be0 0x7f2da80ca620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009e60 tx=0x7f2d9c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a0a57e611f8d951 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da67fc700 1 -- 172.21.15.19:0/3908876630 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00e070 con 0x7f2da8068be0 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da67fc700 1 -- 172.21.15.19:0/3908876630 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c00bab0 con 0x7f2da8068be0 2024-08-17T02:27:22.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2da67fc700 1 -- 172.21.15.19:0/3908876630 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00be70 con 0x7f2da8068be0 2024-08-17T02:27:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2dae16b700 1 -- 172.21.15.19:0/3908876630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2da8068be0 msgr2=0x7f2da80ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.279+0000 7f2dae16b700 1 --2- 172.21.15.19:0/3908876630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2da8068be0 0x7f2da80ca620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009e60 tx=0x7f2d9c009780 comp rx=0 tx=0).stop 2024-08-17T02:27:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 -- 172.21.15.19:0/3908876630 shutdown_connections 2024-08-17T02:27:22.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 --2- 172.21.15.19:0/3908876630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2da8068be0 0x7f2da80ca620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 --2- 172.21.15.19:0/3908876630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da8156e80 0x7f2da80686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 -- 172.21.15.19:0/3908876630 >> 172.21.15.19:0/3908876630 conn(0x7f2da806e4e0 msgr2=0x7f2da806bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 -- 172.21.15.19:0/3908876630 shutdown_connections 2024-08-17T02:27:22.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 -- 172.21.15.19:0/3908876630 wait complete. 2024-08-17T02:27:22.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 Processor -- start 2024-08-17T02:27:22.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 -- start start 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2da8068be0 0x7f2da814f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da80cab60 0x7f2da80b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2da8156e80 0x7f2da80b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c62b0 con 0x7f2da8156e80 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c25a0 con 0x7f2da8068be0 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2dae16b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c2880 con 0x7f2da80cab60 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2da7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2da8156e80 0x7f2da80b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2da7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2da8156e80 0x7f2da80b21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56558/0 (socket says 172.21.15.19:56558) 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2da7fff700 1 -- 172.21.15.19:0/3246494826 learned_addr learned my addr 172.21.15.19:0/3246494826 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:22.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da80cab60 0x7f2da80b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.283+0000 7f2da77fe700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2da8068be0 0x7f2da814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2da7fff700 1 -- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da80cab60 msgr2=0x7f2da80b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2da7fff700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da80cab60 0x7f2da80b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2da7fff700 1 -- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2da8068be0 msgr2=0x7f2da814f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2da7fff700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2da8068be0 0x7f2da814f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2da7fff700 1 -- 172.21.15.19:0/3246494826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c009a20 con 0x7f2da8156e80 2024-08-17T02:27:22.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2da7fff700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2da8156e80 0x7f2da80b21d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2da00010e0 tx=0x7f2da0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2d8f7fe700 1 -- 172.21.15.19:0/3246494826 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0005c00 con 0x7f2da8156e80 2024-08-17T02:27:22.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2d8f7fe700 1 -- 172.21.15.19:0/3246494826 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0005d60 con 0x7f2da8156e80 2024-08-17T02:27:22.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2dae16b700 1 -- 172.21.15.19:0/3246494826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da80c2b60 con 0x7f2da8156e80 2024-08-17T02:27:22.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2d8f7fe700 1 -- 172.21.15.19:0/3246494826 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00072e0 con 0x7f2da8156e80 2024-08-17T02:27:22.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2dae16b700 1 -- 172.21.15.19:0/3246494826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da814fd40 con 0x7f2da8156e80 2024-08-17T02:27:22.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.287+0000 7f2d8f7fe700 1 -- 172.21.15.19:0/3246494826 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2da0012400 con 0x7f2da8156e80 2024-08-17T02:27:22.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2d8f7fe700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d94060860 0x7f2d94062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2da77fe700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d94060860 0x7f2d94062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2d8f7fe700 1 -- 172.21.15.19:0/3246494826 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2da0053280 con 0x7f2da8156e80 2024-08-17T02:27:22.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2da77fe700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d94060860 0x7f2d94062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009cf0 tx=0x7f2d980091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2db041a740 1 Processor -- start 2024-08-17T02:27:22.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2db041a740 1 -- start start 2024-08-17T02:27:22.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2db041a740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1a5cae0 0x1c901d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2db041a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1c90710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2db041a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1c93c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2db041a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c08ba0 con 0x1aa7790 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.291+0000 7f2db041a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c04b40 con 0x1a5c710 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bca0a0 con 0x1a5cae0 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1c93c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1c93c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56572/0 (socket says 172.21.15.19:56572) 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da7fff700 1 -- 172.21.15.19:0/1102345439 learned_addr learned my addr 172.21.15.19:0/1102345439 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1c90710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da77fe700 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1a5cae0 0x1c901d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da7fff700 1 -- 172.21.15.19:0/1102345439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1a5cae0 msgr2=0x1c901d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da7fff700 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1a5cae0 0x1c901d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da7fff700 1 -- 172.21.15.19:0/1102345439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 msgr2=0x1c90710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da7fff700 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1c90710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da7fff700 1 -- 172.21.15.19:0/1102345439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1aa89e0 con 0x1aa7790 2024-08-17T02:27:22.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da77fe700 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1a5cae0 0x1c901d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2da7fff700 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1c93c60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2da0050030 tx=0x7f2da007a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4193ab100539ec7d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2d8cff9700 1 -- 172.21.15.19:0/1102345439 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da004e1e0 con 0x1aa7790 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2d8cff9700 1 -- 172.21.15.19:0/1102345439 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da00076d0 con 0x1aa7790 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2d8cff9700 1 -- 172.21.15.19:0/1102345439 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da007a5a0 con 0x1aa7790 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 -- 172.21.15.19:0/1102345439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 msgr2=0x1c93c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1c93c60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2da0050030 tx=0x7f2da007a360 comp rx=0 tx=0).stop 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 -- 172.21.15.19:0/1102345439 shutdown_connections 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1c93c60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1c90710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 --2- 172.21.15.19:0/1102345439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1a5cae0 0x1c901d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 -- 172.21.15.19:0/1102345439 >> 172.21.15.19:0/1102345439 conn(0x1a5ceb0 msgr2=0x1c960b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 -- 172.21.15.19:0/1102345439 shutdown_connections 2024-08-17T02:27:22.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 -- 172.21.15.19:0/1102345439 wait complete. 2024-08-17T02:27:22.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 -- start start 2024-08-17T02:27:22.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.295+0000 7f2db041a740 1 Processor -- start 2024-08-17T02:27:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5c710 0x1cddaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5cae0 0x1cddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 0x1c97fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bc9d40 con 0x1a5c710 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba2970 con 0x1a5cae0 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bafec0 con 0x1aa7790 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 10 client.0 _ll_register_callbacks cb 0x1ba6f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5c710 0x1cddaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5c710 0x1cddaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56578/0 (socket says 172.21.15.19:56578) 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da77fe700 1 -- 172.21.15.19:0/728006377 learned_addr learned my addr 172.21.15.19:0/728006377 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da7fff700 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 0x1c97fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5cae0 0x1cddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da77fe700 1 -- 172.21.15.19:0/728006377 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 msgr2=0x1c97fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da77fe700 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 0x1c97fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da77fe700 1 -- 172.21.15.19:0/728006377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5cae0 msgr2=0x1cddfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da77fe700 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5cae0 0x1cddfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da77fe700 1 -- 172.21.15.19:0/728006377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da814fd40 con 0x1a5c710 2024-08-17T02:27:22.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da77fe700 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5c710 0x1cddaa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d98014bd0 tx=0x7f2d98016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6503e592345d39 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2d85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2d85ffb700 1 -- 172.21.15.19:0/728006377 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98013a40 con 0x1a5c710 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2d85ffb700 1 -- 172.21.15.19:0/728006377 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d98013ba0 con 0x1a5c710 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 -- 172.21.15.19:0/728006377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a6a260 con 0x1a5c710 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2d85ffb700 1 -- 172.21.15.19:0/728006377 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d98022400 con 0x1a5c710 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 10 client.5217 fetch_fsmap learned FSMap version 13 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 -- 172.21.15.19:0/728006377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x1bd2370 con 0x1a5c710 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2d85ffb700 1 -- 172.21.15.19:0/728006377 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a6a260 con 0x1a5c710 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2d85ffb700 1 -- 172.21.15.19:0/728006377 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 13) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2d98022560 con 0x1a5c710 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 10 client.5217 fetch_fsmap finished waiting for FSMap version 13 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 10 client.5217 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 20 client.5217 populate_metadata read hostname 'smithi019' 2024-08-17T02:27:22.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] conn(0x1ce6c30 0x1ce9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 4 client.5217 mds_command: new command op to 34649 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:27:22.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 -- 172.21.15.19:0/728006377 --> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ab44e0 con 0x1ce6c30 2024-08-17T02:27:22.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] conn(0x1ce6c30 0x1ce9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] conn(0x1ce6c30 0x1ce9010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488aa292e9458880 server_cookie=6105fcb31c0c5082 in_seq=0 out_seq=0 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2d85ffb700 10 client.5217 ms_handle_connect on v2:172.21.15.19:6834/363347157 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2d85ffb700 1 -- 172.21.15.19:0/728006377 <== mds.0 v2:172.21.15.19:6834/363347157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x1ab44e0 con 0x1ce6c30 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2d85ffb700 10 client.5217 handle_command_reply: tid=0 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.299+0000 7f2db041a740 1 client.5217 shutdown 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 -- 172.21.15.19:0/728006377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5c710 msgr2=0x1cddaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5c710 0x1cddaa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d98014bd0 tx=0x7f2d98016000 comp rx=0 tx=0).stop 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 -- 172.21.15.19:0/728006377 shutdown_connections 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] conn(0x1ce6c30 0x1ce9010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 0x1c97fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5cae0 0x1cddfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 --2- 172.21.15.19:0/728006377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5c710 0x1cddaa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2d85ffb700 0 client.5217 ms_handle_reset on v2:172.21.15.19:6834/363347157 2024-08-17T02:27:22.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 -- 172.21.15.19:0/728006377 >> 172.21.15.19:0/728006377 conn(0x1a5ceb0 msgr2=0x1c95ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 -- 172.21.15.19:0/728006377 shutdown_connections 2024-08-17T02:27:22.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 1 -- 172.21.15.19:0/728006377 wait complete. 2024-08-17T02:27:22.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.303+0000 7f2db041a740 20 client.5217 trim_cache size 0 max 16384 2024-08-17T02:27:22.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2db041a740 1 Processor -- start 2024-08-17T02:27:22.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2db041a740 1 -- start start 2024-08-17T02:27:22.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2db041a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d3a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2db041a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5cae0 0x1d3a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2db041a740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 0x1d3adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2db041a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c0ada0 con 0x1a5cae0 2024-08-17T02:27:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2db041a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bdc570 con 0x1a5c710 2024-08-17T02:27:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2db041a740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ad9650 con 0x1aa7790 2024-08-17T02:27:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5cae0 0x1d3a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5cae0 0x1d3a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56580/0 (socket says 172.21.15.19:56580) 2024-08-17T02:27:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da6ffd700 1 -- 172.21.15.19:0/3691618873 learned_addr learned my addr 172.21.15.19:0/3691618873 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da7fff700 1 --2- 172.21.15.19:0/3691618873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 0x1d3adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da77fe700 1 --2- 172.21.15.19:0/3691618873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d3a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da6ffd700 1 -- 172.21.15.19:0/3691618873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 msgr2=0x1d3adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/3691618873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 0x1d3adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da6ffd700 1 -- 172.21.15.19:0/3691618873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 msgr2=0x1d3a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/3691618873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d3a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da6ffd700 1 -- 172.21.15.19:0/3691618873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bb8d80 con 0x1a5cae0 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/3691618873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5cae0 0x1d3a880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2da806cea0 tx=0x7f2d9c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7f12074ef579e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.323+0000 7f2d8d7fa700 1 -- 172.21.15.19:0/3691618873 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c029670 con 0x1a5cae0 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2d8d7fa700 1 -- 172.21.15.19:0/3691618873 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c024040 con 0x1a5cae0 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2d8d7fa700 1 -- 172.21.15.19:0/3691618873 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c029870 con 0x1a5cae0 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 -- 172.21.15.19:0/3691618873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5cae0 msgr2=0x1d3a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 --2- 172.21.15.19:0/3691618873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5cae0 0x1d3a880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2da806cea0 tx=0x7f2d9c020040 comp rx=0 tx=0).stop 2024-08-17T02:27:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 -- 172.21.15.19:0/3691618873 shutdown_connections 2024-08-17T02:27:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 --2- 172.21.15.19:0/3691618873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1aa7790 0x1d3adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 --2- 172.21.15.19:0/3691618873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1a5cae0 0x1d3a880 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 --2- 172.21.15.19:0/3691618873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d3a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 -- 172.21.15.19:0/3691618873 >> 172.21.15.19:0/3691618873 conn(0x1a5ceb0 msgr2=0x1c96370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 -- 172.21.15.19:0/3691618873 shutdown_connections 2024-08-17T02:27:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 -- 172.21.15.19:0/3691618873 wait complete. 2024-08-17T02:27:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 -- start start 2024-08-17T02:27:22.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 Processor -- start 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.327+0000 7f2db041a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d1e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1ce7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1ce7540 0x1ce7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c07200 con 0x1aa7790 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c02500 con 0x1a5c710 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c039d0 con 0x1ce7540 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 10 client.0 _ll_register_callbacks cb 0x1a289d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d1e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1ce7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1ce7540 0x1ce7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da77fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d1e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:49382/0 (socket says 172.21.15.19:49382) 2024-08-17T02:27:22.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da77fe700 1 -- 172.21.15.19:0/1428491506 learned_addr learned my addr 172.21.15.19:0/1428491506 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:22.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da77fe700 1 -- 172.21.15.19:0/1428491506 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1ce7540 msgr2=0x1ce7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da77fe700 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1ce7540 0x1ce7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da77fe700 1 -- 172.21.15.19:0/1428491506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 msgr2=0x1ce7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da77fe700 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1ce7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da77fe700 1 -- 172.21.15.19:0/1428491506 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da80cb630 con 0x1a5c710 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da7fff700 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1ce7540 0x1ce7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da77fe700 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d1e0f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d98011ec0 tx=0x7f2d98024000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa6a63ced3d799d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2d85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2d85ffb700 1 -- 172.21.15.19:0/1428491506 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98022d50 con 0x1a5c710 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2d85ffb700 1 -- 172.21.15.19:0/1428491506 <== mon.1 v2:172.21.15.119:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d98022a20 con 0x1a5c710 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 1 -- 172.21.15.19:0/1428491506 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2da00076d0 con 0x1a5c710 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2d85ffb700 1 -- 172.21.15.19:0/1428491506 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d98022be0 con 0x1a5c710 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 10 client.5182 fetch_fsmap learned FSMap version 13 2024-08-17T02:27:22.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 1 -- 172.21.15.19:0/1428491506 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x1bad130 con 0x1a5c710 2024-08-17T02:27:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2d85ffb700 1 -- 172.21.15.19:0/1428491506 <== mon.1 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da00076d0 con 0x1a5c710 2024-08-17T02:27:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2d85ffb700 1 -- 172.21.15.19:0/1428491506 <== mon.1 v2:172.21.15.119:3300/0 5 ==== fsmap(e 13) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2d9802b440 con 0x1a5c710 2024-08-17T02:27:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 10 client.5182 fetch_fsmap finished waiting for FSMap version 13 2024-08-17T02:27:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 10 client.5182 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:27:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 20 client.5182 populate_metadata read hostname 'smithi019' 2024-08-17T02:27:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] conn(0x1d3dd50 0x1d3e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 4 client.5182 mds_command: new command op to 34649 tid=0[{"prefix": "status"}] 2024-08-17T02:27:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2db041a740 1 -- 172.21.15.19:0/1428491506 --> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1ad9260 con 0x1d3dd50 2024-08-17T02:27:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.331+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] conn(0x1d3dd50 0x1d3e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2d85ffb700 10 client.5182 ms_handle_connect on v2:172.21.15.19:6834/363347157 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2da6ffd700 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] conn(0x1d3dd50 0x1d3e120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1ef8c5ce4304d9 server_cookie=42eb5ef3c9a15820 in_seq=0 out_seq=0 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2d85ffb700 1 -- 172.21.15.19:0/1428491506 <== mds.0 v2:172.21.15.19:6834/363347157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x1ad9260 con 0x1d3dd50 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2d85ffb700 10 client.5182 handle_command_reply: tid=0 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 client.5182 shutdown 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 -- 172.21.15.19:0/1428491506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 msgr2=0x1d1e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d1e0f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d98011ec0 tx=0x7f2d98024000 comp rx=0 tx=0).stop 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 -- 172.21.15.19:0/1428491506 shutdown_connections 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.19:6834/363347157,v1:172.21.15.19:6835/363347157] conn(0x1d3dd50 0x1d3e120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x1ce7540 0x1ce7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x1aa7790 0x1ce7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 --2- 172.21.15.19:0/1428491506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x1a5c710 0x1d1e0f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 -- 172.21.15.19:0/1428491506 >> 172.21.15.19:0/1428491506 conn(0x1a5ceb0 msgr2=0x1cdc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2d85ffb700 0 client.5182 ms_handle_reset on v2:172.21.15.19:6834/363347157 2024-08-17T02:27:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 -- 172.21.15.19:0/1428491506 shutdown_connections 2024-08-17T02:27:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 1 -- 172.21.15.19:0/1428491506 wait complete. 2024-08-17T02:27:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2db041a740 20 client.5182 trim_cache size 0 max 16384 2024-08-17T02:27:22.342 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:27:22.342 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "1a630ac0-5cc8-463b-a63c-db2f048e27a8", 2024-08-17T02:27:22.342 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 34649, 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 9.0872735060000007, 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 13, 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 33, 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 33, 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 15.996593251 2024-08-17T02:27:22.343 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:27:22.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 -- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d94060860 msgr2=0x7f2d94062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d94060860 0x7f2d94062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009cf0 tx=0x7f2d980091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 -- 172.21.15.19:0/3246494826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2da8156e80 msgr2=0x7f2da80b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2da8156e80 0x7f2da80b21d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2da00010e0 tx=0x7f2da0007dd0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 -- 172.21.15.19:0/3246494826 shutdown_connections 2024-08-17T02:27:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2d94060860 0x7f2d94062d10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2da8156e80 0x7f2da80b21d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2da80cab60 0x7f2da80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 --2- 172.21.15.19:0/3246494826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2da8068be0 0x7f2da814f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 -- 172.21.15.19:0/3246494826 >> 172.21.15.19:0/3246494826 conn(0x7f2da806e4e0 msgr2=0x7f2da8150700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 -- 172.21.15.19:0/3246494826 shutdown_connections 2024-08-17T02:27:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.335+0000 7f2dae16b700 1 -- 172.21.15.19:0/3246494826 wait complete. 2024-08-17T02:27:22.356 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf988ac700 1 Processor -- start 2024-08-17T02:27:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf988ac700 1 -- start start 2024-08-17T02:27:22.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf988ac700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940b14a0 0x7fcf940cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf988ac700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcf940cb390 0x7fcf94160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf988ac700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf940cbaa0 con 0x7fcf94154900 2024-08-17T02:27:22.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf988ac700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf94068790 con 0x7fcf940cb390 2024-08-17T02:27:22.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf988ac700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf941583f0 con 0x7fcf940b14a0 2024-08-17T02:27:22.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf92d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcf94154900 0x7fcf940b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41674/0 (socket says 172.21.15.19:41674) 2024-08-17T02:27:22.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf92d9d700 1 -- 172.21.15.19:0/3069417156 learned_addr learned my addr 172.21.15.19:0/3069417156 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:22.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf9359e700 1 --2- 172.21.15.19:0/3069417156 >> v2:172.21.15.19:3300/0 conn(0x7fcf940cb390 0x7fcf94160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf9259c700 1 --2- 172.21.15.19:0/3069417156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940b14a0 0x7fcf940cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf91d9b700 1 -- 172.21.15.19:0/3069417156 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427602874 0 0) 0x7fcf940cbaa0 con 0x7fcf94154900 2024-08-17T02:27:22.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf91d9b700 1 -- 172.21.15.19:0/3069417156 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf74003570 con 0x7fcf94154900 2024-08-17T02:27:22.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf9359e700 1 -- 172.21.15.19:0/3069417156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940b14a0 msgr2=0x7fcf940cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf9359e700 1 --2- 172.21.15.19:0/3069417156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940b14a0 0x7fcf940cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf9359e700 1 -- 172.21.15.19:0/3069417156 >> v1:172.21.15.19:6789/0 conn(0x7fcf94154900 legacy=0x7fcf940b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf9359e700 1 -- 172.21.15.19:0/3069417156 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf94157630 con 0x7fcf940cb390 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf9359e700 1 --2- 172.21.15.19:0/3069417156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf940cb390 0x7fcf94160ac0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009e60 tx=0x7fcf8c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3006fbd274e236e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf91d9b700 1 -- 172.21.15.19:0/3069417156 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00e070 con 0x7fcf940cb390 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf91d9b700 1 -- 172.21.15.19:0/3069417156 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c00bab0 con 0x7fcf940cb390 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.463+0000 7fcf91d9b700 1 -- 172.21.15.19:0/3069417156 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00be70 con 0x7fcf940cb390 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 -- 172.21.15.19:0/3069417156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf940cb390 msgr2=0x7fcf94160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 --2- 172.21.15.19:0/3069417156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf940cb390 0x7fcf94160ac0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009e60 tx=0x7fcf8c009780 comp rx=0 tx=0).stop 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 -- 172.21.15.19:0/3069417156 shutdown_connections 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 --2- 172.21.15.19:0/3069417156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf940cb390 0x7fcf94160ac0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 --2- 172.21.15.19:0/3069417156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940b14a0 0x7fcf940cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 -- 172.21.15.19:0/3069417156 >> 172.21.15.19:0/3069417156 conn(0x7fcf940678d0 msgr2=0x7fcf94067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 -- 172.21.15.19:0/3069417156 shutdown_connections 2024-08-17T02:27:22.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 -- 172.21.15.19:0/3069417156 wait complete. 2024-08-17T02:27:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 Processor -- start 2024-08-17T02:27:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 -- start start 2024-08-17T02:27:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf940b14a0 0x7fcf94140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940cb390 0x7fcf94148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf94154900 0x7fcf94148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf941522e0 con 0x7fcf94154900 2024-08-17T02:27:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf94152860 con 0x7fcf940b14a0 2024-08-17T02:27:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf988ac700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9414b570 con 0x7fcf940cb390 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf94154900 0x7fcf94148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf94154900 0x7fcf94148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56610/0 (socket says 172.21.15.19:56610) 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9359e700 1 -- 172.21.15.19:0/3007572866 learned_addr learned my addr 172.21.15.19:0/3007572866 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf92d9d700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf940b14a0 0x7fcf94140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9259c700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940cb390 0x7fcf94148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9359e700 1 -- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940cb390 msgr2=0x7fcf94148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9359e700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940cb390 0x7fcf94148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9359e700 1 -- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf940b14a0 msgr2=0x7fcf94140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9359e700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf940b14a0 0x7fcf94140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9359e700 1 -- 172.21.15.19:0/3007572866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c009a20 con 0x7fcf94154900 2024-08-17T02:27:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.467+0000 7fcf9359e700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf94154900 0x7fcf94148750 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf9406c2d0 tx=0x7fcf8c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf8affd700 1 -- 172.21.15.19:0/3007572866 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c012e10 con 0x7fcf94154900 2024-08-17T02:27:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf8affd700 1 -- 172.21.15.19:0/3007572866 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c027470 con 0x7fcf94154900 2024-08-17T02:27:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9414b850 con 0x7fcf94154900 2024-08-17T02:27:22.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf8affd700 1 -- 172.21.15.19:0/3007572866 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c027830 con 0x7fcf94154900 2024-08-17T02:27:22.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf94140ed0 con 0x7fcf94154900 2024-08-17T02:27:22.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf941529f0 con 0x7fcf94154900 2024-08-17T02:27:22.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf8affd700 1 -- 172.21.15.19:0/3007572866 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcf8c024070 con 0x7fcf94154900 2024-08-17T02:27:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf8affd700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcf78060860 0x7fcf78062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf8affd700 1 -- 172.21.15.19:0/3007572866 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf8c07f1b0 con 0x7fcf94154900 2024-08-17T02:27:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.471+0000 7fcf92d9d700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcf78060860 0x7fcf78062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.475+0000 7fcf92d9d700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcf78060860 0x7fcf78062d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c007fd0 tx=0x7fcf7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.479+0000 7fcf8affd700 1 -- 172.21.15.19:0/3007572866 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcf8c04f600 con 0x7fcf94154900 2024-08-17T02:27:22.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.683+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf9414ba40 con 0x7fcf94154900 2024-08-17T02:27:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.683+0000 7fcf8affd700 1 -- 172.21.15.19:0/3007572866 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcf9414ba40 con 0x7fcf94154900 2024-08-17T02:27:22.688 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcf78060860 msgr2=0x7fcf78062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcf78060860 0x7fcf78062d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c007fd0 tx=0x7fcf7c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf94154900 msgr2=0x7fcf94148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf94154900 0x7fcf94148750 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcf9406c2d0 tx=0x7fcf8c019000 comp rx=0 tx=0).stop 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 shutdown_connections 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fcf78060860 0x7fcf78062d10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf94154900 0x7fcf94148750 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcf940cb390 0x7fcf94148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 --2- 172.21.15.19:0/3007572866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf940b14a0 0x7fcf94140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 >> 172.21.15.19:0/3007572866 conn(0x7fcf940678d0 msgr2=0x7fcf94063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 shutdown_connections 2024-08-17T02:27:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:22.687+0000 7fcf988ac700 1 -- 172.21.15.19:0/3007572866 wait complete. 2024-08-17T02:27:22.702 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:22.702 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:22.702 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-08-17T02:27:22.702 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:27:22.702 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:22.702 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:22.702 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:22.703 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:22.703 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:22.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:22.703 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:22.711 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42554sec preferred_lft 42554sec 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 02:42:23:00:30:78 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 7e:11:a0:10:3d:55 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:22.712 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::d445:7ff:fed2:b4ef/64 scope link 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 9a:8d:51:c5:15:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::988d:51ff:fec5:1503/64 scope link 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 7e:11:a0:10:3d:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::7c11:a0ff:fe10:3d55/64 scope link 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:22.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:22.713 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:22.768 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-08-17T02:27:22.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:22.770 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-08-17T02:27:22.778 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-08-17T02:27:22.778 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:22.779 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-17T02:27:22.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:27:22.779 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-17T02:27:22.779 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:22.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:22.779 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-08-17T02:27:22.779 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-08-17T02:27:22.779 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:27:22.779 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:27:22.779 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:27:22.779 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-08-17T02:27:22.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:22.821 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-08-17T02:27:22.868 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:27:22.868 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:27:22.869 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:22.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:22.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-08-17T02:27:22.883 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:27:22.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:22.884 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:22.891 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:22.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:22.891 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:22.896 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-08-17T02:27:22.953 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:22.954 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:22.963 INFO:teuthology.orchestra.run.smithi019.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:22.964 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:22.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:22.965 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-08-17T02:27:22.969 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:27:22.970 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:27:23.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-08-17T02:27:23.032 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:23.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:23.041 INFO:teuthology.orchestra.run.smithi019.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:23.042 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:23.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:23.043 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-08-17T02:27:23.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-08-17T02:27:23.104+0000 7fb650853380 -1 init, newargv = 0x55d195b016a0 newargc=15 2024-08-17T02:27:23.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[33335]: starting ceph client 2024-08-17T02:27:23.117 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[33335]: starting fuse 2024-08-17T02:27:24.149 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-08-17T02:27:24.167 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:24.167 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:24.184 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:24.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:24.185 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-08-17T02:27:24.191 INFO:teuthology.orchestra.run.smithi019.stdout:52 2024-08-17T02:27:24.192 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:27:24.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:27:24.192 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-08-17T02:27:24.192 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-08-17T02:27:24.192 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-08-17T02:27:24.192 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-08-17T02:27:24.192 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:27:24.192 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-08-17T02:27:24.192 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-08-17T02:27:24.193 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:27:24.194 DEBUG:teuthology.orchestra.run.smithi019:> 2024-08-17T02:27:24.194 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-08-17T02:27:24.194 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-08-17T02:27:24.318 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.33335.asok 2024-08-17T02:27:24.503 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33335.asok 2024-08-17T02:27:24.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:24.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33335.asok status 2024-08-17T02:27:24.595 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "33335", 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-08-17T02:27:24.596 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5241, 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 5241 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1367781825 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:24.597 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1367781825 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.5241 192.168.0.1:0/1367781825", 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/1367781825", 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 13, 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 33, 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-08-17T02:27:24.598 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:27:24.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:24.605 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-08-17T02:27:24.605 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:24.613 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-08-17T02:27:24.613 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:24.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:24.614 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:24.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:24.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f8983fff700 1 Processor -- start 2024-08-17T02:27:24.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f8983fff700 1 -- start start 2024-08-17T02:27:24.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f8983fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8984155d80 0x7f89840aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f8983fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89840af420 0x7f89840acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f8983fff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89840af880 con 0x7f89840ad090 2024-08-17T02:27:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f8983fff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89840ad8a0 con 0x7f89840af420 2024-08-17T02:27:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f8983fff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89840adb80 con 0x7f8984155d80 2024-08-17T02:27:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f89827fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89840af420 0x7f89840acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f89827fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89840af420 0x7f89840acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56620/0 (socket says 172.21.15.19:56620) 2024-08-17T02:27:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f89827fc700 1 -- 172.21.15.19:0/3817203221 learned_addr learned my addr 172.21.15.19:0/3817203221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f8982ffd700 1 --2- 172.21.15.19:0/3817203221 >> v2:172.21.15.119:3300/0 conn(0x7f8984155d80 0x7f89840aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f89827fc700 1 -- 172.21.15.19:0/3817203221 >> v2:172.21.15.119:3300/0 conn(0x7f8984155d80 msgr2=0x7f89840aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f89827fc700 1 --2- 172.21.15.19:0/3817203221 >> v2:172.21.15.119:3300/0 conn(0x7f8984155d80 0x7f89840aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f89827fc700 1 -- 172.21.15.19:0/3817203221 >> v1:172.21.15.19:6789/0 conn(0x7f89840ad090 legacy=0x7f89841599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.776+0000 7f89827fc700 1 -- 172.21.15.19:0/3817203221 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89840ade60 con 0x7f89840af420 2024-08-17T02:27:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f89827fc700 1 --2- 172.21.15.19:0/3817203221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 0x7f89840acb50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8984070410 tx=0x7f8978009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f19a7437e04c5b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8981ffb700 1 -- 172.21.15.19:0/3817203221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978009e70 con 0x7f89840af420 2024-08-17T02:27:24.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8981ffb700 1 -- 172.21.15.19:0/3817203221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897800b860 con 0x7f89840af420 2024-08-17T02:27:24.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8981ffb700 1 -- 172.21.15.19:0/3817203221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800bc00 con 0x7f89840af420 2024-08-17T02:27:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 -- 172.21.15.19:0/3817203221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 msgr2=0x7f89840acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 --2- 172.21.15.19:0/3817203221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 0x7f89840acb50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8984070410 tx=0x7f8978009250 comp rx=0 tx=0).stop 2024-08-17T02:27:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 -- 172.21.15.19:0/3817203221 shutdown_connections 2024-08-17T02:27:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 --2- 172.21.15.19:0/3817203221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 0x7f89840acb50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 --2- 172.21.15.19:0/3817203221 >> v2:172.21.15.119:3300/0 conn(0x7f8984155d80 0x7f89840aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 -- 172.21.15.19:0/3817203221 >> 172.21.15.19:0/3817203221 conn(0x7f898406e070 msgr2=0x7f89840b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 -- 172.21.15.19:0/3817203221 shutdown_connections 2024-08-17T02:27:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 -- 172.21.15.19:0/3817203221 wait complete. 2024-08-17T02:27:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 Processor -- start 2024-08-17T02:27:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.780+0000 7f8983fff700 1 -- start start 2024-08-17T02:27:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8983fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89840ad090 0x7f898406b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8983fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 0x7f898416ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8983fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8984155d80 0x7f898416b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8983fff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89841460d0 con 0x7f89840af420 2024-08-17T02:27:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8983fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8984145490 con 0x7f89840ad090 2024-08-17T02:27:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8983fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8984145730 con 0x7f8984155d80 2024-08-17T02:27:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89827fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 0x7f898416ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8982ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89840ad090 0x7f898406b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89827fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 0x7f898416ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56624/0 (socket says 172.21.15.19:56624) 2024-08-17T02:27:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89827fc700 1 -- 172.21.15.19:0/2526327644 learned_addr learned my addr 172.21.15.19:0/2526327644 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89837fe700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8984155d80 0x7f898416b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89827fc700 1 -- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8984155d80 msgr2=0x7f898416b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89827fc700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8984155d80 0x7f898416b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89827fc700 1 -- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89840ad090 msgr2=0x7f898406b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89827fc700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89840ad090 0x7f898406b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89827fc700 1 -- 172.21.15.19:0/2526327644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780094f0 con 0x7f89840af420 2024-08-17T02:27:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8982ffd700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89840ad090 0x7f898406b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:24.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f89827fc700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 0x7f898416ae40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f898406fbe0 tx=0x7f8978017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f896affd700 1 -- 172.21.15.19:0/2526327644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800bbe0 con 0x7f89840af420 2024-08-17T02:27:24.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f896affd700 1 -- 172.21.15.19:0/2526327644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8978011420 con 0x7f89840af420 2024-08-17T02:27:24.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8984145a10 con 0x7f89840af420 2024-08-17T02:27:24.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f896affd700 1 -- 172.21.15.19:0/2526327644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780117c0 con 0x7f89840af420 2024-08-17T02:27:24.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.784+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898406ba60 con 0x7f89840af420 2024-08-17T02:27:24.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.788+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89840638f0 con 0x7f89840af420 2024-08-17T02:27:24.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.788+0000 7f896affd700 1 -- 172.21.15.19:0/2526327644 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8978011bf0 con 0x7f89840af420 2024-08-17T02:27:24.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.788+0000 7f896affd700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8970060860 0x7f8970062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.788+0000 7f896affd700 1 -- 172.21.15.19:0/2526327644 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f897807e090 con 0x7f89840af420 2024-08-17T02:27:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.788+0000 7f8982ffd700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8970060860 0x7f8970062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.788+0000 7f8982ffd700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8970060860 0x7f8970062d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f897400f8c0 tx=0x7f897400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.800+0000 7f896affd700 1 -- 172.21.15.19:0/2526327644 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f897804e4e0 con 0x7f89840af420 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:24.996+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8984155560 con 0x7f89840af420 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f896affd700 1 -- 172.21.15.19:0/2526327644 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8978057020 con 0x7f89840af420 2024-08-17T02:27:25.002 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8970060860 msgr2=0x7f8970062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8970060860 0x7f8970062d10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f897400f8c0 tx=0x7f897400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 msgr2=0x7f898416ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 0x7f898416ae40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f898406fbe0 tx=0x7f8978017000 comp rx=0 tx=0).stop 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 shutdown_connections 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8970060860 0x7f8970062d10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8984155d80 0x7f898416b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89840af420 0x7f898416ae40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 --2- 172.21.15.19:0/2526327644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89840ad090 0x7f898406b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 >> 172.21.15.19:0/2526327644 conn(0x7f898406e070 msgr2=0x7f8984146590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 shutdown_connections 2024-08-17T02:27:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:25.000+0000 7f8983fff700 1 -- 172.21.15.19:0/2526327644 wait complete. 2024-08-17T02:27:25.016 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:25.016 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:25.016 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-08-17T02:27:25.016 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:27:25.017 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:25.017 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:25.017 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:25.017 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:25.017 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:25.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:25.017 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-08-17T02:27:25.026 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42551sec preferred_lft 42551sec 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:5f:96:fc:ab brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:ff:18:ed:c1:7d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c822:e4ff:fe07:ddf0/64 scope link 2024-08-17T02:27:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:25.029 INFO:teuthology.orchestra.run.smithi119.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 16:36:22:ed:1e:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::1436:22ff:feed:1e03/64 scope link 2024-08-17T02:27:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:25.029 INFO:teuthology.orchestra.run.smithi119.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:ff:18:ed:c1:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:27:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ff:18ff:feed:c17d/64 scope link 2024-08-17T02:27:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:25.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:25.029 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:25.083 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-08-17T02:27:25.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:25.085 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-08-17T02:27:25.091 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-08-17T02:27:25.092 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:25.092 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:27:25.092 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:25.092 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:27:25.092 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:27:25.092 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:27:25.092 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:25.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:25.092 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-08-17T02:27:25.092 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-08-17T02:27:25.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:25.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:25.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:25.093 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-08-17T02:27:25.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:25.132 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-08-17T02:27:25.179 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:27:25.179 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:27:25.179 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:25.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:25.180 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-08-17T02:27:25.196 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:27:25.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:25.196 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:25.202 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:25.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:25.202 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:25.254 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-08-17T02:27:25.271 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:25.272 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:25.286 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:25.286 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:25.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:25.287 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-08-17T02:27:25.293 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:27:25.293 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:27:25.338 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-08-17T02:27:25.355 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:25.355 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:25.365 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:25.366 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:25.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:25.367 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-08-17T02:27:25.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:2024-08-17T02:27:25.420+0000 7f985277f380 -1 init, newargv = 0x55ecde381df0 newargc=15 2024-08-17T02:27:25.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:ceph-fuse[30601]: starting ceph client 2024-08-17T02:27:25.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:ceph-fuse[30601]: starting fuse 2024-08-17T02:27:26.473 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-08-17T02:27:26.489 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:27:26.490 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:27:26.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:26.523 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:26.546 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:27:26.547 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:27:26.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:26.547 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-08-17T02:27:26.554 INFO:teuthology.orchestra.run.smithi119.stdout:52 2024-08-17T02:27:26.555 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-08-17T02:27:26.555 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> 2024-08-17T02:27:26.556 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.1")) 2024-08-17T02:27:26.557 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-08-17T02:27:26.639 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.1.30601.asok 2024-08-17T02:27:26.824 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.30601.asok 2024-08-17T02:27:26.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:26.824 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.30601.asok status 2024-08-17T02:27:26.917 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-08-17T02:27:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-08-17T02:27:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:27:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:27:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "1", 2024-08-17T02:27:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-08-17T02:27:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:27:26.918 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "30601", 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5200, 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 5200 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-08-17T02:27:26.919 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 152378410 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 152378410 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.5200 192.168.0.1:0/152378410", 2024-08-17T02:27:26.920 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/152378410", 2024-08-17T02:27:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-08-17T02:27:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 13, 2024-08-17T02:27:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 33, 2024-08-17T02:27:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:27:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-08-17T02:27:26.921 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-08-17T02:27:26.921 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-08-17T02:27:26.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:26.927 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-08-17T02:27:26.927 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:26.935 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-08-17T02:27:26.935 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:26.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:27:26.935 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:26.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:27:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.064+0000 7f619759e700 1 Processor -- start 2024-08-17T02:27:27.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.064+0000 7f619759e700 1 -- start start 2024-08-17T02:27:27.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61980b2e70 0x7f61980cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61980c5bb0 con 0x7f61980cc230 2024-08-17T02:27:27.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61980b32f0 con 0x7f61980ce640 2024-08-17T02:27:27.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61980c4fa0 con 0x7f61980b2e70 2024-08-17T02:27:27.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f6195d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61980b2e70 0x7f61980cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f6195d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61980b2e70 0x7f61980cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56632/0 (socket says 172.21.15.19:56632) 2024-08-17T02:27:27.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f6196d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f61980cc230 0x7f61980c6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41688/0 (socket says 172.21.15.19:41688) 2024-08-17T02:27:27.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f6195d9b700 1 -- 172.21.15.19:0/2826523872 learned_addr learned my addr 172.21.15.19:0/2826523872 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:27.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f6195d9b700 1 -- 172.21.15.19:0/2826523872 >> v1:172.21.15.119:6789/0 conn(0x7f61980ce640 legacy=0x7f61980cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f6195d9b700 1 -- 172.21.15.19:0/2826523872 >> v1:172.21.15.19:6789/0 conn(0x7f61980cc230 legacy=0x7f61980c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f6195d9b700 1 -- 172.21.15.19:0/2826523872 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980c5280 con 0x7f61980b2e70 2024-08-17T02:27:27.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f6195d9b700 1 --2- 172.21.15.19:0/2826523872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980b2e70 0x7f61980cbcf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f61880099b0 tx=0x7f6188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0019aff92ca3dac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619559a700 1 -- 172.21.15.19:0/2826523872 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800b820 con 0x7f61980b2e70 2024-08-17T02:27:27.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619559a700 1 -- 172.21.15.19:0/2826523872 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618800b980 con 0x7f61980b2e70 2024-08-17T02:27:27.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619559a700 1 -- 172.21.15.19:0/2826523872 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800bd40 con 0x7f61980b2e70 2024-08-17T02:27:27.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 -- 172.21.15.19:0/2826523872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980b2e70 msgr2=0x7f61980cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 --2- 172.21.15.19:0/2826523872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980b2e70 0x7f61980cbcf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f61880099b0 tx=0x7f6188009250 comp rx=0 tx=0).stop 2024-08-17T02:27:27.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 -- 172.21.15.19:0/2826523872 shutdown_connections 2024-08-17T02:27:27.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 --2- 172.21.15.19:0/2826523872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980b2e70 0x7f61980cbcf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 -- 172.21.15.19:0/2826523872 >> 172.21.15.19:0/2826523872 conn(0x7f6198099410 msgr2=0x7f61980675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 -- 172.21.15.19:0/2826523872 shutdown_connections 2024-08-17T02:27:27.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.068+0000 7f619759e700 1 -- 172.21.15.19:0/2826523872 wait complete. 2024-08-17T02:27:27.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f619759e700 1 Processor -- start 2024-08-17T02:27:27.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f619759e700 1 -- start start 2024-08-17T02:27:27.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f619759e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b2e70 0x7f619814bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f619759e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cc230 0x7f61980c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f619759e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980ce640 0x7f61980690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f619759e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619809ad30 con 0x7f61980ce640 2024-08-17T02:27:27.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f619759e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619814c130 con 0x7f61980cc230 2024-08-17T02:27:27.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f619759e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619809a120 con 0x7f61980b2e70 2024-08-17T02:27:27.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f6196d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980ce640 0x7f61980690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f6196d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980ce640 0x7f61980690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56636/0 (socket says 172.21.15.19:56636) 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.072+0000 7f6196d9d700 1 -- 172.21.15.19:0/1943102694 learned_addr learned my addr 172.21.15.19:0/1943102694 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f6195d9b700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cc230 0x7f61980c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f619659c700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b2e70 0x7f619814bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f6196d9d700 1 -- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b2e70 msgr2=0x7f619814bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f6196d9d700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b2e70 0x7f619814bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f6196d9d700 1 -- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cc230 msgr2=0x7f61980c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f6196d9d700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cc230 0x7f61980c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f6196d9d700 1 -- 172.21.15.19:0/1943102694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61880094f0 con 0x7f61980ce640 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f6195d9b700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cc230 0x7f61980c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f6196d9d700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980ce640 0x7f61980690f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f619000cd00 tx=0x7f6190001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f61867fc700 1 -- 172.21.15.19:0/1943102694 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190005df0 con 0x7f61980ce640 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f61867fc700 1 -- 172.21.15.19:0/1943102694 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619000a960 con 0x7f61980ce640 2024-08-17T02:27:27.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619809a400 con 0x7f61980ce640 2024-08-17T02:27:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f61867fc700 1 -- 172.21.15.19:0/1943102694 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619000ad00 con 0x7f61980ce640 2024-08-17T02:27:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619809a9c0 con 0x7f61980ce640 2024-08-17T02:27:27.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.076+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619809aea0 con 0x7f61980ce640 2024-08-17T02:27:27.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.080+0000 7f61867fc700 1 -- 172.21.15.19:0/1943102694 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6190007300 con 0x7f61980ce640 2024-08-17T02:27:27.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.080+0000 7f61867fc700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6178060860 0x7f6178062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.080+0000 7f61867fc700 1 -- 172.21.15.19:0/1943102694 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f619007cda0 con 0x7f61980ce640 2024-08-17T02:27:27.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.080+0000 7f619659c700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6178060860 0x7f6178062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.080+0000 7f619659c700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6178060860 0x7f6178062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f618c003870 tx=0x7f618c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.088+0000 7f61867fc700 1 -- 172.21.15.19:0/1943102694 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f619004d270 con 0x7f61980ce640 2024-08-17T02:27:27.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.292+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f61980644b0 con 0x7f61980ce640 2024-08-17T02:27:27.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.320+0000 7f61867fc700 1 -- 172.21.15.19:0/1943102694 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 136+0+0 (secure 0 0 0) 0x7f619000ae60 con 0x7f61980ce640 2024-08-17T02:27:27.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6178060860 msgr2=0x7f6178062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6178060860 0x7f6178062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f618c003870 tx=0x7f618c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:27.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980ce640 msgr2=0x7f61980690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980ce640 0x7f61980690f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f619000cd00 tx=0x7f6190001b10 comp rx=0 tx=0).stop 2024-08-17T02:27:27.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 shutdown_connections 2024-08-17T02:27:27.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6178060860 0x7f6178062d10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61980ce640 0x7f61980690f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cc230 0x7f61980c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 --2- 172.21.15.19:0/1943102694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b2e70 0x7f619814bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 >> 172.21.15.19:0/1943102694 conn(0x7f6198099410 msgr2=0x7f61981588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 shutdown_connections 2024-08-17T02:27:27.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.324+0000 7f619759e700 1 -- 172.21.15.19:0/1943102694 wait complete. 2024-08-17T02:27:27.343 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:27:27.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.448+0000 7f704daa8700 1 Processor -- start 2024-08-17T02:27:27.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.448+0000 7f704daa8700 1 -- start start 2024-08-17T02:27:27.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.448+0000 7f704daa8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70480adf10 0x7f70480ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.448+0000 7f704daa8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70480cb450 0x7f704806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.448+0000 7f704daa8700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70480cb890 con 0x7f704806e470 2024-08-17T02:27:27.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.448+0000 7f704daa8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7048158290 con 0x7f70480cb450 2024-08-17T02:27:27.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.448+0000 7f704daa8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70481610c0 con 0x7f70480adf10 2024-08-17T02:27:27.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.448+0000 7f7047fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70480cb450 0x7f704806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.448+0000 7f7047fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70480cb450 0x7f704806e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56648/0 (socket says 172.21.15.19:56648) 2024-08-17T02:27:27.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f7047fff700 1 -- 172.21.15.19:0/1409527163 learned_addr learned my addr 172.21.15.19:0/1409527163 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:27.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f70477fe700 1 --2- 172.21.15.19:0/1409527163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70480adf10 0x7f70480ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f70477fe700 1 -- 172.21.15.19:0/1409527163 >> v2:172.21.15.19:3300/0 conn(0x7f70480cb450 msgr2=0x7f704806e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f70477fe700 1 --2- 172.21.15.19:0/1409527163 >> v2:172.21.15.19:3300/0 conn(0x7f70480cb450 0x7f704806e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f70477fe700 1 -- 172.21.15.19:0/1409527163 >> v1:172.21.15.119:6789/0 conn(0x7f704806e470 legacy=0x7f70480cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f70477fe700 1 -- 172.21.15.19:0/1409527163 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70480ae820 con 0x7f70480adf10 2024-08-17T02:27:27.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f70477fe700 1 --2- 172.21.15.19:0/1409527163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70480adf10 0x7f70480ae2e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f70380098e0 tx=0x7f70380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8a87dad7906d6d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f70467fc700 1 -- 172.21.15.19:0/1409527163 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703800b640 con 0x7f70480adf10 2024-08-17T02:27:27.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f70467fc700 1 -- 172.21.15.19:0/1409527163 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703800b7a0 con 0x7f70480adf10 2024-08-17T02:27:27.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f70467fc700 1 -- 172.21.15.19:0/1409527163 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703800bb40 con 0x7f70480adf10 2024-08-17T02:27:27.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f704daa8700 1 -- 172.21.15.19:0/1409527163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70480adf10 msgr2=0x7f70480ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f704daa8700 1 --2- 172.21.15.19:0/1409527163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70480adf10 0x7f70480ae2e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f70380098e0 tx=0x7f70380091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f704daa8700 1 -- 172.21.15.19:0/1409527163 shutdown_connections 2024-08-17T02:27:27.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f704daa8700 1 --2- 172.21.15.19:0/1409527163 >> v2:172.21.15.19:3300/0 conn(0x7f70480cb450 0x7f704806e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f704daa8700 1 --2- 172.21.15.19:0/1409527163 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70480adf10 0x7f70480ae2e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f704daa8700 1 -- 172.21.15.19:0/1409527163 >> 172.21.15.19:0/1409527163 conn(0x7f7048067810 msgr2=0x7f7048067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f704daa8700 1 -- 172.21.15.19:0/1409527163 shutdown_connections 2024-08-17T02:27:27.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.452+0000 7f704daa8700 1 -- 172.21.15.19:0/1409527163 wait complete. 2024-08-17T02:27:27.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 Processor -- start 2024-08-17T02:27:27.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 -- start start 2024-08-17T02:27:27.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704806e470 0x7f7048171c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70480adf10 0x7f70481605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70480cb450 0x7f704816dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704816ecc0 con 0x7f70480adf10 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704816e700 con 0x7f70480cb450 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704816e9e0 con 0x7f704806e470 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f7046ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70480adf10 0x7f70481605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f70477fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704806e470 0x7f7048171c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f7047fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70480cb450 0x7f704816dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f70477fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704806e470 0x7f7048171c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:34364/0 (socket says 172.21.15.19:34364) 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f7047fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70480cb450 0x7f704816dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:49446/0 (socket says 172.21.15.19:49446) 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f70477fe700 1 -- 172.21.15.19:0/3404218780 learned_addr learned my addr 172.21.15.19:0/3404218780 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:27.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f7046ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70480adf10 0x7f70481605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56662/0 (socket says 172.21.15.19:56662) 2024-08-17T02:27:27.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f70477fe700 1 -- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70480cb450 msgr2=0x7f704816dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f70477fe700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70480cb450 0x7f704816dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f70477fe700 1 -- 172.21.15.19:0/3404218780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70480adf10 msgr2=0x7f70481605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f70477fe700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70480adf10 0x7f70481605f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f70477fe700 1 -- 172.21.15.19:0/3404218780 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009420 con 0x7f704806e470 2024-08-17T02:27:27.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f7047fff700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70480cb450 0x7f704816dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:27.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f70477fe700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704806e470 0x7f7048171c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7048161200 tx=0x7f7038017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f703f7fe700 1 -- 172.21.15.19:0/3404218780 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703801bc40 con 0x7f704806e470 2024-08-17T02:27:27.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f703f7fe700 1 -- 172.21.15.19:0/3404218780 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703801bdc0 con 0x7f704806e470 2024-08-17T02:27:27.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f703f7fe700 1 -- 172.21.15.19:0/3404218780 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038011670 con 0x7f704806e470 2024-08-17T02:27:27.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7048171450 con 0x7f704806e470 2024-08-17T02:27:27.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.456+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7048172190 con 0x7f704806e470 2024-08-17T02:27:27.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.460+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70480645c0 con 0x7f704806e470 2024-08-17T02:27:27.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.460+0000 7f703f7fe700 1 -- 172.21.15.19:0/3404218780 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7038011a20 con 0x7f704806e470 2024-08-17T02:27:27.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.460+0000 7f703f7fe700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7028060860 0x7f7028062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.460+0000 7f703f7fe700 1 -- 172.21.15.19:0/3404218780 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f703807e140 con 0x7f704806e470 2024-08-17T02:27:27.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.460+0000 7f7046ffd700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7028060860 0x7f7028062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.464+0000 7f7046ffd700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7028060860 0x7f7028062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f704809a030 tx=0x7f7030001710 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.472+0000 7f703f7fe700 1 -- 172.21.15.19:0/3404218780 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f703804e610 con 0x7f704806e470 2024-08-17T02:27:27.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.660+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f70480684a0 con 0x7f7028060860 2024-08-17T02:27:27.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.660+0000 7f703f7fe700 1 -- 172.21.15.19:0/3404218780 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f70480684a0 con 0x7f7028060860 2024-08-17T02:27:27.666 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-08-17T02:27:27.666 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:27.666 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephfs" 2024-08-17T02:27:27.666 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:27.666 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-08-17T02:27:27.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7028060860 msgr2=0x7f7028062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7028060860 0x7f7028062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f704809a030 tx=0x7f7030001710 comp rx=0 tx=0).stop 2024-08-17T02:27:27.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704806e470 msgr2=0x7f7048171c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704806e470 0x7f7048171c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7048161200 tx=0x7f7038017000 comp rx=0 tx=0).stop 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 shutdown_connections 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7028060860 0x7f7028062d10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70480cb450 0x7f704816dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70480adf10 0x7f70481605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 --2- 172.21.15.19:0/3404218780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704806e470 0x7f7048171c50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 >> 172.21.15.19:0/3404218780 conn(0x7f7048067810 msgr2=0x7f7048069270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 shutdown_connections 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.664+0000 7f704daa8700 1 -- 172.21.15.19:0/3404218780 wait complete. 2024-08-17T02:27:27.680 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:27:27.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.792+0000 7f2e0513e700 1 Processor -- start 2024-08-17T02:27:27.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.792+0000 7f2e0513e700 1 -- start start 2024-08-17T02:27:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e001514d0 0x7f2e0006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2e000b14a0 0x7f2e00157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0006e010 con 0x7f2e001574f0 2024-08-17T02:27:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0006efa0 con 0x7f2e001514d0 2024-08-17T02:27:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e00157fb0 con 0x7f2e000b14a0 2024-08-17T02:27:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2df7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2e001574f0 0x7f2e000b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41700/0 (socket says 172.21.15.19:41700) 2024-08-17T02:27:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dfffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e001514d0 0x7f2e0006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2df7fff700 1 -- 172.21.15.19:0/2060955841 learned_addr learned my addr 172.21.15.19:0/2060955841 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0493d700 1 --2- 172.21.15.19:0/2060955841 >> v2:172.21.15.119:3300/0 conn(0x7f2e000b14a0 0x7f2e00157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dff7fe700 1 -- 172.21.15.19:0/2060955841 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736670650 0 0) 0x7f2e0006e010 con 0x7f2e001574f0 2024-08-17T02:27:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dff7fe700 1 -- 172.21.15.19:0/2060955841 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dec003570 con 0x7f2e001574f0 2024-08-17T02:27:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dfffff700 1 -- 172.21.15.19:0/2060955841 >> v2:172.21.15.119:3300/0 conn(0x7f2e000b14a0 msgr2=0x7f2e00157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dfffff700 1 --2- 172.21.15.19:0/2060955841 >> v2:172.21.15.119:3300/0 conn(0x7f2e000b14a0 0x7f2e00157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dfffff700 1 -- 172.21.15.19:0/2060955841 >> v1:172.21.15.19:6789/0 conn(0x7f2e001574f0 legacy=0x7f2e000b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dfffff700 1 -- 172.21.15.19:0/2060955841 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00158290 con 0x7f2e001514d0 2024-08-17T02:27:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dfffff700 1 --2- 172.21.15.19:0/2060955841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 0x7f2e0006ea60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2e0006cdd0 tx=0x7f2df00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3792af93203fb5cb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dff7fe700 1 -- 172.21.15.19:0/2060955841 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df0011630 con 0x7f2e001514d0 2024-08-17T02:27:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dff7fe700 1 -- 172.21.15.19:0/2060955841 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df00117b0 con 0x7f2e001514d0 2024-08-17T02:27:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2dff7fe700 1 -- 172.21.15.19:0/2060955841 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df0011b70 con 0x7f2e001514d0 2024-08-17T02:27:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 -- 172.21.15.19:0/2060955841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 msgr2=0x7f2e0006ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 --2- 172.21.15.19:0/2060955841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 0x7f2e0006ea60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2e0006cdd0 tx=0x7f2df00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 -- 172.21.15.19:0/2060955841 shutdown_connections 2024-08-17T02:27:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 --2- 172.21.15.19:0/2060955841 >> v2:172.21.15.119:3300/0 conn(0x7f2e000b14a0 0x7f2e00157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 --2- 172.21.15.19:0/2060955841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 0x7f2e0006ea60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 -- 172.21.15.19:0/2060955841 >> 172.21.15.19:0/2060955841 conn(0x7f2e000678a0 msgr2=0x7f2e00067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 -- 172.21.15.19:0/2060955841 shutdown_connections 2024-08-17T02:27:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.796+0000 7f2e0513e700 1 -- 172.21.15.19:0/2060955841 wait complete. 2024-08-17T02:27:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0513e700 1 Processor -- start 2024-08-17T02:27:27.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0513e700 1 -- start start 2024-08-17T02:27:27.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0513e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e000b14a0 0x7f2e0013e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0513e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 0x7f2e001561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0513e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e001574f0 0x7f2e001566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0513e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e001546a0 con 0x7f2e001514d0 2024-08-17T02:27:27.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0513e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e00153a90 con 0x7f2e000b14a0 2024-08-17T02:27:27.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0513e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e00153d70 con 0x7f2e001574f0 2024-08-17T02:27:27.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2df7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 0x7f2e001561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2df7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 0x7f2e001561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56674/0 (socket says 172.21.15.19:56674) 2024-08-17T02:27:27.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2df7fff700 1 -- 172.21.15.19:0/1530055147 learned_addr learned my addr 172.21.15.19:0/1530055147 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:27.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2dfffff700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e000b14a0 0x7f2e0013e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0493d700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e001574f0 0x7f2e001566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2df7fff700 1 -- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e001574f0 msgr2=0x7f2e001566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2df7fff700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e001574f0 0x7f2e001566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2df7fff700 1 -- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e000b14a0 msgr2=0x7f2e0013e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2df7fff700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e000b14a0 0x7f2e0013e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2df7fff700 1 -- 172.21.15.19:0/1530055147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df0009420 con 0x7f2e001514d0 2024-08-17T02:27:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2e0493d700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e001574f0 0x7f2e001566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.800+0000 7f2df7fff700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 0x7f2e001561a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c590 tx=0x7f2de8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2dfcff9700 1 -- 172.21.15.19:0/1530055147 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8005b30 con 0x7f2e001514d0 2024-08-17T02:27:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2dfcff9700 1 -- 172.21.15.19:0/1530055147 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de8005cb0 con 0x7f2e001514d0 2024-08-17T02:27:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2dfcff9700 1 -- 172.21.15.19:0/1530055147 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8007320 con 0x7f2e001514d0 2024-08-17T02:27:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e00154050 con 0x7f2e001514d0 2024-08-17T02:27:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0013e7d0 con 0x7f2e001514d0 2024-08-17T02:27:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e00064330 con 0x7f2e001514d0 2024-08-17T02:27:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2dfcff9700 1 -- 172.21.15.19:0/1530055147 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2de801b3b0 con 0x7f2e001514d0 2024-08-17T02:27:27.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2dfcff9700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2de0060890 0x7f2de0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2dfcff9700 1 -- 172.21.15.19:0/1530055147 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2de807bf70 con 0x7f2e001514d0 2024-08-17T02:27:27.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.804+0000 7f2dfffff700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2de0060890 0x7f2de0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.808+0000 7f2dfffff700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2de0060890 0x7f2de0062d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e0006cdd0 tx=0x7f2df0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.812+0000 7f2dfcff9700 1 -- 172.21.15.19:0/1530055147 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2de804c3c0 con 0x7f2e001514d0 2024-08-17T02:27:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.976+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2e00155060 con 0x7f2e001514d0 2024-08-17T02:27:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2dfcff9700 1 -- 172.21.15.19:0/1530055147 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2de80170c0 con 0x7f2e001514d0 2024-08-17T02:27:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2de0060890 msgr2=0x7f2de0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2de0060890 0x7f2de0062d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e0006cdd0 tx=0x7f2df0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 msgr2=0x7f2e001561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 0x7f2e001561a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c590 tx=0x7f2de8007e00 comp rx=0 tx=0).stop 2024-08-17T02:27:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 shutdown_connections 2024-08-17T02:27:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f2de0060890 0x7f2de0062d40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2e001574f0 0x7f2e001566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e001514d0 0x7f2e001561a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 --2- 172.21.15.19:0/1530055147 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e000b14a0 0x7f2e0013e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 >> 172.21.15.19:0/1530055147 conn(0x7f2e000678a0 msgr2=0x7f2e000c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 shutdown_connections 2024-08-17T02:27:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:27.980+0000 7f2e0513e700 1 -- 172.21.15.19:0/1530055147 wait complete. 2024-08-17T02:27:27.997 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000446940 2024-08-17T02:27:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.100+0000 7f186b03f700 1 Processor -- start 2024-08-17T02:27:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.100+0000 7f186b03f700 1 -- start start 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186b03f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f18640af190 0x7f18640b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186b03f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1864140f70 con 0x7f186406e840 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186b03f700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1864141250 con 0x7f186406e470 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186b03f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1864141530 con 0x7f18640af190 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186a83e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f186406e840 0x7f18640b1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33926/0 (socket says 172.21.15.19:33926) 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186a83e700 1 -- 172.21.15.19:0/3338396713 learned_addr learned my addr 172.21.15.19:0/3338396713 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186983c700 1 --2- 172.21.15.19:0/3338396713 >> v2:172.21.15.119:3300/0 conn(0x7f18640af190 0x7f18640b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186903b700 1 -- 172.21.15.19:0/3338396713 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503891600 0 0) 0x7f1864140f70 con 0x7f186406e840 2024-08-17T02:27:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186903b700 1 -- 172.21.15.19:0/3338396713 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1850003570 con 0x7f186406e840 2024-08-17T02:27:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186983c700 1 -- 172.21.15.19:0/3338396713 >> v1:172.21.15.119:6789/0 conn(0x7f186406e470 legacy=0x7f18640aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186983c700 1 -- 172.21.15.19:0/3338396713 >> v1:172.21.15.19:6789/0 conn(0x7f186406e840 legacy=0x7f18640b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186983c700 1 -- 172.21.15.19:0/3338396713 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864141810 con 0x7f18640af190 2024-08-17T02:27:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186983c700 1 --2- 172.21.15.19:0/3338396713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640af190 0x7f18640b0ef0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f18580098e0 tx=0x7f18580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dce2eba2782fb789 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186903b700 1 -- 172.21.15.19:0/3338396713 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800b640 con 0x7f18640af190 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186903b700 1 -- 172.21.15.19:0/3338396713 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800b7a0 con 0x7f18640af190 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186903b700 1 -- 172.21.15.19:0/3338396713 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800bb20 con 0x7f18640af190 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186b03f700 1 -- 172.21.15.19:0/3338396713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640af190 msgr2=0x7f18640b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186b03f700 1 --2- 172.21.15.19:0/3338396713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640af190 0x7f18640b0ef0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f18580098e0 tx=0x7f18580091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186b03f700 1 -- 172.21.15.19:0/3338396713 shutdown_connections 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186b03f700 1 --2- 172.21.15.19:0/3338396713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18640af190 0x7f18640b0ef0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.104+0000 7f186b03f700 1 -- 172.21.15.19:0/3338396713 >> 172.21.15.19:0/3338396713 conn(0x7f18640678a0 msgr2=0x7f1864067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 -- 172.21.15.19:0/3338396713 shutdown_connections 2024-08-17T02:27:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 -- 172.21.15.19:0/3338396713 wait complete. 2024-08-17T02:27:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 Processor -- start 2024-08-17T02:27:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 -- start start 2024-08-17T02:27:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f186406e470 0x7f186414c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f186406e840 0x7f18640c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18640af190 0x7f186413faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18640c7900 con 0x7f186406e470 2024-08-17T02:27:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18640c36e0 con 0x7f186406e840 2024-08-17T02:27:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186b03f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18640c39c0 con 0x7f18640af190 2024-08-17T02:27:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186a03d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f186406e470 0x7f186414c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186a03d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f186406e470 0x7f186414c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59990/0 (socket says 172.21.15.19:59990) 2024-08-17T02:27:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186a03d700 1 -- 172.21.15.19:0/2974590517 learned_addr learned my addr 172.21.15.19:0/2974590517 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186a83e700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18640af190 0x7f186413faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.108+0000 7f186983c700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f186406e840 0x7f18640c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f186a03d700 1 -- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18640af190 msgr2=0x7f186413faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f186a03d700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18640af190 0x7f186413faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f186a03d700 1 -- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f186406e840 msgr2=0x7f18640c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f186a03d700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f186406e840 0x7f18640c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f186a03d700 1 -- 172.21.15.19:0/2974590517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858009420 con 0x7f186406e470 2024-08-17T02:27:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f186a03d700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f186406e470 0x7f186414c670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f186000c590 tx=0x7f1860007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f18567fc700 1 -- 172.21.15.19:0/2974590517 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860011590 con 0x7f186406e470 2024-08-17T02:27:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f18567fc700 1 -- 172.21.15.19:0/2974590517 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860011730 con 0x7f186406e470 2024-08-17T02:27:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18640c3ca0 con 0x7f186406e470 2024-08-17T02:27:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f18567fc700 1 -- 172.21.15.19:0/2974590517 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860011af0 con 0x7f186406e470 2024-08-17T02:27:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18640c4260 con 0x7f186406e470 2024-08-17T02:27:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18640c4450 con 0x7f186406e470 2024-08-17T02:27:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f18567fc700 1 -- 172.21.15.19:0/2974590517 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1860012420 con 0x7f186406e470 2024-08-17T02:27:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f18567fc700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1848060860 0x7f1848062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.112+0000 7f18567fc700 1 -- 172.21.15.19:0/2974590517 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f186007be10 con 0x7f186406e470 2024-08-17T02:27:28.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.116+0000 7f186983c700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1848060860 0x7f1848062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.116+0000 7f186983c700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1848060860 0x7f1848062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f18640af590 tx=0x7f1858017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.120+0000 7f18567fc700 1 -- 172.21.15.19:0/2974590517 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f186004c310 con 0x7f186406e470 2024-08-17T02:27:28.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:28.308+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000446940", "target": ["mon-mgr", ""]}) v1 -- 0x7f1864064330 con 0x7f1848060860 2024-08-17T02:27:30.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.420+0000 7f18567fc700 1 -- 172.21.15.19:0/2974590517 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f1864064330 con 0x7f1848060860 2024-08-17T02:27:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1848060860 msgr2=0x7f1848062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1848060860 0x7f1848062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f18640af590 tx=0x7f1858017000 comp rx=0 tx=0).stop 2024-08-17T02:27:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f186406e470 msgr2=0x7f186414c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f186406e470 0x7f186414c670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f186000c590 tx=0x7f1860007f30 comp rx=0 tx=0).stop 2024-08-17T02:27:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 shutdown_connections 2024-08-17T02:27:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1848060860 0x7f1848062d10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18640af190 0x7f186413faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f186406e840 0x7f18640c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 --2- 172.21.15.19:0/2974590517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f186406e470 0x7f186414c670 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f186000c590 tx=0x7f1860007f30 comp rx=0 tx=0).stop 2024-08-17T02:27:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.428+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 >> 172.21.15.19:0/2974590517 conn(0x7f18640678a0 msgr2=0x7f186415d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.432+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 shutdown_connections 2024-08-17T02:27:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.432+0000 7f186b03f700 1 -- 172.21.15.19:0/2974590517 wait complete. 2024-08-17T02:27:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:27:30.450 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:27:30.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5f4fdc700 1 Processor -- start 2024-08-17T02:27:30.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5f4fdc700 1 -- start start 2024-08-17T02:27:30.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5f4fdc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5f01613e0 0x7fd5f01617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5f4fdc700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd5f00adfa0 0x7fd5f00ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5f4fdc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f00acf00 con 0x7fd5f00b1a90 2024-08-17T02:27:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5f4fdc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f00ad1e0 con 0x7fd5f01613e0 2024-08-17T02:27:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5f4fdc700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f00ad4c0 con 0x7fd5f00adfa0 2024-08-17T02:27:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5eeffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd5f00b1a90 0x7fd5f00ac6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33938/0 (socket says 172.21.15.19:33938) 2024-08-17T02:27:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5ef7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5f01613e0 0x7fd5f01617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5eeffd700 1 -- 172.21.15.19:0/1037732872 learned_addr learned my addr 172.21.15.19:0/1037732872 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5effff700 1 --2- 172.21.15.19:0/1037732872 >> v2:172.21.15.119:3300/0 conn(0x7fd5f00adfa0 0x7fd5f00ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5ee7fc700 1 -- 172.21.15.19:0/1037732872 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647236157 0 0) 0x7fd5f00acf00 con 0x7fd5f00b1a90 2024-08-17T02:27:30.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5ee7fc700 1 -- 172.21.15.19:0/1037732872 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5dc003570 con 0x7fd5f00b1a90 2024-08-17T02:27:30.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5ef7fe700 1 -- 172.21.15.19:0/1037732872 >> v2:172.21.15.119:3300/0 conn(0x7fd5f00adfa0 msgr2=0x7fd5f00ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:30.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5ee7fc700 1 -- 172.21.15.19:0/1037732872 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2012926278 0 0) 0x7fd5dc003570 con 0x7fd5f00b1a90 2024-08-17T02:27:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5ef7fe700 1 --2- 172.21.15.19:0/1037732872 >> v2:172.21.15.119:3300/0 conn(0x7fd5f00adfa0 0x7fd5f00ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5ef7fe700 1 -- 172.21.15.19:0/1037732872 >> v1:172.21.15.19:6789/0 conn(0x7fd5f00b1a90 legacy=0x7fd5f00ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5ef7fe700 1 -- 172.21.15.19:0/1037732872 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f00ad7a0 con 0x7fd5f01613e0 2024-08-17T02:27:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5effff700 1 --2- 172.21.15.19:0/1037732872 >> v2:172.21.15.119:3300/0 conn(0x7fd5f00adfa0 0x7fd5f00ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.552+0000 7fd5ef7fe700 1 --2- 172.21.15.19:0/1037732872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f01613e0 0x7fd5f01617b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00ca600 tx=0x7fd5e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788152ef82d44b95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5ee7fc700 1 -- 172.21.15.19:0/1037732872 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80017f0 con 0x7fd5f01613e0 2024-08-17T02:27:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5ee7fc700 1 -- 172.21.15.19:0/1037732872 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e0011420 con 0x7fd5f01613e0 2024-08-17T02:27:30.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5ee7fc700 1 -- 172.21.15.19:0/1037732872 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00117c0 con 0x7fd5f01613e0 2024-08-17T02:27:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1037732872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f01613e0 msgr2=0x7fd5f01617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5f4fdc700 1 --2- 172.21.15.19:0/1037732872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f01613e0 0x7fd5f01617b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00ca600 tx=0x7fd5e00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1037732872 shutdown_connections 2024-08-17T02:27:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5f4fdc700 1 --2- 172.21.15.19:0/1037732872 >> v2:172.21.15.119:3300/0 conn(0x7fd5f00adfa0 0x7fd5f00ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5f4fdc700 1 --2- 172.21.15.19:0/1037732872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f01613e0 0x7fd5f01617b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1037732872 >> 172.21.15.19:0/1037732872 conn(0x7fd5f00c9840 msgr2=0x7fd5f00c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1037732872 shutdown_connections 2024-08-17T02:27:30.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.556+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1037732872 wait complete. 2024-08-17T02:27:30.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5f4fdc700 1 Processor -- start 2024-08-17T02:27:30.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5f4fdc700 1 -- start start 2024-08-17T02:27:30.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5f4fdc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5f00adfa0 0x7fd5f00a7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5f4fdc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f00b1a90 0x7fd5f00a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5f4fdc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5f01613e0 0x7fd5f00a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5f4fdc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00a6840 con 0x7fd5f00b1a90 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5f4fdc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0069610 con 0x7fd5f00adfa0 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5f4fdc700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0068ce0 con 0x7fd5f01613e0 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5eeffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f00b1a90 0x7fd5f00a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5eeffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f00b1a90 0x7fd5f00a9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60008/0 (socket says 172.21.15.19:60008) 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5eeffd700 1 -- 172.21.15.19:0/1789114178 learned_addr learned my addr 172.21.15.19:0/1789114178 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5effff700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5f01613e0 0x7fd5f00a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.560+0000 7fd5ef7fe700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5f00adfa0 0x7fd5f00a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5eeffd700 1 -- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5f01613e0 msgr2=0x7fd5f00a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5eeffd700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5f01613e0 0x7fd5f00a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5eeffd700 1 -- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5f00adfa0 msgr2=0x7fd5f00a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5eeffd700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5f00adfa0 0x7fd5f00a7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5eeffd700 1 -- 172.21.15.19:0/1789114178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e8009420 con 0x7fd5f00b1a90 2024-08-17T02:27:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5eeffd700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f00b1a90 0x7fd5f00a9540 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800ccd0 tx=0x7fd5d80016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5e77fe700 1 -- 172.21.15.19:0/1789114178 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8004dc0 con 0x7fd5f00b1a90 2024-08-17T02:27:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5e77fe700 1 -- 172.21.15.19:0/1789114178 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d800a770 con 0x7fd5f00b1a90 2024-08-17T02:27:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e0009420 con 0x7fd5f00b1a90 2024-08-17T02:27:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5e77fe700 1 -- 172.21.15.19:0/1789114178 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800ab30 con 0x7fd5f00b1a90 2024-08-17T02:27:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f00692a0 con 0x7fd5f00b1a90 2024-08-17T02:27:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f00638f0 con 0x7fd5f00b1a90 2024-08-17T02:27:30.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.564+0000 7fd5e77fe700 1 -- 172.21.15.19:0/1789114178 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd5d8007150 con 0x7fd5f00b1a90 2024-08-17T02:27:30.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.568+0000 7fd5e77fe700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd5d0060860 0x7fd5d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.568+0000 7fd5e77fe700 1 -- 172.21.15.19:0/1789114178 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd5d807cad0 con 0x7fd5f00b1a90 2024-08-17T02:27:30.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.568+0000 7fd5ef7fe700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd5d0060860 0x7fd5d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.568+0000 7fd5ef7fe700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd5d0060860 0x7fd5d0062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00ca600 tx=0x7fd5e0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.576+0000 7fd5e77fe700 1 -- 172.21.15.19:0/1789114178 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd5d804cce0 con 0x7fd5f00b1a90 2024-08-17T02:27:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.760+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5f0068e50 con 0x7fd5d0060860 2024-08-17T02:27:30.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.764+0000 7fd5e77fe700 1 -- 172.21.15.19:0/1789114178 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7fd5f0068e50 con 0x7fd5d0060860 2024-08-17T02:27:30.768 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-08-17T02:27:30.768 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:30.769 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephfs" 2024-08-17T02:27:30.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-08-17T02:27:30.769 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-08-17T02:27:30.769 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volume_0000000000446940" 2024-08-17T02:27:30.769 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-08-17T02:27:30.769 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-08-17T02:27:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd5d0060860 msgr2=0x7fd5d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd5d0060860 0x7fd5d0062d10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00ca600 tx=0x7fd5e0016000 comp rx=0 tx=0).stop 2024-08-17T02:27:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f00b1a90 msgr2=0x7fd5f00a9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f00b1a90 0x7fd5f00a9540 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800ccd0 tx=0x7fd5d80016f0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 shutdown_connections 2024-08-17T02:27:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd5d0060860 0x7fd5d0062d10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd5f01613e0 0x7fd5f00a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5f00b1a90 0x7fd5f00a9540 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 --2- 172.21.15.19:0/1789114178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd5f00adfa0 0x7fd5f00a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 >> 172.21.15.19:0/1789114178 conn(0x7fd5f00c9840 msgr2=0x7fd5f015d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 shutdown_connections 2024-08-17T02:27:30.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.768+0000 7fd5f4fdc700 1 -- 172.21.15.19:0/1789114178 wait complete. 2024-08-17T02:27:30.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:27:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.892+0000 7f590878e700 1 Processor -- start 2024-08-17T02:27:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.892+0000 7f590878e700 1 -- start start 2024-08-17T02:27:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.892+0000 7f590878e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59001596d0 0x7f5900066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.892+0000 7f590878e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59000cba90 con 0x7f5900159300 2024-08-17T02:27:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.892+0000 7f590878e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59000cb160 con 0x7f590015dbc0 2024-08-17T02:27:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.892+0000 7f590878e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59000b2b60 con 0x7f59001596d0 2024-08-17T02:27:30.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.892+0000 7f590652a700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5900159300 0x7f59000b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33940/0 (socket says 172.21.15.19:33940) 2024-08-17T02:27:30.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.892+0000 7f590652a700 1 -- 172.21.15.19:0/543717199 learned_addr learned my addr 172.21.15.19:0/543717199 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:30.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.892+0000 7f5905d29700 1 --2- 172.21.15.19:0/543717199 >> v2:172.21.15.19:3300/0 conn(0x7f59001596d0 0x7f5900066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f5905528700 1 -- 172.21.15.19:0/543717199 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451756649 0 0) 0x7f59000cba90 con 0x7f5900159300 2024-08-17T02:27:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f5905528700 1 -- 172.21.15.19:0/543717199 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ec003570 con 0x7f5900159300 2024-08-17T02:27:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f5905d29700 1 -- 172.21.15.19:0/543717199 >> v1:172.21.15.119:6789/0 conn(0x7f590015dbc0 legacy=0x7f59000cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f5905d29700 1 -- 172.21.15.19:0/543717199 >> v1:172.21.15.19:6789/0 conn(0x7f5900159300 legacy=0x7f59000b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f5905d29700 1 -- 172.21.15.19:0/543717199 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59000cb440 con 0x7f59001596d0 2024-08-17T02:27:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f5905d29700 1 --2- 172.21.15.19:0/543717199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 0x7f5900066e00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58f00098e0 tx=0x7f58f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c161b8b4eab114 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f5905528700 1 -- 172.21.15.19:0/543717199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000b640 con 0x7f59001596d0 2024-08-17T02:27:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f5905528700 1 -- 172.21.15.19:0/543717199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f000b7a0 con 0x7f59001596d0 2024-08-17T02:27:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f5905528700 1 -- 172.21.15.19:0/543717199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000bb40 con 0x7f59001596d0 2024-08-17T02:27:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f590878e700 1 -- 172.21.15.19:0/543717199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 msgr2=0x7f5900066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f590878e700 1 --2- 172.21.15.19:0/543717199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 0x7f5900066e00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58f00098e0 tx=0x7f58f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f590878e700 1 -- 172.21.15.19:0/543717199 shutdown_connections 2024-08-17T02:27:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f590878e700 1 --2- 172.21.15.19:0/543717199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 0x7f5900066e00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f590878e700 1 -- 172.21.15.19:0/543717199 >> 172.21.15.19:0/543717199 conn(0x7f59000682c0 msgr2=0x7f59000686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f590878e700 1 -- 172.21.15.19:0/543717199 shutdown_connections 2024-08-17T02:27:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f590878e700 1 -- 172.21.15.19:0/543717199 wait complete. 2024-08-17T02:27:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f590878e700 1 Processor -- start 2024-08-17T02:27:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.896+0000 7f590878e700 1 -- start start 2024-08-17T02:27:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590878e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5900159300 0x7f590016d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590878e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 0x7f590014cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590878e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f590015dbc0 0x7f590014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590878e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59000c9710 con 0x7f59001596d0 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590878e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590016deb0 con 0x7f590015dbc0 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590878e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59000c8b00 con 0x7f5900159300 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5905d29700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 0x7f590014cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5906d2b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f590015dbc0 0x7f590014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590652a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5900159300 0x7f590016d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5906d2b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f590015dbc0 0x7f590014d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:60382/0 (socket says 172.21.15.19:60382) 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590652a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5900159300 0x7f590016d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:58694/0 (socket says 172.21.15.19:58694) 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5906d2b700 1 -- 172.21.15.19:0/3816771600 learned_addr learned my addr 172.21.15.19:0/3816771600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5905d29700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 0x7f590014cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60038/0 (socket says 172.21.15.19:60038) 2024-08-17T02:27:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5905d29700 1 -- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5900159300 msgr2=0x7f590016d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5905d29700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5900159300 0x7f590016d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5905d29700 1 -- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f590015dbc0 msgr2=0x7f590014d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5905d29700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f590015dbc0 0x7f590014d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5905d29700 1 -- 172.21.15.19:0/3816771600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f0009420 con 0x7f59001596d0 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5906d2b700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f590015dbc0 0x7f590014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590652a700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5900159300 0x7f590016d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f5905d29700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 0x7f590014cf80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5900089460 tx=0x7f58f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f58f67fc700 1 -- 172.21.15.19:0/3816771600 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000bb20 con 0x7f59001596d0 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f58f67fc700 1 -- 172.21.15.19:0/3816771600 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f0000c90 con 0x7f59001596d0 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59000c8de0 con 0x7f59001596d0 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f58f67fc700 1 -- 172.21.15.19:0/3816771600 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f0011650 con 0x7f59001596d0 2024-08-17T02:27:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.900+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59000c93a0 con 0x7f59001596d0 2024-08-17T02:27:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.904+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59000c98c0 con 0x7f59001596d0 2024-08-17T02:27:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.904+0000 7f58f67fc700 1 -- 172.21.15.19:0/3816771600 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f58f0011a00 con 0x7f59001596d0 2024-08-17T02:27:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.904+0000 7f58f67fc700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f58e4060860 0x7f58e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.904+0000 7f58f67fc700 1 -- 172.21.15.19:0/3816771600 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f58f007e4f0 con 0x7f59001596d0 2024-08-17T02:27:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.904+0000 7f590652a700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f58e4060860 0x7f58e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.904+0000 7f590652a700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f58e4060860 0x7f58e4062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58fc007fd0 tx=0x7f58fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:30.908+0000 7f58f67fc700 1 -- 172.21.15.19:0/3816771600 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f59000c98c0 con 0x7f59001596d0 2024-08-17T02:27:31.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f59000c98c0 con 0x7f59001596d0 2024-08-17T02:27:31.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f58f67fc700 1 -- 172.21.15.19:0/3816771600 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f59000c98c0 con 0x7f59001596d0 2024-08-17T02:27:31.075 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:31.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f58e4060860 msgr2=0x7f58e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f58e4060860 0x7f58e4062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58fc007fd0 tx=0x7f58fc009040 comp rx=0 tx=0).stop 2024-08-17T02:27:31.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 msgr2=0x7f590014cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 0x7f590014cf80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5900089460 tx=0x7f58f0017000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 shutdown_connections 2024-08-17T02:27:31.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f58e4060860 0x7f58e4062d10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f590015dbc0 0x7f590014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59001596d0 0x7f590014cf80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 --2- 172.21.15.19:0/3816771600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5900159300 0x7f590016d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.072+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 >> 172.21.15.19:0/3816771600 conn(0x7f59000682c0 msgr2=0x7f59000cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.076+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 shutdown_connections 2024-08-17T02:27:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.076+0000 7f590878e700 1 -- 172.21.15.19:0/3816771600 wait complete. 2024-08-17T02:27:31.090 INFO:teuthology.orchestra.run.smithi019.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:11.122666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:11.570819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000446940.meta","create_time":"2024-08-17T02:27:28.354322+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000446940"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000446940.data","create_time":"2024-08-17T02:27:28.449086+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000446940"}}}] 2024-08-17T02:27:31.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000446940 --format=json 2024-08-17T02:27:31.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3397a0700 1 Processor -- start 2024-08-17T02:27:31.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3397a0700 1 -- start start 2024-08-17T02:27:31.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3397a0700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe334154900 0x7fe3340b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3397a0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe3340b12d0 0x7fe3340cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3397a0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3340cbaa0 con 0x7fe3340cb390 2024-08-17T02:27:31.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3397a0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe334068790 con 0x7fe3340b12d0 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3397a0700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341583f0 con 0x7fe334154900 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3337fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe3340b12d0 0x7fe3340cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3337fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe3340b12d0 0x7fe3340cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60042/0 (socket says 172.21.15.19:60042) 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3337fe700 1 -- 172.21.15.19:0/106595336 learned_addr learned my addr 172.21.15.19:0/106595336 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe338f9f700 1 --1- 172.21.15.19:0/106595336 >> v1:172.21.15.19:6789/0 conn(0x7fe3340cb390 0x7fe33406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33956/0 (socket says 172.21.15.19:33956) 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe333fff700 1 --2- 172.21.15.19:0/106595336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe334154900 0x7fe3340b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3337fe700 1 -- 172.21.15.19:0/106595336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe334154900 msgr2=0x7fe3340b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3337fe700 1 --2- 172.21.15.19:0/106595336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe334154900 0x7fe3340b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3337fe700 1 -- 172.21.15.19:0/106595336 >> v1:172.21.15.19:6789/0 conn(0x7fe3340cb390 legacy=0x7fe33406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe332ffd700 1 -- 172.21.15.19:0/106595336 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888871990 0 0) 0x7fe3340cbaa0 con 0x7fe3340cb390 2024-08-17T02:27:31.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3337fe700 1 -- 172.21.15.19:0/106595336 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340b1700 con 0x7fe3340b12d0 2024-08-17T02:27:31.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe3337fe700 1 --2- 172.21.15.19:0/106595336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3340b12d0 0x7fe3340cae50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0099b0 tx=0x7fe31c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796daa6f37ec1788 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe332ffd700 1 -- 172.21.15.19:0/106595336 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00b860 con 0x7fe3340b12d0 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe332ffd700 1 -- 172.21.15.19:0/106595336 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c00b9c0 con 0x7fe3340b12d0 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.200+0000 7fe332ffd700 1 -- 172.21.15.19:0/106595336 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00bd60 con 0x7fe3340b12d0 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 -- 172.21.15.19:0/106595336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3340b12d0 msgr2=0x7fe3340cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 --2- 172.21.15.19:0/106595336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3340b12d0 0x7fe3340cae50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0099b0 tx=0x7fe31c009250 comp rx=0 tx=0).stop 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 -- 172.21.15.19:0/106595336 shutdown_connections 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 --2- 172.21.15.19:0/106595336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3340b12d0 0x7fe3340cae50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 --2- 172.21.15.19:0/106595336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe334154900 0x7fe3340b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 -- 172.21.15.19:0/106595336 >> 172.21.15.19:0/106595336 conn(0x7fe3340678d0 msgr2=0x7fe334067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 -- 172.21.15.19:0/106595336 shutdown_connections 2024-08-17T02:27:31.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 -- 172.21.15.19:0/106595336 wait complete. 2024-08-17T02:27:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 Processor -- start 2024-08-17T02:27:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.204+0000 7fe3397a0700 1 -- start start 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3397a0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3340b12d0 0x7fe3340a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3397a0700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3340cb390 0x7fe334142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3397a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334154900 0x7fe334155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3397a0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334168450 con 0x7fe334154900 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3397a0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340a5eb0 con 0x7fe3340b12d0 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3397a0700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340a5580 con 0x7fe3340cb390 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe338f9f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334154900 0x7fe334155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe338f9f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334154900 0x7fe334155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60056/0 (socket says 172.21.15.19:60056) 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe338f9f700 1 -- 172.21.15.19:0/38452332 learned_addr learned my addr 172.21.15.19:0/38452332 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3337fe700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3340cb390 0x7fe334142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe333fff700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3340b12d0 0x7fe3340a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3337fe700 1 -- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3340b12d0 msgr2=0x7fe3340a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3337fe700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3340b12d0 0x7fe3340a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3337fe700 1 -- 172.21.15.19:0/38452332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334154900 msgr2=0x7fe334155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3337fe700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334154900 0x7fe334155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3337fe700 1 -- 172.21.15.19:0/38452332 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0094f0 con 0x7fe3340cb390 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe338f9f700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334154900 0x7fe334155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3337fe700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3340cb390 0x7fe334142060 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe334070340 tx=0x7fe31c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe32bfff700 1 -- 172.21.15.19:0/38452332 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c011d30 con 0x7fe3340cb390 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe32bfff700 1 -- 172.21.15.19:0/38452332 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c024440 con 0x7fe3340cb390 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3340a5860 con 0x7fe3340cb390 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe32bfff700 1 -- 172.21.15.19:0/38452332 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c024800 con 0x7fe3340cb390 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3341425a0 con 0x7fe3340cb390 2024-08-17T02:27:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.208+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3340643a0 con 0x7fe3340cb390 2024-08-17T02:27:31.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.212+0000 7fe32bfff700 1 -- 172.21.15.19:0/38452332 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe31c01a420 con 0x7fe3340cb390 2024-08-17T02:27:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.212+0000 7fe32bfff700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe314060860 0x7fe314062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.212+0000 7fe32bfff700 1 -- 172.21.15.19:0/38452332 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe31c07ed50 con 0x7fe3340cb390 2024-08-17T02:27:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.212+0000 7fe333fff700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe314060860 0x7fe314062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.212+0000 7fe333fff700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe314060860 0x7fe314062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe324006fd0 tx=0x7fe324008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.224+0000 7fe32bfff700 1 -- 172.21.15.19:0/38452332 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe31c082030 con 0x7fe3340cb390 2024-08-17T02:27:31.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.436+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000446940", "format": "json"} v 0) v1 -- 0x7fe33406f5f0 con 0x7fe3340cb390 2024-08-17T02:27:31.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.436+0000 7fe32bfff700 1 -- 172.21.15.19:0/38452332 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000446940", "format": "json"}]=0 v17) v1 ==== 110+0+1850 (secure 0 0 0) 0x7fe31c04eee0 con 0x7fe3340cb390 2024-08-17T02:27:31.440 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:27:31.440 INFO:teuthology.orchestra.run.smithi019.stdout:{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:29.433713+0000","modified":"2024-08-17T02:27:31.418434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34643":{"gid":34643,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":8,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000446940","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe314060860 msgr2=0x7fe314062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe314060860 0x7fe314062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe324006fd0 tx=0x7fe324008040 comp rx=0 tx=0).stop 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3340cb390 msgr2=0x7fe334142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3340cb390 0x7fe334142060 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe334070340 tx=0x7fe31c017000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 shutdown_connections 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe314060860 0x7fe314062d10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe334154900 0x7fe334155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3340cb390 0x7fe334142060 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 --2- 172.21.15.19:0/38452332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3340b12d0 0x7fe3340a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 >> 172.21.15.19:0/38452332 conn(0x7fe3340678d0 msgr2=0x7fe334153860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 shutdown_connections 2024-08-17T02:27:31.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.440+0000 7fe3397a0700 1 -- 172.21.15.19:0/38452332 wait complete. 2024-08-17T02:27:31.454 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000446940 --yes-i-really-mean-it 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.560+0000 7ff7a0639700 1 Processor -- start 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.560+0000 7ff7a0639700 1 -- start start 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff7a0639700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 0x7ff7980ae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff7a0639700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff798068db0 0x7ff7980b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff7a0639700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79806ed10 con 0x7ff79815a8d0 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff7a0639700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980b1dc0 con 0x7ff798068db0 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff7a0639700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79806ea30 con 0x7ff79815a500 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79dbd4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff79815a8d0 0x7ff7980686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33964/0 (socket says 172.21.15.19:33964) 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79dbd4700 1 -- 172.21.15.19:0/3606776951 learned_addr learned my addr 172.21.15.19:0/3606776951 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79e3d5700 1 --2- 172.21.15.19:0/3606776951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 0x7ff7980ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79ebd6700 1 --2- 172.21.15.19:0/3606776951 >> v2:172.21.15.119:3300/0 conn(0x7ff798068db0 0x7ff7980b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79d3d3700 1 -- 172.21.15.19:0/3606776951 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90062240 0 0) 0x7ff79806ed10 con 0x7ff79815a8d0 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79d3d3700 1 -- 172.21.15.19:0/3606776951 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff784003570 con 0x7ff79815a8d0 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79e3d5700 1 -- 172.21.15.19:0/3606776951 >> v2:172.21.15.119:3300/0 conn(0x7ff798068db0 msgr2=0x7ff7980b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79e3d5700 1 --2- 172.21.15.19:0/3606776951 >> v2:172.21.15.119:3300/0 conn(0x7ff798068db0 0x7ff7980b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79e3d5700 1 -- 172.21.15.19:0/3606776951 >> v1:172.21.15.19:6789/0 conn(0x7ff79815a8d0 legacy=0x7ff7980686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79d3d3700 1 -- 172.21.15.19:0/3606776951 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303480325 0 0) 0x7ff784003570 con 0x7ff79815a8d0 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79e3d5700 1 -- 172.21.15.19:0/3606776951 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980b1770 con 0x7ff79815a500 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79e3d5700 1 --2- 172.21.15.19:0/3606776951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 0x7ff7980ae830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7940098e0 tx=0x7ff7940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1762ab3cc0261046 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79d3d3700 1 -- 172.21.15.19:0/3606776951 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788001470 con 0x7ff79815a500 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79d3d3700 1 -- 172.21.15.19:0/3606776951 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794011420 con 0x7ff79815a500 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff79d3d3700 1 -- 172.21.15.19:0/3606776951 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7940117c0 con 0x7ff79815a500 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.564+0000 7ff7a0639700 1 -- 172.21.15.19:0/3606776951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 msgr2=0x7ff7980ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.568+0000 7ff7a0639700 1 --2- 172.21.15.19:0/3606776951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 0x7ff7980ae830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7940098e0 tx=0x7ff7940091a0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.568+0000 7ff7a0639700 1 -- 172.21.15.19:0/3606776951 shutdown_connections 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.568+0000 7ff7a0639700 1 --2- 172.21.15.19:0/3606776951 >> v2:172.21.15.119:3300/0 conn(0x7ff798068db0 0x7ff7980b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.568+0000 7ff7a0639700 1 --2- 172.21.15.19:0/3606776951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 0x7ff7980ae830 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.568+0000 7ff7a0639700 1 -- 172.21.15.19:0/3606776951 >> 172.21.15.19:0/3606776951 conn(0x7ff7980c9bf0 msgr2=0x7ff79806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.568+0000 7ff7a0639700 1 -- 172.21.15.19:0/3606776951 shutdown_connections 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.568+0000 7ff7a0639700 1 -- 172.21.15.19:0/3606776951 wait complete. 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.568+0000 7ff7a0639700 1 Processor -- start 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.568+0000 7ff7a0639700 1 -- start start 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff7a0639700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff798068db0 0x7ff798169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff7a0639700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 0x7ff7980c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff7a0639700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff79815a8d0 0x7ff7980caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff7a0639700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980ad920 con 0x7ff798068db0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff7a0639700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980cbeb0 con 0x7ff79815a8d0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff7a0639700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7981699d0 con 0x7ff79815a500 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79e3d5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff798068db0 0x7ff798169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79e3d5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff798068db0 0x7ff798169490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60072/0 (socket says 172.21.15.19:60072) 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79e3d5700 1 -- 172.21.15.19:0/2320618846 learned_addr learned my addr 172.21.15.19:0/2320618846 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79dbd4700 1 --2- 172.21.15.19:0/2320618846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 0x7ff7980c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79ebd6700 1 --2- 172.21.15.19:0/2320618846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff79815a8d0 0x7ff7980caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79e3d5700 1 -- 172.21.15.19:0/2320618846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 msgr2=0x7ff7980c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79e3d5700 1 --2- 172.21.15.19:0/2320618846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff79815a500 0x7ff7980c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79e3d5700 1 -- 172.21.15.19:0/2320618846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff79815a8d0 msgr2=0x7ff7980caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79e3d5700 1 --2- 172.21.15.19:0/2320618846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff79815a8d0 0x7ff7980caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79e3d5700 1 -- 172.21.15.19:0/2320618846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009420 con 0x7ff798068db0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff79e3d5700 1 --2- 172.21.15.19:0/2320618846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff798068db0 0x7ff798169490 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff7980710e0 tx=0x7ff794016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff78e7fc700 1 -- 172.21.15.19:0/2320618846 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79401cd10 con 0x7ff798068db0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff78e7fc700 1 -- 172.21.15.19:0/2320618846 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79401ce70 con 0x7ff798068db0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff7a0639700 1 -- 172.21.15.19:0/2320618846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7980acd10 con 0x7ff798068db0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff78e7fc700 1 -- 172.21.15.19:0/2320618846 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79401a660 con 0x7ff798068db0 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.572+0000 7ff7a0639700 1 -- 172.21.15.19:0/2320618846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7980ad2d0 con 0x7ff798068db0 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.576+0000 7ff7a0639700 1 -- 172.21.15.19:0/2320618846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7980645c0 con 0x7ff798068db0 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.576+0000 7ff78e7fc700 1 -- 172.21.15.19:0/2320618846 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff79401aa50 con 0x7ff798068db0 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.576+0000 7ff78e7fc700 1 --2- 172.21.15.19:0/2320618846 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff77c060860 0x7ff77c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.576+0000 7ff78e7fc700 1 -- 172.21.15.19:0/2320618846 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff79407ea60 con 0x7ff798068db0 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.576+0000 7ff79dbd4700 1 --2- 172.21.15.19:0/2320618846 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff77c060860 0x7ff77c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.576+0000 7ff79dbd4700 1 --2- 172.21.15.19:0/2320618846 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff77c060860 0x7ff77c062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff7980ac020 tx=0x7ff788001a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.588+0000 7ff78e7fc700 1 -- 172.21.15.19:0/2320618846 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff79404ea90 con 0x7ff798068db0 2024-08-17T02:27:31.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:27:31.768+0000 7ff7a0639700 1 -- 172.21.15.19:0/2320618846 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000446940", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7980aedf0 con 0x7ff77c060860 2024-08-17T02:27:56.586 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:56.590 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:26.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:26.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:56.706 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:56.709 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:26.761 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:26.764 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:31.471 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:29:31.472 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:29:31.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:31.490 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:31.511 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:29:31.511 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-08-17T02:29:31.512 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:29:31.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:29:31.527 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[33335]: fuse finished with error 0 and tester_r 0 2024-08-17T02:29:31.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:29:31.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:31.529 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:29:31.655 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-08-17T02:29:31.656 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:29:31.656 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:29:31.671 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:ceph-fuse[30601]: fuse finished with error 0 and tester_r 0 2024-08-17T02:29:31.672 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:29:31.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:31.673 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:29:31.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:29:31.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:31.796 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:29:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-08-17T02:29:31.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:31.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:29:31.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:31.804 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-08-17T02:29:31.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:31.844 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.955+0000 7fa0ebfff700 1 Processor -- start 2024-08-17T02:29:31.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.955+0000 7fa0ebfff700 1 -- start start 2024-08-17T02:29:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.955+0000 7fa0ebfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa0ec0b14a0 0x7fa0ec0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.955+0000 7fa0ebfff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ec0cbaa0 con 0x7fa0ec154900 2024-08-17T02:29:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.955+0000 7fa0ebfff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ec157630 con 0x7fa0ec0cb390 2024-08-17T02:29:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.955+0000 7fa0ebfff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ec068790 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.955+0000 7fa0ea7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa0ec0b14a0 0x7fa0ec0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.955+0000 7fa0eaffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa0ec154900 0x7fa0ec0b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59086/0 (socket says 172.21.15.19:59086) 2024-08-17T02:29:31.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.955+0000 7fa0eaffd700 1 -- 172.21.15.19:0/388653990 learned_addr learned my addr 172.21.15.19:0/388653990 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ea7fc700 1 -- 172.21.15.19:0/388653990 >> v1:172.21.15.119:6789/0 conn(0x7fa0ec0cb390 legacy=0x7fa0ec160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ea7fc700 1 -- 172.21.15.19:0/388653990 >> v1:172.21.15.19:6789/0 conn(0x7fa0ec154900 legacy=0x7fa0ec0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ea7fc700 1 -- 172.21.15.19:0/388653990 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec157910 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ea7fc700 1 --2- 172.21.15.19:0/388653990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 0x7fa0ec0cae50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0098e0 tx=0x7fa0dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc3b5f6a0b219b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0e9ffb700 1 -- 172.21.15.19:0/388653990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc009e80 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0e9ffb700 1 -- 172.21.15.19:0/388653990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc00b860 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0e9ffb700 1 -- 172.21.15.19:0/388653990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc00bbe0 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ebfff700 1 -- 172.21.15.19:0/388653990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 msgr2=0x7fa0ec0cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ebfff700 1 --2- 172.21.15.19:0/388653990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 0x7fa0ec0cae50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0098e0 tx=0x7fa0dc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ebfff700 1 -- 172.21.15.19:0/388653990 shutdown_connections 2024-08-17T02:29:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ebfff700 1 --2- 172.21.15.19:0/388653990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 0x7fa0ec0cae50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ebfff700 1 -- 172.21.15.19:0/388653990 >> 172.21.15.19:0/388653990 conn(0x7fa0ec0678d0 msgr2=0x7fa0ec067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ebfff700 1 -- 172.21.15.19:0/388653990 shutdown_connections 2024-08-17T02:29:31.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ebfff700 1 -- 172.21.15.19:0/388653990 wait complete. 2024-08-17T02:29:31.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ebfff700 1 Processor -- start 2024-08-17T02:29:31.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.959+0000 7fa0ebfff700 1 -- start start 2024-08-17T02:29:31.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ebfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 0x7fa0ec142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ebfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0ec0cb390 0x7fa0ec069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ebfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0ec154900 0x7fa0ec06a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ebfff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0a6420 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ebfff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec167320 con 0x7fa0ec154900 2024-08-17T02:29:31.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ebfff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec1427d0 con 0x7fa0ec0cb390 2024-08-17T02:29:31.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eaffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 0x7fa0ec142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eaffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 0x7fa0ec142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52814/0 (socket says 172.21.15.19:52814) 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eaffd700 1 -- 172.21.15.19:0/1102659920 learned_addr learned my addr 172.21.15.19:0/1102659920 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eb7fe700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0ec154900 0x7fa0ec06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ea7fc700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0ec0cb390 0x7fa0ec069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eaffd700 1 -- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0ec0cb390 msgr2=0x7fa0ec069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eaffd700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0ec0cb390 0x7fa0ec069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eaffd700 1 -- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0ec154900 msgr2=0x7fa0ec06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eaffd700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0ec154900 0x7fa0ec06a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eaffd700 1 -- 172.21.15.19:0/1102659920 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc009420 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ea7fc700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0ec0cb390 0x7fa0ec069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eb7fe700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0ec154900 0x7fa0ec06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0eaffd700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 0x7fa0ec142290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400c7c0 tx=0x7fa0d4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0e2ffd700 1 -- 172.21.15.19:0/1102659920 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4005b30 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0e2ffd700 1 -- 172.21.15.19:0/1102659920 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d4005cb0 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec0a7a60 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0e2ffd700 1 -- 172.21.15.19:0/1102659920 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4004a80 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.963+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ec0a7410 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.967+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ec0643a0 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.967+0000 7fa0e2ffd700 1 -- 172.21.15.19:0/1102659920 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa0d40070d0 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.967+0000 7fa0e2ffd700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa0cc060860 0x7fa0cc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.967+0000 7fa0e2ffd700 1 -- 172.21.15.19:0/1102659920 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa0d407c350 con 0x7fa0ec0b14a0 2024-08-17T02:29:31.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.967+0000 7fa0ea7fc700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa0cc060860 0x7fa0cc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.967+0000 7fa0ea7fc700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa0cc060860 0x7fa0cc062d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0b18a0 tx=0x7fa0dc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:31.975+0000 7fa0e2ffd700 1 -- 172.21.15.19:0/1102659920 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa0d404a480 con 0x7fa0ec0b14a0 2024-08-17T02:29:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.175+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0ec06f5f0 con 0x7fa0ec0b14a0 2024-08-17T02:29:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0e2ffd700 1 -- 172.21.15.19:0/1102659920 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5694 (secure 0 0 0) 0x7fa0d404c420 con 0x7fa0ec0b14a0 2024-08-17T02:29:32.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:32.182 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:12.591455+0000","modified":"2024-08-17T02:27:15.252576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34649":{"gid":34649,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/363347157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":363347157},{"type":"v1","addr":"172.21.15.19:6835","nonce":363347157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:29.433713+0000","modified":"2024-08-17T02:27:31.418434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34643":{"gid":34643,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":8,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000446940","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa0cc060860 msgr2=0x7fa0cc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa0cc060860 0x7fa0cc062d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0b18a0 tx=0x7fa0dc017000 comp rx=0 tx=0).stop 2024-08-17T02:29:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 msgr2=0x7fa0ec142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 0x7fa0ec142290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400c7c0 tx=0x7fa0d4007f70 comp rx=0 tx=0).stop 2024-08-17T02:29:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 shutdown_connections 2024-08-17T02:29:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa0cc060860 0x7fa0cc062d10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0ec154900 0x7fa0ec06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0ec0cb390 0x7fa0ec069f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 --2- 172.21.15.19:0/1102659920 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0ec0b14a0 0x7fa0ec142290 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 >> 172.21.15.19:0/1102659920 conn(0x7fa0ec0678d0 msgr2=0x7fa0ec063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 shutdown_connections 2024-08-17T02:29:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.179+0000 7fa0ebfff700 1 -- 172.21.15.19:0/1102659920 wait complete. 2024-08-17T02:29:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 17 2024-08-17T02:29:32.198 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87198c2700 1 Processor -- start 2024-08-17T02:29:32.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87198c2700 1 -- start start 2024-08-17T02:29:32.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87198c2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871413e960 0x7f87141556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87198c2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8714156940 con 0x7f871406e140 2024-08-17T02:29:32.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87198c2700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8714155d30 con 0x7f871406e510 2024-08-17T02:29:32.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87198c2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8714156010 con 0x7f871413e960 2024-08-17T02:29:32.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87188c0700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f871406e140 0x7f87140b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59098/0 (socket says 172.21.15.19:59098) 2024-08-17T02:29:32.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87188c0700 1 -- 172.21.15.19:0/3549421167 learned_addr learned my addr 172.21.15.19:0/3549421167 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:32.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87190c1700 1 --2- 172.21.15.19:0/3549421167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871413e960 0x7f87141556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87137fe700 1 -- 172.21.15.19:0/3549421167 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894676169 0 0) 0x7f8714156940 con 0x7f871406e140 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87137fe700 1 -- 172.21.15.19:0/3549421167 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f4004680 con 0x7f871406e140 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87137fe700 1 -- 172.21.15.19:0/3549421167 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425294635 0 0) 0x7f8714155d30 con 0x7f871406e510 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87137fe700 1 -- 172.21.15.19:0/3549421167 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8714156940 con 0x7f871406e510 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87137fe700 1 -- 172.21.15.19:0/3549421167 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 391411238 0 0) 0x7f86f4004680 con 0x7f871406e140 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87190c1700 1 -- 172.21.15.19:0/3549421167 >> v1:172.21.15.119:6789/0 conn(0x7f871406e510 legacy=0x7f871413e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87190c1700 1 -- 172.21.15.19:0/3549421167 >> v1:172.21.15.19:6789/0 conn(0x7f871406e140 legacy=0x7f87140b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.303+0000 7f87190c1700 1 -- 172.21.15.19:0/3549421167 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87141562f0 con 0x7f871413e960 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87190c1700 1 --2- 172.21.15.19:0/3549421167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871413e960 0x7f87141556f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f870c007750 tx=0x7f870c00c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ca1ccfcf2ad13ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87137fe700 1 -- 172.21.15.19:0/3549421167 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704001470 con 0x7f871413e960 2024-08-17T02:29:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87137fe700 1 -- 172.21.15.19:0/3549421167 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c007bd0 con 0x7f871413e960 2024-08-17T02:29:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87137fe700 1 -- 172.21.15.19:0/3549421167 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00cb40 con 0x7f871413e960 2024-08-17T02:29:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 -- 172.21.15.19:0/3549421167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871413e960 msgr2=0x7f87141556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 --2- 172.21.15.19:0/3549421167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871413e960 0x7f87141556f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f870c007750 tx=0x7f870c00c3c0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 -- 172.21.15.19:0/3549421167 shutdown_connections 2024-08-17T02:29:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 --2- 172.21.15.19:0/3549421167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871413e960 0x7f87141556f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 -- 172.21.15.19:0/3549421167 >> 172.21.15.19:0/3549421167 conn(0x7f87140678d0 msgr2=0x7f8714067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 -- 172.21.15.19:0/3549421167 shutdown_connections 2024-08-17T02:29:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 -- 172.21.15.19:0/3549421167 wait complete. 2024-08-17T02:29:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 Processor -- start 2024-08-17T02:29:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 -- start start 2024-08-17T02:29:32.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f871406e140 0x7f87140cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871406e510 0x7f87140c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871413e960 0x7f87140c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87140acb00 con 0x7f871406e140 2024-08-17T02:29:32.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87140acde0 con 0x7f871413e960 2024-08-17T02:29:32.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.307+0000 7f87198c2700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87140ad0c0 con 0x7f871406e510 2024-08-17T02:29:32.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87188c0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f871406e140 0x7f87140cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f8713fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871406e510 0x7f87140c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87188c0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f871406e140 0x7f87140cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52818/0 (socket says 172.21.15.19:52818) 2024-08-17T02:29:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87188c0700 1 -- 172.21.15.19:0/970798475 learned_addr learned my addr 172.21.15.19:0/970798475 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87190c1700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871413e960 0x7f87140c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87188c0700 1 -- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871406e510 msgr2=0x7f87140c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87188c0700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871406e510 0x7f87140c0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87188c0700 1 -- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871413e960 msgr2=0x7f87140c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87188c0700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871413e960 0x7f87140c0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87188c0700 1 -- 172.21.15.19:0/970798475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c007260 con 0x7f871406e140 2024-08-17T02:29:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87188c0700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f871406e140 0x7f87140cb3e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f870400cb60 tx=0x7f8704001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f8710ff9700 1 -- 172.21.15.19:0/970798475 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704007150 con 0x7f871406e140 2024-08-17T02:29:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f8710ff9700 1 -- 172.21.15.19:0/970798475 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87040072b0 con 0x7f871406e140 2024-08-17T02:29:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87140ad3a0 con 0x7f871406e140 2024-08-17T02:29:32.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f8710ff9700 1 -- 172.21.15.19:0/970798475 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704007670 con 0x7f871406e140 2024-08-17T02:29:32.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87140cb920 con 0x7f871406e140 2024-08-17T02:29:32.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87140643a0 con 0x7f871406e140 2024-08-17T02:29:32.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.311+0000 7f8710ff9700 1 -- 172.21.15.19:0/970798475 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8704004a40 con 0x7f871406e140 2024-08-17T02:29:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.315+0000 7f8710ff9700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f86f8060860 0x7f86f8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.315+0000 7f8710ff9700 1 -- 172.21.15.19:0/970798475 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f870407c500 con 0x7f871406e140 2024-08-17T02:29:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.315+0000 7f8713fff700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f86f8060860 0x7f86f8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.315+0000 7f8713fff700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f86f8060860 0x7f86f8062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f87140b09d0 tx=0x7f86fc007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.319+0000 7f8710ff9700 1 -- 172.21.15.19:0/970798475 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f870404c650 con 0x7f871406e140 2024-08-17T02:29:32.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.483+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f871406f5f0 con 0x7f871406e140 2024-08-17T02:29:32.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f8710ff9700 1 -- 172.21.15.19:0/970798475 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18599 (secure 0 0 0) 0x7f870404fc70 con 0x7f871406e140 2024-08-17T02:29:32.491 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:32.491 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":38,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:27:32.364602+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:11.122666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:11.570819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000446940.meta","create_time":"2024-08-17T02:27:28.354322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000446940"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000446940.data","create_time":"2024-08-17T02:27:28.449086+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000446940"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:32.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f86f8060860 msgr2=0x7f86f8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f86f8060860 0x7f86f8062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f87140b09d0 tx=0x7f86fc007d50 comp rx=0 tx=0).stop 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f871406e140 msgr2=0x7f87140cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f871406e140 0x7f87140cb3e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f870400cb60 tx=0x7f8704001ad0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 shutdown_connections 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f86f8060860 0x7f86f8062d10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f871413e960 0x7f87140c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f871406e510 0x7f87140c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 --2- 172.21.15.19:0/970798475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f871406e140 0x7f87140cb3e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 >> 172.21.15.19:0/970798475 conn(0x7f87140678d0 msgr2=0x7f8714156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 shutdown_connections 2024-08-17T02:29:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.487+0000 7f87198c2700 1 -- 172.21.15.19:0/970798475 wait complete. 2024-08-17T02:29:32.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:11.122666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:11.570819+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000446940.meta', 'create_time': '2024-08-17T02:27:28.354322+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000446940'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000446940.data', 'create_time': '2024-08-17T02:27:28.449086+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000446940'}}}] 2024-08-17T02:29:32.505 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:32.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.619+0000 7f69fbfff700 1 Processor -- start 2024-08-17T02:29:32.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.619+0000 7f69fbfff700 1 -- start start 2024-08-17T02:29:32.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.619+0000 7f69fbfff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f69fc0aeb00 0x7f69fc0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.619+0000 7f69fbfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69fc0c7400 0x7f69fc0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.619+0000 7f69fbfff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc0c8cd0 con 0x7f69fc15a0e0 2024-08-17T02:29:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.619+0000 7f69fbfff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc0c80c0 con 0x7f69fc0c7400 2024-08-17T02:29:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.619+0000 7f69fbfff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc0c83a0 con 0x7f69fc0aeb00 2024-08-17T02:29:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.619+0000 7f69fb7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69fc0c7400 0x7f69fc0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69faffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f69fc15a0e0 0x7f69fc0ae3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59112/0 (socket says 172.21.15.19:59112) 2024-08-17T02:29:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fb7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f69fc0c7400 0x7f69fc0c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52828/0 (socket says 172.21.15.19:52828) 2024-08-17T02:29:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69faffd700 1 -- 172.21.15.19:0/3907626254 learned_addr learned my addr 172.21.15.19:0/3907626254 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:32.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fa7fc700 1 --2- 172.21.15.19:0/3907626254 >> v2:172.21.15.119:3300/0 conn(0x7f69fc0aeb00 0x7f69fc0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fb7fe700 1 -- 172.21.15.19:0/3907626254 >> v2:172.21.15.119:3300/0 conn(0x7f69fc0aeb00 msgr2=0x7f69fc0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:32.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fb7fe700 1 --2- 172.21.15.19:0/3907626254 >> v2:172.21.15.119:3300/0 conn(0x7f69fc0aeb00 0x7f69fc0c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fb7fe700 1 -- 172.21.15.19:0/3907626254 >> v1:172.21.15.19:6789/0 conn(0x7f69fc15a0e0 legacy=0x7f69fc0ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fb7fe700 1 -- 172.21.15.19:0/3907626254 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0c8680 con 0x7f69fc0c7400 2024-08-17T02:29:32.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69f9ffb700 1 -- 172.21.15.19:0/3907626254 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896542469 0 0) 0x7f69fc0c8cd0 con 0x7f69fc15a0e0 2024-08-17T02:29:32.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fb7fe700 1 --2- 172.21.15.19:0/3907626254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc0c7400 0x7f69fc0c7800 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f69fc06f540 tx=0x7f69f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc931536e662a93b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69f9ffb700 1 -- 172.21.15.19:0/3907626254 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f400e070 con 0x7f69fc0c7400 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69f9ffb700 1 -- 172.21.15.19:0/3907626254 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f400bb60 con 0x7f69fc0c7400 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69f9ffb700 1 -- 172.21.15.19:0/3907626254 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4012430 con 0x7f69fc0c7400 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 -- 172.21.15.19:0/3907626254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc0c7400 msgr2=0x7f69fc0c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 --2- 172.21.15.19:0/3907626254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc0c7400 0x7f69fc0c7800 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f69fc06f540 tx=0x7f69f4009780 comp rx=0 tx=0).stop 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 -- 172.21.15.19:0/3907626254 shutdown_connections 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 --2- 172.21.15.19:0/3907626254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc0c7400 0x7f69fc0c7800 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 --2- 172.21.15.19:0/3907626254 >> v2:172.21.15.119:3300/0 conn(0x7f69fc0aeb00 0x7f69fc0c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 -- 172.21.15.19:0/3907626254 >> 172.21.15.19:0/3907626254 conn(0x7f69fc0c9830 msgr2=0x7f69fc0c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 -- 172.21.15.19:0/3907626254 shutdown_connections 2024-08-17T02:29:32.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 -- 172.21.15.19:0/3907626254 wait complete. 2024-08-17T02:29:32.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 Processor -- start 2024-08-17T02:29:32.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.623+0000 7f69fbfff700 1 -- start start 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69fc0aeb00 0x7f69fc15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fbfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69fc0c7400 0x7f69fc15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc15a0e0 0x7f69fc15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fbfff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc14b270 con 0x7f69fc15a0e0 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fbfff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc15be60 con 0x7f69fc0aeb00 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fbfff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc148300 con 0x7f69fc0c7400 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc15a0e0 0x7f69fc15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc15a0e0 0x7f69fc15a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52830/0 (socket says 172.21.15.19:52830) 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fb7fe700 1 -- 172.21.15.19:0/772626410 learned_addr learned my addr 172.21.15.19:0/772626410 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fa7fc700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69fc0c7400 0x7f69fc15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69faffd700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69fc0aeb00 0x7f69fc15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fb7fe700 1 -- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69fc0c7400 msgr2=0x7f69fc15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fb7fe700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69fc0c7400 0x7f69fc15a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fb7fe700 1 -- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69fc0aeb00 msgr2=0x7f69fc15b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fb7fe700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69fc0aeb00 0x7f69fc15b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fb7fe700 1 -- 172.21.15.19:0/772626410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009a20 con 0x7f69fc15a0e0 2024-08-17T02:29:32.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fb7fe700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc15a0e0 0x7f69fc15a9f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009fd0 tx=0x7f69f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69f2ffd700 1 -- 172.21.15.19:0/772626410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4027470 con 0x7f69fc15a0e0 2024-08-17T02:29:32.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69f2ffd700 1 -- 172.21.15.19:0/772626410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f40275f0 con 0x7f69fc15a0e0 2024-08-17T02:29:32.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc150ad0 con 0x7f69fc15a0e0 2024-08-17T02:29:32.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69f2ffd700 1 -- 172.21.15.19:0/772626410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f40279b0 con 0x7f69fc15a0e0 2024-08-17T02:29:32.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.627+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc151090 con 0x7f69fc15a0e0 2024-08-17T02:29:32.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.631+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc064330 con 0x7f69fc15a0e0 2024-08-17T02:29:32.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.631+0000 7f69f2ffd700 1 -- 172.21.15.19:0/772626410 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f69f4024070 con 0x7f69fc15a0e0 2024-08-17T02:29:32.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.631+0000 7f69f2ffd700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f69dc060860 0x7f69dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.631+0000 7f69f2ffd700 1 -- 172.21.15.19:0/772626410 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f69f407f8d0 con 0x7f69fc15a0e0 2024-08-17T02:29:32.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.631+0000 7f69faffd700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f69dc060860 0x7f69dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.631+0000 7f69faffd700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f69dc060860 0x7f69dc062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007160 tx=0x7f69e4007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.639+0000 7f69f2ffd700 1 -- 172.21.15.19:0/772626410 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f69f404f9a0 con 0x7f69fc15a0e0 2024-08-17T02:29:32.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.807+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69fc0c7870 con 0x7f69fc15a0e0 2024-08-17T02:29:32.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.807+0000 7f69f2ffd700 1 -- 172.21.15.19:0/772626410 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69f402c0a0 con 0x7f69fc15a0e0 2024-08-17T02:29:32.812 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:29:32.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f69dc060860 msgr2=0x7f69dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f69dc060860 0x7f69dc062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007160 tx=0x7f69e4007f50 comp rx=0 tx=0).stop 2024-08-17T02:29:32.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc15a0e0 msgr2=0x7f69fc15a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc15a0e0 0x7f69fc15a9f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009fd0 tx=0x7f69f4019000 comp rx=0 tx=0).stop 2024-08-17T02:29:32.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 shutdown_connections 2024-08-17T02:29:32.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f69dc060860 0x7f69dc062d10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69fc15a0e0 0x7f69fc15a9f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69fc0c7400 0x7f69fc15a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 --2- 172.21.15.19:0/772626410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69fc0aeb00 0x7f69fc15b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 >> 172.21.15.19:0/772626410 conn(0x7f69fc0c9830 msgr2=0x7f69fc06e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 shutdown_connections 2024-08-17T02:29:32.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.811+0000 7f69fbfff700 1 -- 172.21.15.19:0/772626410 wait complete. 2024-08-17T02:29:32.826 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:32.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdedf110700 1 Processor -- start 2024-08-17T02:29:32.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdedf110700 1 -- start start 2024-08-17T02:29:32.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdedf110700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 0x7fded80b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdedf110700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fded8067510 0x7fded80cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdedf110700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded80cba90 con 0x7fded81596d0 2024-08-17T02:29:32.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdedf110700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded80b2b60 con 0x7fded8067510 2024-08-17T02:29:32.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdedf110700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded80cb160 con 0x7fded8159300 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdecffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fded81596d0 0x7fded8066e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59122/0 (socket says 172.21.15.19:59122) 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdecffff700 1 -- 172.21.15.19:0/3997989208 learned_addr learned my addr 172.21.15.19:0/3997989208 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.935+0000 7fdedd6ad700 1 --2- 172.21.15.19:0/3997989208 >> v2:172.21.15.119:3300/0 conn(0x7fded8067510 0x7fded80cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedceac700 1 --2- 172.21.15.19:0/3997989208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 0x7fded80b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdecf7fe700 1 -- 172.21.15.19:0/3997989208 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722049102 0 0) 0x7fded80cba90 con 0x7fded81596d0 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdecf7fe700 1 -- 172.21.15.19:0/3997989208 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec0003570 con 0x7fded81596d0 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedd6ad700 1 -- 172.21.15.19:0/3997989208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 msgr2=0x7fded80b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedd6ad700 1 --2- 172.21.15.19:0/3997989208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 0x7fded80b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedd6ad700 1 -- 172.21.15.19:0/3997989208 >> v1:172.21.15.19:6789/0 conn(0x7fded81596d0 legacy=0x7fded8066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedd6ad700 1 -- 172.21.15.19:0/3997989208 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded80cb440 con 0x7fded8067510 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedceac700 1 --2- 172.21.15.19:0/3997989208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 0x7fded80b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:32.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedd6ad700 1 --2- 172.21.15.19:0/3997989208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 0x7fded80cbf20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fded0009e60 tx=0x7fded0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfdc86360e70255f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdecf7fe700 1 -- 172.21.15.19:0/3997989208 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000e070 con 0x7fded8067510 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdecf7fe700 1 -- 172.21.15.19:0/3997989208 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded000bab0 con 0x7fded8067510 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdecf7fe700 1 -- 172.21.15.19:0/3997989208 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000be70 con 0x7fded8067510 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 -- 172.21.15.19:0/3997989208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 msgr2=0x7fded80cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 --2- 172.21.15.19:0/3997989208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 0x7fded80cbf20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fded0009e60 tx=0x7fded0009780 comp rx=0 tx=0).stop 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 -- 172.21.15.19:0/3997989208 shutdown_connections 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 --2- 172.21.15.19:0/3997989208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 0x7fded80cbf20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 --2- 172.21.15.19:0/3997989208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 0x7fded80b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 -- 172.21.15.19:0/3997989208 >> 172.21.15.19:0/3997989208 conn(0x7fded80682c0 msgr2=0x7fded80686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 -- 172.21.15.19:0/3997989208 shutdown_connections 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 -- 172.21.15.19:0/3997989208 wait complete. 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 Processor -- start 2024-08-17T02:29:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.939+0000 7fdedf110700 1 -- start start 2024-08-17T02:29:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedf110700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 0x7fded80c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedf110700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 0x7fded8169bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedf110700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fded81596d0 0x7fded815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedf110700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded815a040 con 0x7fded81596d0 2024-08-17T02:29:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedf110700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded815a320 con 0x7fded8067510 2024-08-17T02:29:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedf110700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded815a600 con 0x7fded8159300 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedd6ad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fded81596d0 0x7fded815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedceac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 0x7fded80c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedd6ad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fded81596d0 0x7fded815b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52842/0 (socket says 172.21.15.19:52842) 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedd6ad700 1 -- 172.21.15.19:0/1284760316 learned_addr learned my addr 172.21.15.19:0/1284760316 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdecffff700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 0x7fded8169bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedceac700 1 -- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 msgr2=0x7fded8169bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedceac700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 0x7fded8169bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedceac700 1 -- 172.21.15.19:0/1284760316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fded81596d0 msgr2=0x7fded815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedceac700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fded81596d0 0x7fded815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedceac700 1 -- 172.21.15.19:0/1284760316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4009420 con 0x7fded8067510 2024-08-17T02:29:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedceac700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 0x7fded80c51a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fded400ec80 tx=0x7fded40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdeccff9700 1 -- 172.21.15.19:0/1284760316 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400c850 con 0x7fded8067510 2024-08-17T02:29:32.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdeccff9700 1 -- 172.21.15.19:0/1284760316 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded400c9b0 con 0x7fded8067510 2024-08-17T02:29:32.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdeccff9700 1 -- 172.21.15.19:0/1284760316 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400cd70 con 0x7fded8067510 2024-08-17T02:29:32.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded0009a20 con 0x7fded8067510 2024-08-17T02:29:32.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.943+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded815abc0 con 0x7fded8067510 2024-08-17T02:29:32.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.947+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded80645c0 con 0x7fded8067510 2024-08-17T02:29:32.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.947+0000 7fdeccff9700 1 -- 172.21.15.19:0/1284760316 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fded4013680 con 0x7fded8067510 2024-08-17T02:29:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.947+0000 7fdeccff9700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdec4060860 0x7fdec4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.947+0000 7fdeccff9700 1 -- 172.21.15.19:0/1284760316 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fded407d950 con 0x7fded8067510 2024-08-17T02:29:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.947+0000 7fdecffff700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdec4060860 0x7fdec4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.947+0000 7fdecffff700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdec4060860 0x7fdec4062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fded80b1f80 tx=0x7fdec8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:32.955+0000 7fdeccff9700 1 -- 172.21.15.19:0/1284760316 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fded404da20 con 0x7fded8067510 2024-08-17T02:29:33.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.119+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fded80caac0 con 0x7fded8067510 2024-08-17T02:29:33.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.119+0000 7fdeccff9700 1 -- 172.21.15.19:0/1284760316 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fded4051040 con 0x7fded8067510 2024-08-17T02:29:33.125 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:29:33.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdec4060860 msgr2=0x7fdec4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdec4060860 0x7fdec4062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fded80b1f80 tx=0x7fdec8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:33.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 msgr2=0x7fded80c51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 0x7fded80c51a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fded400ec80 tx=0x7fded40091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 shutdown_connections 2024-08-17T02:29:33.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdec4060860 0x7fdec4062d10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fded81596d0 0x7fded815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fded8159300 0x7fded8169bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 --2- 172.21.15.19:0/1284760316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fded8067510 0x7fded80c51a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 >> 172.21.15.19:0/1284760316 conn(0x7fded80682c0 msgr2=0x7fded8157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 shutdown_connections 2024-08-17T02:29:33.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.123+0000 7fdedf110700 1 -- 172.21.15.19:0/1284760316 wait complete. 2024-08-17T02:29:33.139 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:33.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.247+0000 7f9d074f7700 1 Processor -- start 2024-08-17T02:29:33.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d074f7700 1 -- start start 2024-08-17T02:29:33.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d074f7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d001590b0 0x7f9d00066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d074f7700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9d00159480 0x7f9d00067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d074f7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d000cd2b0 0x7f9d0015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d074f7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d000cba00 con 0x7f9d000cd2b0 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d074f7700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d000cdc90 con 0x7f9d00159480 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d074f7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000ce210 con 0x7f9d001590b0 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d06cf6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d000cd2b0 0x7f9d0015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d06cf6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d000cd2b0 0x7f9d0015ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52854/0 (socket says 172.21.15.19:52854) 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d06cf6700 1 -- 172.21.15.19:0/600575233 learned_addr learned my addr 172.21.15.19:0/600575233 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d05cf4700 1 --2- 172.21.15.19:0/600575233 >> v2:172.21.15.119:3300/0 conn(0x7f9d00159480 0x7f9d00067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d064f5700 1 --2- 172.21.15.19:0/600575233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d001590b0 0x7f9d00066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d06cf6700 1 -- 172.21.15.19:0/600575233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d001590b0 msgr2=0x7f9d00066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d06cf6700 1 --2- 172.21.15.19:0/600575233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d001590b0 0x7f9d00066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d06cf6700 1 -- 172.21.15.19:0/600575233 >> v2:172.21.15.119:3300/0 conn(0x7f9d00159480 msgr2=0x7f9d00067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d06cf6700 1 --2- 172.21.15.19:0/600575233 >> v2:172.21.15.119:3300/0 conn(0x7f9d00159480 0x7f9d00067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d06cf6700 1 -- 172.21.15.19:0/600575233 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d000cb440 con 0x7f9d000cd2b0 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d05cf4700 1 --2- 172.21.15.19:0/600575233 >> v2:172.21.15.119:3300/0 conn(0x7f9d00159480 0x7f9d00067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d06cf6700 1 --2- 172.21.15.19:0/600575233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d000cd2b0 0x7f9d0015ce00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9d0006fa10 tx=0x7f9cf8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74bbb433cbaf89 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d054f3700 1 -- 172.21.15.19:0/600575233 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800e070 con 0x7f9d000cd2b0 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d054f3700 1 -- 172.21.15.19:0/600575233 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf800b970 con 0x7f9d000cd2b0 2024-08-17T02:29:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.251+0000 7f9d054f3700 1 -- 172.21.15.19:0/600575233 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80092e0 con 0x7f9d000cd2b0 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 -- 172.21.15.19:0/600575233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d000cd2b0 msgr2=0x7f9d0015ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 --2- 172.21.15.19:0/600575233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d000cd2b0 0x7f9d0015ce00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9d0006fa10 tx=0x7f9cf8009840 comp rx=0 tx=0).stop 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 -- 172.21.15.19:0/600575233 shutdown_connections 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 --2- 172.21.15.19:0/600575233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d000cd2b0 0x7f9d0015ce00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 --2- 172.21.15.19:0/600575233 >> v2:172.21.15.119:3300/0 conn(0x7f9d00159480 0x7f9d00067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 --2- 172.21.15.19:0/600575233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d001590b0 0x7f9d00066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 -- 172.21.15.19:0/600575233 >> 172.21.15.19:0/600575233 conn(0x7f9d000d0b90 msgr2=0x7f9d000ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 -- 172.21.15.19:0/600575233 shutdown_connections 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 -- 172.21.15.19:0/600575233 wait complete. 2024-08-17T02:29:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 Processor -- start 2024-08-17T02:29:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.255+0000 7f9d074f7700 1 -- start start 2024-08-17T02:29:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d074f7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d000cd2b0 0x7f9d0016a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d074f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d001590b0 0x7f9d001512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d074f7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d00159480 0x7f9d00152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d074f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0016a5d0 con 0x7f9d001590b0 2024-08-17T02:29:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d074f7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00153b60 con 0x7f9d000cd2b0 2024-08-17T02:29:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d074f7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00153e40 con 0x7f9d00159480 2024-08-17T02:29:33.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d05cf4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d001590b0 0x7f9d001512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d05cf4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d001590b0 0x7f9d001512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52870/0 (socket says 172.21.15.19:52870) 2024-08-17T02:29:33.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d05cf4700 1 -- 172.21.15.19:0/2037263428 learned_addr learned my addr 172.21.15.19:0/2037263428 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:33.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d064f5700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d000cd2b0 0x7f9d0016a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d06cf6700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d00159480 0x7f9d00152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d05cf4700 1 -- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d00159480 msgr2=0x7f9d00152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d05cf4700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d00159480 0x7f9d00152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d05cf4700 1 -- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d000cd2b0 msgr2=0x7f9d0016a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d05cf4700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d000cd2b0 0x7f9d0016a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d05cf4700 1 -- 172.21.15.19:0/2037263428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0009420 con 0x7f9d001590b0 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d05cf4700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d001590b0 0x7f9d001512d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000ec80 tx=0x7f9cf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9cf67fc700 1 -- 172.21.15.19:0/2037263428 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000c850 con 0x7f9d001590b0 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9cf67fc700 1 -- 172.21.15.19:0/2037263428 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000c9b0 con 0x7f9d001590b0 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf8009ae0 con 0x7f9d001590b0 2024-08-17T02:29:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9cf67fc700 1 -- 172.21.15.19:0/2037263428 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000cd30 con 0x7f9d001590b0 2024-08-17T02:29:33.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.259+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d00154480 con 0x7f9d001590b0 2024-08-17T02:29:33.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.263+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d00064330 con 0x7f9d001590b0 2024-08-17T02:29:33.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.263+0000 7f9cf67fc700 1 -- 172.21.15.19:0/2037263428 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9cf0013680 con 0x7f9d001590b0 2024-08-17T02:29:33.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.263+0000 7f9cf67fc700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce4060860 0x7f9ce4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.263+0000 7f9cf67fc700 1 -- 172.21.15.19:0/2037263428 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9cf007d4e0 con 0x7f9d001590b0 2024-08-17T02:29:33.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.263+0000 7f9d064f5700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce4060860 0x7f9ce4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.263+0000 7f9d064f5700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce4060860 0x7f9ce4062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009db0 tx=0x7f9cfc0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.271+0000 7f9cf67fc700 1 -- 172.21.15.19:0/2037263428 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9cf0051040 con 0x7f9d001590b0 2024-08-17T02:29:33.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.427+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d00070cf0 con 0x7f9d001590b0 2024-08-17T02:29:33.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.427+0000 7f9cf67fc700 1 -- 172.21.15.19:0/2037263428 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9cf0050bd0 con 0x7f9d001590b0 2024-08-17T02:29:33.432 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-08-17T02:29:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce4060860 msgr2=0x7f9ce4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce4060860 0x7f9ce4062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009db0 tx=0x7f9cfc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d001590b0 msgr2=0x7f9d001512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d001590b0 0x7f9d001512d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000ec80 tx=0x7f9cf00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 shutdown_connections 2024-08-17T02:29:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce4060860 0x7f9ce4062d10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d00159480 0x7f9d00152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d001590b0 0x7f9d001512d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 --2- 172.21.15.19:0/2037263428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d000cd2b0 0x7f9d0016a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 >> 172.21.15.19:0/2037263428 conn(0x7f9d000d0b90 msgr2=0x7f9d000b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 shutdown_connections 2024-08-17T02:29:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.431+0000 7f9d074f7700 1 -- 172.21.15.19:0/2037263428 wait complete. 2024-08-17T02:29:33.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000446940.meta pg_num 2024-08-17T02:29:33.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.555+0000 7f3cc55b0700 1 Processor -- start 2024-08-17T02:29:33.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.555+0000 7f3cc55b0700 1 -- start start 2024-08-17T02:29:33.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cc55b0700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc0140910 0x7f3cc00c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cc55b0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cc00cbab0 0x7f3cc00cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cc55b0700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc00cc440 con 0x7f3cc00c2c80 2024-08-17T02:29:33.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cc55b0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc00c3e30 con 0x7f3cc00cbab0 2024-08-17T02:29:33.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cc55b0700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00c4110 con 0x7f3cc0140910 2024-08-17T02:29:33.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cc00cbab0 0x7f3cc00cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cc00cbab0 0x7f3cc00cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52876/0 (socket says 172.21.15.19:52876) 2024-08-17T02:29:33.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbf7fe700 1 -- 172.21.15.19:0/1282261139 learned_addr learned my addr 172.21.15.19:0/1282261139 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:33.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbffff700 1 --2- 172.21.15.19:0/1282261139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc0140910 0x7f3cc00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbf7fe700 1 -- 172.21.15.19:0/1282261139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc0140910 msgr2=0x7f3cc00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:33.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbf7fe700 1 --2- 172.21.15.19:0/1282261139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc0140910 0x7f3cc00c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbeffd700 1 -- 172.21.15.19:0/1282261139 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055077396 0 0) 0x7f3cc00cc440 con 0x7f3cc00c2c80 2024-08-17T02:29:33.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbf7fe700 1 -- 172.21.15.19:0/1282261139 >> v1:172.21.15.119:6789/0 conn(0x7f3cc00c2c80 legacy=0x7f3cc00c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbf7fe700 1 -- 172.21.15.19:0/1282261139 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00c43f0 con 0x7f3cc00cbab0 2024-08-17T02:29:33.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbf7fe700 1 --2- 172.21.15.19:0/1282261139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00cbab0 0x7f3cc00cbf00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1a5d00f33714cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbeffd700 1 -- 172.21.15.19:0/1282261139 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4009ea0 con 0x7f3cc00cbab0 2024-08-17T02:29:33.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbeffd700 1 -- 172.21.15.19:0/1282261139 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb400b860 con 0x7f3cc00cbab0 2024-08-17T02:29:33.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.559+0000 7f3cbeffd700 1 -- 172.21.15.19:0/1282261139 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400bc00 con 0x7f3cc00cbab0 2024-08-17T02:29:33.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 -- 172.21.15.19:0/1282261139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00cbab0 msgr2=0x7f3cc00cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 --2- 172.21.15.19:0/1282261139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00cbab0 0x7f3cc00cbf00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4009250 comp rx=0 tx=0).stop 2024-08-17T02:29:33.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 -- 172.21.15.19:0/1282261139 shutdown_connections 2024-08-17T02:29:33.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 --2- 172.21.15.19:0/1282261139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00cbab0 0x7f3cc00cbf00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 --2- 172.21.15.19:0/1282261139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc0140910 0x7f3cc00c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 -- 172.21.15.19:0/1282261139 >> 172.21.15.19:0/1282261139 conn(0x7f3cc00cdee0 msgr2=0x7f3cc00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 -- 172.21.15.19:0/1282261139 shutdown_connections 2024-08-17T02:29:33.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 -- 172.21.15.19:0/1282261139 wait complete. 2024-08-17T02:29:33.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 Processor -- start 2024-08-17T02:29:33.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.563+0000 7f3cc55b0700 1 -- start start 2024-08-17T02:29:33.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cc55b0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00c2c80 0x7f3cc013f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cc55b0700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc00cbab0 0x7f3cc00a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cc55b0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cc0140910 0x7f3cc0158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cc55b0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0167e50 con 0x7f3cc00c2c80 2024-08-17T02:29:33.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cc55b0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0167520 con 0x7f3cc0140910 2024-08-17T02:29:33.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cc55b0700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0167800 con 0x7f3cc00cbab0 2024-08-17T02:29:33.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00c2c80 0x7f3cc013f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00c2c80 0x7f3cc013f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52890/0 (socket says 172.21.15.19:52890) 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbffff700 1 -- 172.21.15.19:0/3780874191 learned_addr learned my addr 172.21.15.19:0/3780874191 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbf7fe700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc00cbab0 0x7f3cc00a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cc4daf700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cc0140910 0x7f3cc0158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbffff700 1 -- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc00cbab0 msgr2=0x7f3cc00a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbffff700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc00cbab0 0x7f3cc00a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbffff700 1 -- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cc0140910 msgr2=0x7f3cc0158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbffff700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cc0140910 0x7f3cc0158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbffff700 1 -- 172.21.15.19:0/3780874191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40094f0 con 0x7f3cc00c2c80 2024-08-17T02:29:33.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cbffff700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00c2c80 0x7f3cc013f900 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000e930 tx=0x7f3cb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3ca7fff700 1 -- 172.21.15.19:0/3780874191 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0009510 con 0x7f3cc00c2c80 2024-08-17T02:29:33.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3ca7fff700 1 -- 172.21.15.19:0/3780874191 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000c850 con 0x7f3cc00c2c80 2024-08-17T02:29:33.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc0167ae0 con 0x7f3cc00c2c80 2024-08-17T02:29:33.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3ca7fff700 1 -- 172.21.15.19:0/3780874191 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000cc10 con 0x7f3cc00c2c80 2024-08-17T02:29:33.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.567+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc0167200 con 0x7f3cc00c2c80 2024-08-17T02:29:33.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.571+0000 7f3ca7fff700 1 -- 172.21.15.19:0/3780874191 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3cb0013470 con 0x7f3cc00c2c80 2024-08-17T02:29:33.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.571+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc00638f0 con 0x7f3cc00c2c80 2024-08-17T02:29:33.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.571+0000 7f3ca7fff700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3cac060860 0x7f3cac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.571+0000 7f3ca7fff700 1 -- 172.21.15.19:0/3780874191 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3cb007d110 con 0x7f3cc00c2c80 2024-08-17T02:29:33.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.571+0000 7f3cbf7fe700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3cac060860 0x7f3cac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.571+0000 7f3cbf7fe700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3cac060860 0x7f3cac062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.579+0000 7f3ca7fff700 1 -- 172.21.15.19:0/3780874191 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3cb004d140 con 0x7f3cc00c2c80 2024-08-17T02:29:33.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.743+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000446940.meta", "var": "pg_num"} v 0) v1 -- 0x7f3cc00cc180 con 0x7f3cc00c2c80 2024-08-17T02:29:33.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3ca7fff700 1 -- 172.21.15.19:0/3780874191 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000446940.meta", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7f3cb0050760 con 0x7f3cc00c2c80 2024-08-17T02:29:33.750 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:29:33.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3cac060860 msgr2=0x7f3cac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3cac060860 0x7f3cac062d10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4017000 comp rx=0 tx=0).stop 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00c2c80 msgr2=0x7f3cc013f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00c2c80 0x7f3cc013f900 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000e930 tx=0x7f3cb00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 shutdown_connections 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3cac060860 0x7f3cac062d10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cc0140910 0x7f3cc0158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cc00cbab0 0x7f3cc00a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 --2- 172.21.15.19:0/3780874191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cc00c2c80 0x7f3cc013f900 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 >> 172.21.15.19:0/3780874191 conn(0x7f3cc00cdee0 msgr2=0x7f3cc00b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 shutdown_connections 2024-08-17T02:29:33.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.747+0000 7f3cc55b0700 1 -- 172.21.15.19:0/3780874191 wait complete. 2024-08-17T02:29:33.764 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000446940.data pg_num 2024-08-17T02:29:33.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a7fff700 1 Processor -- start 2024-08-17T02:29:33.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a7fff700 1 -- start start 2024-08-17T02:29:33.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a81590b0 0x7f03a8066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03a80cd2b0 0x7f03a8067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a7fff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80ce210 con 0x7f03a8159480 2024-08-17T02:29:33.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a7fff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80cba00 con 0x7f03a80cd2b0 2024-08-17T02:29:33.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a7fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80cdc90 con 0x7f03a81590b0 2024-08-17T02:29:33.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03a80cd2b0 0x7f03a8067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03a80cd2b0 0x7f03a8067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52904/0 (socket says 172.21.15.19:52904) 2024-08-17T02:29:33.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a77fe700 1 -- 172.21.15.19:0/4138106685 learned_addr learned my addr 172.21.15.19:0/4138106685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:33.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.875+0000 7f03a6ffd700 1 --2- 172.21.15.19:0/4138106685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a81590b0 0x7f03a8066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a77fe700 1 -- 172.21.15.19:0/4138106685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a81590b0 msgr2=0x7f03a8066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:33.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a77fe700 1 --2- 172.21.15.19:0/4138106685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a81590b0 0x7f03a8066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a77fe700 1 -- 172.21.15.19:0/4138106685 >> v1:172.21.15.119:6789/0 conn(0x7f03a8159480 legacy=0x7f03a815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a77fe700 1 -- 172.21.15.19:0/4138106685 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80cb440 con 0x7f03a80cd2b0 2024-08-17T02:29:33.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a77fe700 1 --2- 172.21.15.19:0/4138106685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a80cd2b0 0x7f03a8067340 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009f20 tx=0x7f03a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6b30672ec1b8c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a5ffb700 1 -- 172.21.15.19:0/4138106685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000e070 con 0x7f03a80cd2b0 2024-08-17T02:29:33.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a5ffb700 1 -- 172.21.15.19:0/4138106685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000b9d0 con 0x7f03a80cd2b0 2024-08-17T02:29:33.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a5ffb700 1 -- 172.21.15.19:0/4138106685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00092e0 con 0x7f03a80cd2b0 2024-08-17T02:29:33.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a7fff700 1 -- 172.21.15.19:0/4138106685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a80cd2b0 msgr2=0x7f03a8067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a7fff700 1 --2- 172.21.15.19:0/4138106685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a80cd2b0 0x7f03a8067340 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009f20 tx=0x7f03a0009840 comp rx=0 tx=0).stop 2024-08-17T02:29:33.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a7fff700 1 -- 172.21.15.19:0/4138106685 shutdown_connections 2024-08-17T02:29:33.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a7fff700 1 --2- 172.21.15.19:0/4138106685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a80cd2b0 0x7f03a8067340 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a7fff700 1 --2- 172.21.15.19:0/4138106685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a81590b0 0x7f03a8066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a7fff700 1 -- 172.21.15.19:0/4138106685 >> 172.21.15.19:0/4138106685 conn(0x7f03a80d0b90 msgr2=0x7f03a80ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a7fff700 1 -- 172.21.15.19:0/4138106685 shutdown_connections 2024-08-17T02:29:33.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.879+0000 7f03a7fff700 1 -- 172.21.15.19:0/4138106685 wait complete. 2024-08-17T02:29:33.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 Processor -- start 2024-08-17T02:29:33.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 -- start start 2024-08-17T02:29:33.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a80cd2b0 0x7f03a81534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a81590b0 0x7f03a81554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a8159480 0x7f03a81435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c72a0 con 0x7f03a8159480 2024-08-17T02:29:33.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c7580 con 0x7f03a81590b0 2024-08-17T02:29:33.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c7860 con 0x7f03a80cd2b0 2024-08-17T02:29:33.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a8159480 0x7f03a81435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a8159480 0x7f03a81435a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52920/0 (socket says 172.21.15.19:52920) 2024-08-17T02:29:33.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a77fe700 1 -- 172.21.15.19:0/1948112809 learned_addr learned my addr 172.21.15.19:0/1948112809 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:33.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a67fc700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a81590b0 0x7f03a81554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a6ffd700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a80cd2b0 0x7f03a81534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a77fe700 1 -- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a80cd2b0 msgr2=0x7f03a81534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a77fe700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a80cd2b0 0x7f03a81534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a77fe700 1 -- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a81590b0 msgr2=0x7f03a81554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a77fe700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a81590b0 0x7f03a81554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a77fe700 1 -- 172.21.15.19:0/1948112809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0009ae0 con 0x7f03a8159480 2024-08-17T02:29:33.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a77fe700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a8159480 0x7f03a81435a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f03a000b610 tx=0x7f03a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f039effd700 1 -- 172.21.15.19:0/1948112809 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0008ad0 con 0x7f03a8159480 2024-08-17T02:29:33.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f039effd700 1 -- 172.21.15.19:0/1948112809 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0008c30 con 0x7f03a8159480 2024-08-17T02:29:33.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f039effd700 1 -- 172.21.15.19:0/1948112809 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0026460 con 0x7f03a8159480 2024-08-17T02:29:33.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a80c7b40 con 0x7f03a8159480 2024-08-17T02:29:33.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.883+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a8153a20 con 0x7f03a8159480 2024-08-17T02:29:33.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.887+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a8153c40 con 0x7f03a8159480 2024-08-17T02:29:33.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.887+0000 7f039effd700 1 -- 172.21.15.19:0/1948112809 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f03a0003040 con 0x7f03a8159480 2024-08-17T02:29:33.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.887+0000 7f039effd700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0388060860 0x7f0388062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.887+0000 7f039effd700 1 -- 172.21.15.19:0/1948112809 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f03a007ede0 con 0x7f03a8159480 2024-08-17T02:29:33.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.891+0000 7f03a6ffd700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0388060860 0x7f0388062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.891+0000 7f03a6ffd700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0388060860 0x7f0388062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0390009db0 tx=0x7f03900091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:33.895+0000 7f039effd700 1 -- 172.21.15.19:0/1948112809 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f03a004eeb0 con 0x7f03a8159480 2024-08-17T02:29:34.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.063+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000446940.data", "var": "pg_num"} v 0) v1 -- 0x7f03a8064330 con 0x7f03a8159480 2024-08-17T02:29:34.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.063+0000 7f039effd700 1 -- 172.21.15.19:0/1948112809 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000446940.data", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7f03a00524d0 con 0x7f03a8159480 2024-08-17T02:29:34.068 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:29:34.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0388060860 msgr2=0x7f0388062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0388060860 0x7f0388062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0390009db0 tx=0x7f03900091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a8159480 msgr2=0x7f03a81435a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a8159480 0x7f03a81435a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f03a000b610 tx=0x7f03a0018000 comp rx=0 tx=0).stop 2024-08-17T02:29:34.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 shutdown_connections 2024-08-17T02:29:34.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0388060860 0x7f0388062d10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03a8159480 0x7f03a81435a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03a81590b0 0x7f03a81554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 --2- 172.21.15.19:0/1948112809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03a80cd2b0 0x7f03a81534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 >> 172.21.15.19:0/1948112809 conn(0x7f03a80d0b90 msgr2=0x7f03a8063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 shutdown_connections 2024-08-17T02:29:34.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.067+0000 7f03a7fff700 1 -- 172.21.15.19:0/1948112809 wait complete. 2024-08-17T02:29:34.083 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0689159700 1 Processor -- start 2024-08-17T02:29:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0689159700 1 -- start start 2024-08-17T02:29:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0689159700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06840abe80 0x7f06840ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0689159700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0684068db0 0x7f06840b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0689159700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068415ab20 con 0x7f0684159700 2024-08-17T02:29:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0689159700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068415a8b0 con 0x7f0684068db0 2024-08-17T02:29:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0689159700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06840ae4e0 con 0x7f06840abe80 2024-08-17T02:29:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0688958700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0684068db0 0x7f06840b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f06837fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0684159700 0x7f06840686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59126/0 (socket says 172.21.15.19:59126) 2024-08-17T02:29:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f06837fe700 1 -- 172.21.15.19:0/949885175 learned_addr learned my addr 172.21.15.19:0/949885175 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0683fff700 1 --2- 172.21.15.19:0/949885175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06840abe80 0x7f06840ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0682ffd700 1 -- 172.21.15.19:0/949885175 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823095542 0 0) 0x7f068415ab20 con 0x7f0684159700 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0682ffd700 1 -- 172.21.15.19:0/949885175 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0664003570 con 0x7f0684159700 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0688958700 1 -- 172.21.15.19:0/949885175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06840abe80 msgr2=0x7f06840ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0688958700 1 --2- 172.21.15.19:0/949885175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06840abe80 0x7f06840ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0688958700 1 -- 172.21.15.19:0/949885175 >> v1:172.21.15.19:6789/0 conn(0x7f0684159700 legacy=0x7f06840686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0688958700 1 -- 172.21.15.19:0/949885175 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684159ec0 con 0x7f0684068db0 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0683fff700 1 --2- 172.21.15.19:0/949885175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06840abe80 0x7f06840ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0688958700 1 --2- 172.21.15.19:0/949885175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 0x7f06840b14f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f06740098e0 tx=0x7f06740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b75845452dda20 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0682ffd700 1 -- 172.21.15.19:0/949885175 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674011630 con 0x7f0684068db0 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0682ffd700 1 -- 172.21.15.19:0/949885175 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674011790 con 0x7f0684068db0 2024-08-17T02:29:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.183+0000 7f0682ffd700 1 -- 172.21.15.19:0/949885175 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674011b30 con 0x7f0684068db0 2024-08-17T02:29:34.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.187+0000 7f0689159700 1 -- 172.21.15.19:0/949885175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 msgr2=0x7f06840b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.187+0000 7f0689159700 1 --2- 172.21.15.19:0/949885175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 0x7f06840b14f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f06740098e0 tx=0x7f06740091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.187+0000 7f0689159700 1 -- 172.21.15.19:0/949885175 shutdown_connections 2024-08-17T02:29:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.187+0000 7f0689159700 1 --2- 172.21.15.19:0/949885175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 0x7f06840b14f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.187+0000 7f0689159700 1 --2- 172.21.15.19:0/949885175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06840abe80 0x7f06840ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.187+0000 7f0689159700 1 -- 172.21.15.19:0/949885175 >> 172.21.15.19:0/949885175 conn(0x7f068406d870 msgr2=0x7f068406dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.187+0000 7f0689159700 1 -- 172.21.15.19:0/949885175 shutdown_connections 2024-08-17T02:29:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.187+0000 7f0689159700 1 -- 172.21.15.19:0/949885175 wait complete. 2024-08-17T02:29:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.187+0000 7f0689159700 1 Processor -- start 2024-08-17T02:29:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0689159700 1 -- start start 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0689159700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 0x7f0684156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0689159700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06840abe80 0x7f0684158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0689159700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0684159700 0x7f0684141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0689159700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0684157b50 con 0x7f0684068db0 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0689159700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0684158d20 con 0x7f06840abe80 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0689159700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0684159000 con 0x7f0684159700 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0683fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 0x7f0684156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0683fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 0x7f0684156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52946/0 (socket says 172.21.15.19:52946) 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0683fff700 1 -- 172.21.15.19:0/318058008 learned_addr learned my addr 172.21.15.19:0/318058008 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f06837fe700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06840abe80 0x7f0684158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0688958700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0684159700 0x7f0684141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0683fff700 1 -- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0684159700 msgr2=0x7f0684141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0683fff700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0684159700 0x7f0684141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0683fff700 1 -- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06840abe80 msgr2=0x7f0684158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0683fff700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06840abe80 0x7f0684158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0683fff700 1 -- 172.21.15.19:0/318058008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c009a20 con 0x7f0684068db0 2024-08-17T02:29:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0688958700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0684159700 0x7f0684141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:34.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0683fff700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 0x7f0684156560 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c170 tx=0x7f067c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f067bfff700 1 -- 172.21.15.19:0/318058008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c00cd60 con 0x7f0684068db0 2024-08-17T02:29:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f067bfff700 1 -- 172.21.15.19:0/318058008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c00f040 con 0x7f0684068db0 2024-08-17T02:29:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0674009420 con 0x7f0684068db0 2024-08-17T02:29:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f067bfff700 1 -- 172.21.15.19:0/318058008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c014690 con 0x7f0684068db0 2024-08-17T02:29:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.191+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0684154330 con 0x7f0684068db0 2024-08-17T02:29:34.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.195+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06840638f0 con 0x7f0684068db0 2024-08-17T02:29:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.195+0000 7f067bfff700 1 -- 172.21.15.19:0/318058008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f067c014a00 con 0x7f0684068db0 2024-08-17T02:29:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.195+0000 7f067bfff700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0668060890 0x7f0668062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.195+0000 7f067bfff700 1 -- 172.21.15.19:0/318058008 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f067c07dd50 con 0x7f0684068db0 2024-08-17T02:29:34.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.195+0000 7f06837fe700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0668060890 0x7f0668062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.195+0000 7f06837fe700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0668060890 0x7f0668062d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f06840cc130 tx=0x7f066c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.203+0000 7f067bfff700 1 -- 172.21.15.19:0/318058008 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f067c081030 con 0x7f0684068db0 2024-08-17T02:29:34.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.403+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0684153c60 con 0x7f0684068db0 2024-08-17T02:29:34.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.403+0000 7f067bfff700 1 -- 172.21.15.19:0/318058008 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5694 (secure 0 0 0) 0x7f067c04de20 con 0x7f0684068db0 2024-08-17T02:29:34.408 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:34.408 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:12.591455+0000","modified":"2024-08-17T02:27:15.252576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34649":{"gid":34649,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/363347157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":363347157},{"type":"v1","addr":"172.21.15.19:6835","nonce":363347157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:29.433713+0000","modified":"2024-08-17T02:27:31.418434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34643":{"gid":34643,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":8,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000446940","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:34.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0668060890 msgr2=0x7f0668062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0668060890 0x7f0668062d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f06840cc130 tx=0x7f066c009040 comp rx=0 tx=0).stop 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 msgr2=0x7f0684156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 0x7f0684156560 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c170 tx=0x7f067c00b040 comp rx=0 tx=0).stop 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 shutdown_connections 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0668060890 0x7f0668062d40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0684159700 0x7f0684141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06840abe80 0x7f0684158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 --2- 172.21.15.19:0/318058008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0684068db0 0x7f0684156560 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 >> 172.21.15.19:0/318058008 conn(0x7f068406d870 msgr2=0x7f06840aadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 shutdown_connections 2024-08-17T02:29:34.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.407+0000 7f0689159700 1 -- 172.21.15.19:0/318058008 wait complete. 2024-08-17T02:29:34.412 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 17 2024-08-17T02:29:34.423 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:34.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.527+0000 7f59c3fff700 1 Processor -- start 2024-08-17T02:29:34.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.527+0000 7f59c3fff700 1 -- start start 2024-08-17T02:29:34.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59c406e620 0x7f59c40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 0x7f59c4141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c4141a00 con 0x7f59c40b0d20 2024-08-17T02:29:34.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c4140b10 con 0x7f59c406e620 2024-08-17T02:29:34.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4140df0 con 0x7f59c40b1630 2024-08-17T02:29:34.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c27fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59c406e620 0x7f59c40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c27fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59c406e620 0x7f59c40b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52948/0 (socket says 172.21.15.19:52948) 2024-08-17T02:29:34.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c27fc700 1 -- 172.21.15.19:0/761013247 learned_addr learned my addr 172.21.15.19:0/761013247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c37fe700 1 --2- 172.21.15.19:0/761013247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 0x7f59c4141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c27fc700 1 -- 172.21.15.19:0/761013247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 msgr2=0x7f59c4141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c27fc700 1 --2- 172.21.15.19:0/761013247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 0x7f59c4141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c27fc700 1 -- 172.21.15.19:0/761013247 >> v1:172.21.15.119:6789/0 conn(0x7f59c40b0d20 legacy=0x7f59c406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c27fc700 1 -- 172.21.15.19:0/761013247 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c41410d0 con 0x7f59c406e620 2024-08-17T02:29:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c27fc700 1 --2- 172.21.15.19:0/761013247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 0x7f59c40b10f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0099b0 tx=0x7f59ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461e6212d0f91f5e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c1ffb700 1 -- 172.21.15.19:0/761013247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00b860 con 0x7f59c406e620 2024-08-17T02:29:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c1ffb700 1 -- 172.21.15.19:0/761013247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac00b9c0 con 0x7f59c406e620 2024-08-17T02:29:34.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c1ffb700 1 -- 172.21.15.19:0/761013247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00bd60 con 0x7f59c406e620 2024-08-17T02:29:34.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 -- 172.21.15.19:0/761013247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 msgr2=0x7f59c40b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 --2- 172.21.15.19:0/761013247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 0x7f59c40b10f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0099b0 tx=0x7f59ac009250 comp rx=0 tx=0).stop 2024-08-17T02:29:34.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 -- 172.21.15.19:0/761013247 shutdown_connections 2024-08-17T02:29:34.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 --2- 172.21.15.19:0/761013247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 0x7f59c4141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 --2- 172.21.15.19:0/761013247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 0x7f59c40b10f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 -- 172.21.15.19:0/761013247 >> 172.21.15.19:0/761013247 conn(0x7f59c40678d0 msgr2=0x7f59c4067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 -- 172.21.15.19:0/761013247 shutdown_connections 2024-08-17T02:29:34.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.531+0000 7f59c3fff700 1 -- 172.21.15.19:0/761013247 wait complete. 2024-08-17T02:29:34.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c3fff700 1 Processor -- start 2024-08-17T02:29:34.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c3fff700 1 -- start start 2024-08-17T02:29:34.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 0x7f59c41460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c3fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b0d20 0x7f59c415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c3fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 0x7f59c415bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c3fff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40a7830 con 0x7f59c406e620 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c3fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4143ca0 con 0x7f59c40b0d20 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c3fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4143f80 con 0x7f59c40b1630 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 0x7f59c41460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 0x7f59c41460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52962/0 (socket says 172.21.15.19:52962) 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c2ffd700 1 -- 172.21.15.19:0/1436255917 learned_addr learned my addr 172.21.15.19:0/1436255917 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c27fc700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b0d20 0x7f59c415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c37fe700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 0x7f59c415bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c2ffd700 1 -- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 msgr2=0x7f59c415bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c2ffd700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 0x7f59c415bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c2ffd700 1 -- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b0d20 msgr2=0x7f59c415b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c2ffd700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b0d20 0x7f59c415b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.535+0000 7f59c2ffd700 1 -- 172.21.15.19:0/1436255917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac0094f0 con 0x7f59c406e620 2024-08-17T02:29:34.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.539+0000 7f59c2ffd700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 0x7f59c41460a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c790 tx=0x7f59b4007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.539+0000 7f59baffd700 1 -- 172.21.15.19:0/1436255917 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4011590 con 0x7f59c406e620 2024-08-17T02:29:34.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.539+0000 7f59baffd700 1 -- 172.21.15.19:0/1436255917 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b4011710 con 0x7f59c406e620 2024-08-17T02:29:34.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.539+0000 7f59baffd700 1 -- 172.21.15.19:0/1436255917 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4011ad0 con 0x7f59c406e620 2024-08-17T02:29:34.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.539+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c4144260 con 0x7f59c406e620 2024-08-17T02:29:34.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.539+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c4144820 con 0x7f59c406e620 2024-08-17T02:29:34.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.539+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c40643a0 con 0x7f59c406e620 2024-08-17T02:29:34.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.539+0000 7f59baffd700 1 -- 172.21.15.19:0/1436255917 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f59b401b3b0 con 0x7f59c406e620 2024-08-17T02:29:34.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.543+0000 7f59baffd700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f59a4060860 0x7f59a4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.543+0000 7f59baffd700 1 -- 172.21.15.19:0/1436255917 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f59b407c7b0 con 0x7f59c406e620 2024-08-17T02:29:34.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.543+0000 7f59c27fc700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f59a4060860 0x7f59a4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.543+0000 7f59c27fc700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f59a4060860 0x7f59a4062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0099b0 tx=0x7f59ac017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.547+0000 7f59baffd700 1 -- 172.21.15.19:0/1436255917 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f59b404c860 con 0x7f59c406e620 2024-08-17T02:29:34.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.715+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59c416e2d0 con 0x7f59c406e620 2024-08-17T02:29:34.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.715+0000 7f59baffd700 1 -- 172.21.15.19:0/1436255917 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18599 (secure 0 0 0) 0x7f59b4017020 con 0x7f59c406e620 2024-08-17T02:29:34.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:34.721 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":38,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:27:32.364602+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:11.122666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:11.570819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000446940.meta","create_time":"2024-08-17T02:27:28.354322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000446940"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000446940.data","create_time":"2024-08-17T02:27:28.449086+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000446940"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:34.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f59a4060860 msgr2=0x7f59a4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f59a4060860 0x7f59a4062d10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0099b0 tx=0x7f59ac017000 comp rx=0 tx=0).stop 2024-08-17T02:29:34.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 msgr2=0x7f59c41460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 0x7f59c41460a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f59b400c790 tx=0x7f59b4007f40 comp rx=0 tx=0).stop 2024-08-17T02:29:34.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 shutdown_connections 2024-08-17T02:29:34.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f59a4060860 0x7f59a4062d10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40b1630 0x7f59c415bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b0d20 0x7f59c415b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 --2- 172.21.15.19:0/1436255917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59c406e620 0x7f59c41460a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 >> 172.21.15.19:0/1436255917 conn(0x7f59c40678d0 msgr2=0x7f59c4063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 shutdown_connections 2024-08-17T02:29:34.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.719+0000 7f59c3fff700 1 -- 172.21.15.19:0/1436255917 wait complete. 2024-08-17T02:29:34.736 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:34.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:34.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dd064a700 1 Processor -- start 2024-08-17T02:29:34.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dd064a700 1 -- start start 2024-08-17T02:29:34.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dd064a700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7dc8153a40 0x7f7dc80c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dd064a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7dc815a260 0x7f7dc80ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dd064a700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80c9e00 con 0x7f7dc80b29f0 2024-08-17T02:29:34.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dd064a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80ccd20 con 0x7f7dc815a260 2024-08-17T02:29:34.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dd064a700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc80cc890 con 0x7f7dc8153a40 2024-08-17T02:29:34.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dcebe7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7dc815a260 0x7f7dc80ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dcebe7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7dc815a260 0x7f7dc80ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52966/0 (socket says 172.21.15.19:52966) 2024-08-17T02:29:34.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dcebe7700 1 -- 172.21.15.19:0/1931818502 learned_addr learned my addr 172.21.15.19:0/1931818502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:34.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dce3e6700 1 --2- 172.21.15.19:0/1931818502 >> v2:172.21.15.119:3300/0 conn(0x7f7dc8153a40 0x7f7dc80c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dce3e6700 1 -- 172.21.15.19:0/1931818502 >> v2:172.21.15.19:3300/0 conn(0x7f7dc815a260 msgr2=0x7f7dc80ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dce3e6700 1 --2- 172.21.15.19:0/1931818502 >> v2:172.21.15.19:3300/0 conn(0x7f7dc815a260 0x7f7dc80ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dce3e6700 1 -- 172.21.15.19:0/1931818502 >> v1:172.21.15.119:6789/0 conn(0x7f7dc80b29f0 legacy=0x7f7dc8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dce3e6700 1 -- 172.21.15.19:0/1931818502 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80cbf60 con 0x7f7dc8153a40 2024-08-17T02:29:34.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dcebe7700 1 --2- 172.21.15.19:0/1931818502 >> v2:172.21.15.19:3300/0 conn(0x7f7dc815a260 0x7f7dc80ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:34.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dce3e6700 1 --2- 172.21.15.19:0/1931818502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dc8153a40 0x7f7dc80c9820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80701a0 tx=0x7f7db00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6f2cb55c03ee3c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dcd3e4700 1 -- 172.21.15.19:0/1931818502 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db000f6b0 con 0x7f7dc8153a40 2024-08-17T02:29:34.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dcd3e4700 1 -- 172.21.15.19:0/1931818502 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db000f810 con 0x7f7dc8153a40 2024-08-17T02:29:34.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.843+0000 7f7dcd3e4700 1 -- 172.21.15.19:0/1931818502 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db000fbb0 con 0x7f7dc8153a40 2024-08-17T02:29:34.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 -- 172.21.15.19:0/1931818502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dc8153a40 msgr2=0x7f7dc80c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 --2- 172.21.15.19:0/1931818502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dc8153a40 0x7f7dc80c9820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80701a0 tx=0x7f7db00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 -- 172.21.15.19:0/1931818502 shutdown_connections 2024-08-17T02:29:34.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 --2- 172.21.15.19:0/1931818502 >> v2:172.21.15.19:3300/0 conn(0x7f7dc815a260 0x7f7dc80ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 --2- 172.21.15.19:0/1931818502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dc8153a40 0x7f7dc80c9820 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 -- 172.21.15.19:0/1931818502 >> 172.21.15.19:0/1931818502 conn(0x7f7dc80a9db0 msgr2=0x7f7dc80ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 -- 172.21.15.19:0/1931818502 shutdown_connections 2024-08-17T02:29:34.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 -- 172.21.15.19:0/1931818502 wait complete. 2024-08-17T02:29:34.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 Processor -- start 2024-08-17T02:29:34.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.847+0000 7f7dd064a700 1 -- start start 2024-08-17T02:29:34.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dd064a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dc80b29f0 0x7f7dc80b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dd064a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7dc8153a40 0x7f7dc8158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dd064a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc815a260 0x7f7dc8146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dd064a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80b1800 con 0x7f7dc815a260 2024-08-17T02:29:34.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dd064a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80ae020 con 0x7f7dc80b29f0 2024-08-17T02:29:34.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dd064a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80ae300 con 0x7f7dc8153a40 2024-08-17T02:29:34.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcebe7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc815a260 0x7f7dc8146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcebe7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc815a260 0x7f7dc8146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52968/0 (socket says 172.21.15.19:52968) 2024-08-17T02:29:34.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcebe7700 1 -- 172.21.15.19:0/2870754404 learned_addr learned my addr 172.21.15.19:0/2870754404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:34.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dce3e6700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dc80b29f0 0x7f7dc80b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcdbe5700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7dc8153a40 0x7f7dc8158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcebe7700 1 -- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7dc8153a40 msgr2=0x7f7dc8158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcebe7700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7dc8153a40 0x7f7dc8158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcebe7700 1 -- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dc80b29f0 msgr2=0x7f7dc80b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcebe7700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dc80b29f0 0x7f7dc80b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcebe7700 1 -- 172.21.15.19:0/2870754404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc00094f0 con 0x7f7dc815a260 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dcebe7700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc815a260 0x7f7dc8146610 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000ec50 tx=0x7f7dc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dc67fc700 1 -- 172.21.15.19:0/2870754404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc000c850 con 0x7f7dc815a260 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dc67fc700 1 -- 172.21.15.19:0/2870754404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000c9b0 con 0x7f7dc815a260 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db0009420 con 0x7f7dc815a260 2024-08-17T02:29:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dc67fc700 1 -- 172.21.15.19:0/2870754404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc000cd50 con 0x7f7dc815a260 2024-08-17T02:29:34.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.851+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc80aeba0 con 0x7f7dc815a260 2024-08-17T02:29:34.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.855+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc80ae4c0 con 0x7f7dc815a260 2024-08-17T02:29:34.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.855+0000 7f7dc67fc700 1 -- 172.21.15.19:0/2870754404 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7dc0013680 con 0x7f7dc815a260 2024-08-17T02:29:34.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.855+0000 7f7dc67fc700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7da8060860 0x7f7da8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.855+0000 7f7dc67fc700 1 -- 172.21.15.19:0/2870754404 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7dc007d1e0 con 0x7f7dc815a260 2024-08-17T02:29:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.855+0000 7f7dce3e6700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7da8060860 0x7f7da8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.855+0000 7f7dce3e6700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7da8060860 0x7f7da8062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7db00093f0 tx=0x7f7db0019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:34.863+0000 7f7dc67fc700 1 -- 172.21.15.19:0/2870754404 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7dc004d2b0 con 0x7f7dc815a260 2024-08-17T02:29:35.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.067+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dc80645c0 con 0x7f7dc815a260 2024-08-17T02:29:35.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.067+0000 7f7dc67fc700 1 -- 172.21.15.19:0/2870754404 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5694 (secure 0 0 0) 0x7f7dc00508d0 con 0x7f7dc815a260 2024-08-17T02:29:35.072 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:35.072 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:12.591455+0000","modified":"2024-08-17T02:27:15.252576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34649":{"gid":34649,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/363347157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":363347157},{"type":"v1","addr":"172.21.15.19:6835","nonce":363347157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:29.433713+0000","modified":"2024-08-17T02:27:31.418434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34643":{"gid":34643,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":8,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000446940","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:35.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7da8060860 msgr2=0x7f7da8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7da8060860 0x7f7da8062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7db00093f0 tx=0x7f7db0019000 comp rx=0 tx=0).stop 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc815a260 msgr2=0x7f7dc8146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc815a260 0x7f7dc8146610 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000ec50 tx=0x7f7dc0009250 comp rx=0 tx=0).stop 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 shutdown_connections 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7da8060860 0x7f7da8062d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc815a260 0x7f7dc8146610 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7dc8153a40 0x7f7dc8158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 --2- 172.21.15.19:0/2870754404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7dc80b29f0 0x7f7dc80b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 >> 172.21.15.19:0/2870754404 conn(0x7f7dc80a9db0 msgr2=0x7f7dc81512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 shutdown_connections 2024-08-17T02:29:35.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.071+0000 7f7dd064a700 1 -- 172.21.15.19:0/2870754404 wait complete. 2024-08-17T02:29:35.076 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 17 2024-08-17T02:29:35.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 Processor -- start 2024-08-17T02:29:35.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 -- start start 2024-08-17T02:29:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f201415d540 0x7f20140af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f201406e830 0x7f20140a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20140a9260 0x7f20140b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20140b0270 con 0x7f201415d540 2024-08-17T02:29:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20140af660 con 0x7f201406e830 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140af940 con 0x7f20140a9260 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f201259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f201415d540 0x7f20140af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f201259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f201415d540 0x7f20140af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52976/0 (socket says 172.21.15.19:52976) 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f201259c700 1 -- 172.21.15.19:0/2468513666 learned_addr learned my addr 172.21.15.19:0/2468513666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2009d9b700 1 --2- 172.21.15.19:0/2468513666 >> v2:172.21.15.119:3300/0 conn(0x7f201406e830 0x7f20140a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2012d9d700 1 --2- 172.21.15.19:0/2468513666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20140a9260 0x7f20140b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f201259c700 1 -- 172.21.15.19:0/2468513666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20140a9260 msgr2=0x7f20140b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f201259c700 1 --2- 172.21.15.19:0/2468513666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20140a9260 0x7f20140b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f201259c700 1 -- 172.21.15.19:0/2468513666 >> v2:172.21.15.119:3300/0 conn(0x7f201406e830 msgr2=0x7f20140a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f201259c700 1 --2- 172.21.15.19:0/2468513666 >> v2:172.21.15.119:3300/0 conn(0x7f201406e830 0x7f20140a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f201259c700 1 -- 172.21.15.19:0/2468513666 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20140afc20 con 0x7f201415d540 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2009d9b700 1 --2- 172.21.15.19:0/2468513666 >> v2:172.21.15.119:3300/0 conn(0x7f201406e830 0x7f20140a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f201259c700 1 --2- 172.21.15.19:0/2468513666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f201415d540 0x7f20140af030 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f201406c970 tx=0x7f2004009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9943657dcbbef5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2011d9b700 1 -- 172.21.15.19:0/2468513666 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400b640 con 0x7f201415d540 2024-08-17T02:29:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2011d9b700 1 -- 172.21.15.19:0/2468513666 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400b7a0 con 0x7f201415d540 2024-08-17T02:29:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2011d9b700 1 -- 172.21.15.19:0/2468513666 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400bb60 con 0x7f201415d540 2024-08-17T02:29:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 -- 172.21.15.19:0/2468513666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f201415d540 msgr2=0x7f20140af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 --2- 172.21.15.19:0/2468513666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f201415d540 0x7f20140af030 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f201406c970 tx=0x7f2004009250 comp rx=0 tx=0).stop 2024-08-17T02:29:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 -- 172.21.15.19:0/2468513666 shutdown_connections 2024-08-17T02:29:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 --2- 172.21.15.19:0/2468513666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f20140a9260 0x7f20140b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 --2- 172.21.15.19:0/2468513666 >> v2:172.21.15.119:3300/0 conn(0x7f201406e830 0x7f20140a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 --2- 172.21.15.19:0/2468513666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f201415d540 0x7f20140af030 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 -- 172.21.15.19:0/2468513666 >> 172.21.15.19:0/2468513666 conn(0x7f2014066e00 msgr2=0x7f2014067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 -- 172.21.15.19:0/2468513666 shutdown_connections 2024-08-17T02:29:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.187+0000 7f2018c38700 1 -- 172.21.15.19:0/2468513666 wait complete. 2024-08-17T02:29:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.191+0000 7f2018c38700 1 Processor -- start 2024-08-17T02:29:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.191+0000 7f2018c38700 1 -- start start 2024-08-17T02:29:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.191+0000 7f2018c38700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406e830 0x7f2014157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.191+0000 7f2018c38700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20140a9260 0x7f201416d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.191+0000 7f2018c38700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201415d540 0x7f201416df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.191+0000 7f2018c38700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c8740 con 0x7f20140a9260 2024-08-17T02:29:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.191+0000 7f2018c38700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140ad000 con 0x7f201406e830 2024-08-17T02:29:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.191+0000 7f2018c38700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140ad2e0 con 0x7f201415d540 2024-08-17T02:29:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.191+0000 7f2009d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20140a9260 0x7f201416d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2009d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20140a9260 0x7f201416d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52992/0 (socket says 172.21.15.19:52992) 2024-08-17T02:29:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2009d9b700 1 -- 172.21.15.19:0/3069961008 learned_addr learned my addr 172.21.15.19:0/3069961008 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f201259c700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406e830 0x7f2014157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2012d9d700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201415d540 0x7f201416df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2009d9b700 1 -- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201415d540 msgr2=0x7f201416df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2009d9b700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201415d540 0x7f201416df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2009d9b700 1 -- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406e830 msgr2=0x7f2014157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2009d9b700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406e830 0x7f2014157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2009d9b700 1 -- 172.21.15.19:0/3069961008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc009420 con 0x7f20140a9260 2024-08-17T02:29:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2009d9b700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20140a9260 0x7f201416d9c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00ec80 tx=0x7f1ffc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f200affd700 1 -- 172.21.15.19:0/3069961008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00c920 con 0x7f20140a9260 2024-08-17T02:29:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f200affd700 1 -- 172.21.15.19:0/3069961008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc00ca80 con 0x7f20140a9260 2024-08-17T02:29:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f200affd700 1 -- 172.21.15.19:0/3069961008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00ce00 con 0x7f20140a9260 2024-08-17T02:29:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20040094f0 con 0x7f20140a9260 2024-08-17T02:29:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20140ad8a0 con 0x7f20140a9260 2024-08-17T02:29:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.195+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20140c88b0 con 0x7f20140a9260 2024-08-17T02:29:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.199+0000 7f200affd700 1 -- 172.21.15.19:0/3069961008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1ffc013680 con 0x7f20140a9260 2024-08-17T02:29:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.199+0000 7f200affd700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1ff4060890 0x7f1ff4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.199+0000 7f200affd700 1 -- 172.21.15.19:0/3069961008 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1ffc07d3c0 con 0x7f20140a9260 2024-08-17T02:29:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.199+0000 7f201259c700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1ff4060890 0x7f1ff4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.199+0000 7f201259c700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1ff4060890 0x7f1ff4062d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f201406c970 tx=0x7f2004017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.207+0000 7f200affd700 1 -- 172.21.15.19:0/3069961008 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1ffc04d3f0 con 0x7f20140a9260 2024-08-17T02:29:35.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.407+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20140645c0 con 0x7f20140a9260 2024-08-17T02:29:35.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.407+0000 7f200affd700 1 -- 172.21.15.19:0/3069961008 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5694 (secure 0 0 0) 0x7f1ffc050a10 con 0x7f20140a9260 2024-08-17T02:29:35.412 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:35.412 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:12.591455+0000","modified":"2024-08-17T02:27:15.252576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34649":{"gid":34649,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6835/363347157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":363347157},{"type":"v1","addr":"172.21.15.19:6835","nonce":363347157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:29.433713+0000","modified":"2024-08-17T02:27:31.418434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34643":{"gid":34643,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":8,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000446940","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1ff4060890 msgr2=0x7f1ff4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1ff4060890 0x7f1ff4062d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f201406c970 tx=0x7f2004017000 comp rx=0 tx=0).stop 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20140a9260 msgr2=0x7f201416d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20140a9260 0x7f201416d9c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00ec80 tx=0x7f1ffc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 shutdown_connections 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1ff4060890 0x7f1ff4062d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f201415d540 0x7f201416df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20140a9260 0x7f201416d9c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 --2- 172.21.15.19:0/3069961008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f201406e830 0x7f2014157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 >> 172.21.15.19:0/3069961008 conn(0x7f2014066e00 msgr2=0x7f201415c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 shutdown_connections 2024-08-17T02:29:35.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.411+0000 7f2018c38700 1 -- 172.21.15.19:0/3069961008 wait complete. 2024-08-17T02:29:35.418 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 17 2024-08-17T02:29:35.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f721b6d4700 1 Processor -- start 2024-08-17T02:29:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f721b6d4700 1 -- start start 2024-08-17T02:29:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f721b6d4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f72140b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f721b6d4700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72140d1200 0x7f72140c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f721b6d4700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72140ce120 con 0x7f72140d0dd0 2024-08-17T02:29:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f721b6d4700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140c5c60 con 0x7f72140d1200 2024-08-17T02:29:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f721b6d4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72140ce390 con 0x7f7214159810 2024-08-17T02:29:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219470700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f72140b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219c71700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72140d1200 0x7f72140c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219470700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f72140b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:38602/0 (socket says 172.21.15.19:38602) 2024-08-17T02:29:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7218c6f700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f72140d0dd0 0x7f72140cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:47064/0 (socket says 172.21.15.19:47064) 2024-08-17T02:29:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219470700 1 -- 172.21.15.19:0/1974165002 learned_addr learned my addr 172.21.15.19:0/1974165002 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7213fff700 1 -- 172.21.15.19:0/1974165002 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204079282 0 0) 0x7f72140ce120 con 0x7f72140d0dd0 2024-08-17T02:29:35.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7213fff700 1 -- 172.21.15.19:0/1974165002 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71fc003570 con 0x7f72140d0dd0 2024-08-17T02:29:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219470700 1 -- 172.21.15.19:0/1974165002 >> v2:172.21.15.119:3300/0 conn(0x7f72140d1200 msgr2=0x7f72140c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219470700 1 --2- 172.21.15.19:0/1974165002 >> v2:172.21.15.119:3300/0 conn(0x7f72140d1200 0x7f72140c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219470700 1 -- 172.21.15.19:0/1974165002 >> v1:172.21.15.119:6789/0 conn(0x7f72140d0dd0 legacy=0x7f72140cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219470700 1 -- 172.21.15.19:0/1974165002 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72140ce670 con 0x7f7214159810 2024-08-17T02:29:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219c71700 1 --2- 172.21.15.19:0/1974165002 >> v2:172.21.15.119:3300/0 conn(0x7f72140d1200 0x7f72140c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7219470700 1 --2- 172.21.15.19:0/1974165002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f72140b3270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7204009f20 tx=0x7f7204009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37ca21e38fc5f2c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7213fff700 1 -- 172.21.15.19:0/1974165002 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720400e070 con 0x7f7214159810 2024-08-17T02:29:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7213fff700 1 -- 172.21.15.19:0/1974165002 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720400b970 con 0x7f7214159810 2024-08-17T02:29:35.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.535+0000 7f7213fff700 1 -- 172.21.15.19:0/1974165002 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72040092e0 con 0x7f7214159810 2024-08-17T02:29:35.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 -- 172.21.15.19:0/1974165002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 msgr2=0x7f72140b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 --2- 172.21.15.19:0/1974165002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f72140b3270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7204009f20 tx=0x7f7204009840 comp rx=0 tx=0).stop 2024-08-17T02:29:35.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 -- 172.21.15.19:0/1974165002 shutdown_connections 2024-08-17T02:29:35.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 --2- 172.21.15.19:0/1974165002 >> v2:172.21.15.119:3300/0 conn(0x7f72140d1200 0x7f72140c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 --2- 172.21.15.19:0/1974165002 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f72140b3270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 -- 172.21.15.19:0/1974165002 >> 172.21.15.19:0/1974165002 conn(0x7f7214067590 msgr2=0x7f72140d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 -- 172.21.15.19:0/1974165002 shutdown_connections 2024-08-17T02:29:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 -- 172.21.15.19:0/1974165002 wait complete. 2024-08-17T02:29:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 Processor -- start 2024-08-17T02:29:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.539+0000 7f721b6d4700 1 -- start start 2024-08-17T02:29:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f721b6d4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72140d0dd0 0x7f7214156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f721b6d4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72140d1200 0x7f721409c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f721b6d4700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f721409c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f721b6d4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140ca2a0 con 0x7f72140d0dd0 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f721b6d4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72141694c0 con 0x7f72140d1200 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f721b6d4700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72140c8400 con 0x7f7214159810 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219470700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72140d0dd0 0x7f7214156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219470700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72140d0dd0 0x7f7214156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53008/0 (socket says 172.21.15.19:53008) 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219470700 1 -- 172.21.15.19:0/1340763824 learned_addr learned my addr 172.21.15.19:0/1340763824 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219c71700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f721409c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7218c6f700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72140d1200 0x7f721409c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219c71700 1 -- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72140d1200 msgr2=0x7f721409c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219c71700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72140d1200 0x7f721409c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219c71700 1 -- 172.21.15.19:0/1340763824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72140d0dd0 msgr2=0x7f7214156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219c71700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72140d0dd0 0x7f7214156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219c71700 1 -- 172.21.15.19:0/1340763824 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c009420 con 0x7f7214159810 2024-08-17T02:29:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f7219c71700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f721409c8c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f720c00e9d0 tx=0x7f720c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f72117fa700 1 -- 172.21.15.19:0/1340763824 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c013680 con 0x7f7214159810 2024-08-17T02:29:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f72117fa700 1 -- 172.21.15.19:0/1340763824 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c013800 con 0x7f7214159810 2024-08-17T02:29:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f72117fa700 1 -- 172.21.15.19:0/1340763824 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c013bc0 con 0x7f7214159810 2024-08-17T02:29:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7204009ae0 con 0x7f7214159810 2024-08-17T02:29:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72140c89c0 con 0x7f7214159810 2024-08-17T02:29:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.543+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7214169650 con 0x7f7214159810 2024-08-17T02:29:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.547+0000 7f72117fa700 1 -- 172.21.15.19:0/1340763824 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f720c00c490 con 0x7f7214159810 2024-08-17T02:29:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.547+0000 7f72117fa700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7200060860 0x7f7200062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.547+0000 7f72117fa700 1 -- 172.21.15.19:0/1340763824 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f720c07d130 con 0x7f7214159810 2024-08-17T02:29:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.547+0000 7f7219470700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7200060860 0x7f7200062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.547+0000 7f7219470700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7200060860 0x7f7200062d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7204009a60 tx=0x7f7204018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.559+0000 7f72117fa700 1 -- 172.21.15.19:0/1340763824 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f720c04d160 con 0x7f7214159810 2024-08-17T02:29:35.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.723+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72140645c0 con 0x7f7214159810 2024-08-17T02:29:35.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.727+0000 7f72117fa700 1 -- 172.21.15.19:0/1340763824 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18599 (secure 0 0 0) 0x7f720c050780 con 0x7f7214159810 2024-08-17T02:29:35.731 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:35.731 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":38,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:27:32.364602+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:11.122666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:11.570819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000446940.meta","create_time":"2024-08-17T02:27:28.354322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000446940"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000446940.data","create_time":"2024-08-17T02:27:28.449086+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000446940"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7200060860 msgr2=0x7f7200062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7200060860 0x7f7200062d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7204009a60 tx=0x7f7204018000 comp rx=0 tx=0).stop 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 msgr2=0x7f721409c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f721409c8c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f720c00e9d0 tx=0x7f720c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 shutdown_connections 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7200060860 0x7f7200062d10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7214159810 0x7f721409c8c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72140d1200 0x7f721409c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 --2- 172.21.15.19:0/1340763824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72140d0dd0 0x7f7214156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 >> 172.21.15.19:0/1340763824 conn(0x7f7214067590 msgr2=0x7f7214069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 shutdown_connections 2024-08-17T02:29:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.731+0000 7f721b6d4700 1 -- 172.21.15.19:0/1340763824 wait complete. 2024-08-17T02:29:35.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:29:35.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.855+0000 7f6b37fff700 1 Processor -- start 2024-08-17T02:29:35.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.855+0000 7f6b37fff700 1 -- start start 2024-08-17T02:29:35.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.855+0000 7f6b37fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b38155d20 0x7f6b380b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.855+0000 7f6b37fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b380ad7c0 0x7f6b380aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.855+0000 7f6b37fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b3806df10 0x7f6b3806e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.855+0000 7f6b37fff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b380adc10 con 0x7f6b380ad7c0 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.855+0000 7f6b37fff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3806e8d0 con 0x7f6b3806df10 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.855+0000 7f6b37fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380af2b0 con 0x7f6b38155d20 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b367fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b380ad7c0 0x7f6b380aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b36ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b38155d20 0x7f6b380b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b367fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b380ad7c0 0x7f6b380aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53012/0 (socket says 172.21.15.19:53012) 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b367fc700 1 -- 172.21.15.19:0/1048337857 learned_addr learned my addr 172.21.15.19:0/1048337857 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b377fe700 1 --2- 172.21.15.19:0/1048337857 >> v2:172.21.15.119:3300/0 conn(0x7f6b3806df10 0x7f6b3806e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b367fc700 1 -- 172.21.15.19:0/1048337857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b38155d20 msgr2=0x7f6b380b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b367fc700 1 --2- 172.21.15.19:0/1048337857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b38155d20 0x7f6b380b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b367fc700 1 -- 172.21.15.19:0/1048337857 >> v2:172.21.15.119:3300/0 conn(0x7f6b3806df10 msgr2=0x7f6b3806e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b367fc700 1 --2- 172.21.15.19:0/1048337857 >> v2:172.21.15.119:3300/0 conn(0x7f6b3806df10 0x7f6b3806e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b367fc700 1 -- 172.21.15.19:0/1048337857 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380af590 con 0x7f6b380ad7c0 2024-08-17T02:29:35.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b367fc700 1 --2- 172.21.15.19:0/1048337857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b380ad7c0 0x7f6b380aea80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6b380b1d00 tx=0x7f6b28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d7e7198dac8781 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b35ffb700 1 -- 172.21.15.19:0/1048337857 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800b640 con 0x7f6b380ad7c0 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b35ffb700 1 -- 172.21.15.19:0/1048337857 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2800b7a0 con 0x7f6b380ad7c0 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b35ffb700 1 -- 172.21.15.19:0/1048337857 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800bb40 con 0x7f6b380ad7c0 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b37fff700 1 -- 172.21.15.19:0/1048337857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b380ad7c0 msgr2=0x7f6b380aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1048337857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b380ad7c0 0x7f6b380aea80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6b380b1d00 tx=0x7f6b28009250 comp rx=0 tx=0).stop 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b37fff700 1 -- 172.21.15.19:0/1048337857 shutdown_connections 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1048337857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b380ad7c0 0x7f6b380aea80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1048337857 >> v2:172.21.15.119:3300/0 conn(0x7f6b3806df10 0x7f6b3806e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1048337857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b38155d20 0x7f6b380b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b37fff700 1 -- 172.21.15.19:0/1048337857 >> 172.21.15.19:0/1048337857 conn(0x7f6b380678d0 msgr2=0x7f6b38067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b37fff700 1 -- 172.21.15.19:0/1048337857 shutdown_connections 2024-08-17T02:29:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.859+0000 7f6b37fff700 1 -- 172.21.15.19:0/1048337857 wait complete. 2024-08-17T02:29:35.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 Processor -- start 2024-08-17T02:29:35.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 -- start start 2024-08-17T02:29:35.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b3806df10 0x7f6b3813d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b380ad7c0 0x7f6b3813ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b38155d20 0x7f6b38153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3813a0f0 con 0x7f6b38155d20 2024-08-17T02:29:35.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3813b640 con 0x7f6b380ad7c0 2024-08-17T02:29:35.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3813b920 con 0x7f6b3806df10 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b377fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b38155d20 0x7f6b38153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b377fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b38155d20 0x7f6b38153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53016/0 (socket says 172.21.15.19:53016) 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b377fe700 1 -- 172.21.15.19:0/1876161633 learned_addr learned my addr 172.21.15.19:0/1876161633 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b36ffd700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b3806df10 0x7f6b3813d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b367fc700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b380ad7c0 0x7f6b3813ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b377fe700 1 -- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b3806df10 msgr2=0x7f6b3813d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b377fe700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b3806df10 0x7f6b3813d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b377fe700 1 -- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b380ad7c0 msgr2=0x7f6b3813ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b377fe700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b380ad7c0 0x7f6b3813ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b377fe700 1 -- 172.21.15.19:0/1876161633 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280094f0 con 0x7f6b38155d20 2024-08-17T02:29:35.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b377fe700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b38155d20 0x7f6b38153680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00e8d0 tx=0x7f6b2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b1effd700 1 -- 172.21.15.19:0/1876161633 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c013680 con 0x7f6b38155d20 2024-08-17T02:29:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3813bc00 con 0x7f6b38155d20 2024-08-17T02:29:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b1effd700 1 -- 172.21.15.19:0/1876161633 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0137e0 con 0x7f6b38155d20 2024-08-17T02:29:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3813c1c0 con 0x7f6b38155d20 2024-08-17T02:29:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.863+0000 7f6b1effd700 1 -- 172.21.15.19:0/1876161633 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c013b60 con 0x7f6b38155d20 2024-08-17T02:29:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.867+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b380643a0 con 0x7f6b38155d20 2024-08-17T02:29:35.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.867+0000 7f6b1effd700 1 -- 172.21.15.19:0/1876161633 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6b2c013cc0 con 0x7f6b38155d20 2024-08-17T02:29:35.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.867+0000 7f6b1effd700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b24060890 0x7f6b24062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.867+0000 7f6b1effd700 1 -- 172.21.15.19:0/1876161633 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6b2c07ce10 con 0x7f6b38155d20 2024-08-17T02:29:35.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.867+0000 7f6b36ffd700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b24060890 0x7f6b24062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.867+0000 7f6b36ffd700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b24060890 0x7f6b24062d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009fd0 tx=0x7f6b3000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:35.875+0000 7f6b1effd700 1 -- 172.21.15.19:0/1876161633 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6b2c04cee0 con 0x7f6b38155d20 2024-08-17T02:29:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.075+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6b3806f5f0 con 0x7f6b38155d20 2024-08-17T02:29:36.080 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-08-17T02:29:36.075+0000 7fcb8c4f8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:36.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.087+0000 7f6b1effd700 1 -- 172.21.15.19:0/1876161633 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6b2c050500 con 0x7f6b38155d20 2024-08-17T02:29:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b24060890 msgr2=0x7f6b24062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b24060890 0x7f6b24062d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009fd0 tx=0x7f6b3000b040 comp rx=0 tx=0).stop 2024-08-17T02:29:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b38155d20 msgr2=0x7f6b38153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b38155d20 0x7f6b38153680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00e8d0 tx=0x7f6b2c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 shutdown_connections 2024-08-17T02:29:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b24060890 0x7f6b24062d40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b38155d20 0x7f6b38153680 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b380ad7c0 0x7f6b3813ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 --2- 172.21.15.19:0/1876161633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b3806df10 0x7f6b3813d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 >> 172.21.15.19:0/1876161633 conn(0x7f6b380678d0 msgr2=0x7f6b38063060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 shutdown_connections 2024-08-17T02:29:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.091+0000 7f6b37fff700 1 -- 172.21.15.19:0/1876161633 wait complete. 2024-08-17T02:29:36.096 INFO:tasks.ceph.mds.a.smithi019.stderr: -7263> 2024-08-17T02:27:18.187+0000 7ff5d3181700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:36.108 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:29:36.126 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-08-17T02:29:36.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.215+0000 7fd102fec700 1 Processor -- start 2024-08-17T02:29:36.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.215+0000 7fd102fec700 1 -- start start 2024-08-17T02:29:36.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd0fc1596d0 0x7fd0fc066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0fc15dbc0 0x7fd0fc067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0cba90 con 0x7fd0fc159300 2024-08-17T02:29:36.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc0b2b60 con 0x7fd0fc15dbc0 2024-08-17T02:29:36.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc0b2940 con 0x7fd0fc1596d0 2024-08-17T02:29:36.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd101589700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0fc15dbc0 0x7fd0fc067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd100d88700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd0fc159300 0x7fd0fc0b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:47072/0 (socket says 172.21.15.19:47072) 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd100d88700 1 -- 172.21.15.19:0/1863965966 learned_addr learned my addr 172.21.15.19:0/1863965966 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd0fbfff700 1 --2- 172.21.15.19:0/1863965966 >> v2:172.21.15.119:3300/0 conn(0x7fd0fc1596d0 0x7fd0fc066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd101589700 1 -- 172.21.15.19:0/1863965966 >> v2:172.21.15.119:3300/0 conn(0x7fd0fc1596d0 msgr2=0x7fd0fc066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd101589700 1 --2- 172.21.15.19:0/1863965966 >> v2:172.21.15.119:3300/0 conn(0x7fd0fc1596d0 0x7fd0fc066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd0fb7fe700 1 -- 172.21.15.19:0/1863965966 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131142725 0 0) 0x7fd0fc0cba90 con 0x7fd0fc159300 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd101589700 1 -- 172.21.15.19:0/1863965966 >> v1:172.21.15.119:6789/0 conn(0x7fd0fc159300 legacy=0x7fd0fc0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd101589700 1 -- 172.21.15.19:0/1863965966 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0cb160 con 0x7fd0fc15dbc0 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd101589700 1 --2- 172.21.15.19:0/1863965966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc15dbc0 0x7fd0fc067340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0b2d20 tx=0x7fd0f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d9530b5e523e61 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd0fb7fe700 1 -- 172.21.15.19:0/1863965966 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400e070 con 0x7fd0fc15dbc0 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd0fb7fe700 1 -- 172.21.15.19:0/1863965966 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f400bb20 con 0x7fd0fc15dbc0 2024-08-17T02:29:36.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd0fb7fe700 1 -- 172.21.15.19:0/1863965966 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4012430 con 0x7fd0fc15dbc0 2024-08-17T02:29:36.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 -- 172.21.15.19:0/1863965966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc15dbc0 msgr2=0x7fd0fc067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 --2- 172.21.15.19:0/1863965966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc15dbc0 0x7fd0fc067340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0b2d20 tx=0x7fd0f4009780 comp rx=0 tx=0).stop 2024-08-17T02:29:36.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 -- 172.21.15.19:0/1863965966 shutdown_connections 2024-08-17T02:29:36.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 --2- 172.21.15.19:0/1863965966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc15dbc0 0x7fd0fc067340 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 --2- 172.21.15.19:0/1863965966 >> v2:172.21.15.119:3300/0 conn(0x7fd0fc1596d0 0x7fd0fc066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 -- 172.21.15.19:0/1863965966 >> 172.21.15.19:0/1863965966 conn(0x7fd0fc0682c0 msgr2=0x7fd0fc0686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:36.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 -- 172.21.15.19:0/1863965966 shutdown_connections 2024-08-17T02:29:36.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.219+0000 7fd102fec700 1 -- 172.21.15.19:0/1863965966 wait complete. 2024-08-17T02:29:36.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 Processor -- start 2024-08-17T02:29:36.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 -- start start 2024-08-17T02:29:36.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc159300 0x7fd0fc154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc1596d0 0x7fd0fc0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc15dbc0 0x7fd0fc14f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc152180 con 0x7fd0fc159300 2024-08-17T02:29:36.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc154ec0 con 0x7fd0fc1596d0 2024-08-17T02:29:36.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1551a0 con 0x7fd0fc15dbc0 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd100d88700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc159300 0x7fd0fc154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd100d88700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc159300 0x7fd0fc154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53038/0 (socket says 172.21.15.19:53038) 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd100d88700 1 -- 172.21.15.19:0/3169010980 learned_addr learned my addr 172.21.15.19:0/3169010980 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd0fbfff700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc1596d0 0x7fd0fc0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd101589700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc15dbc0 0x7fd0fc14f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd100d88700 1 -- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc15dbc0 msgr2=0x7fd0fc14f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd100d88700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc15dbc0 0x7fd0fc14f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd100d88700 1 -- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc1596d0 msgr2=0x7fd0fc0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd100d88700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc1596d0 0x7fd0fc0b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd100d88700 1 -- 172.21.15.19:0/3169010980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4009a20 con 0x7fd0fc159300 2024-08-17T02:29:36.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd101589700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc15dbc0 0x7fd0fc14f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:36.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd0fbfff700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc1596d0 0x7fd0fc0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:36.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd100d88700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc159300 0x7fd0fc154670 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c560 tx=0x7fd0ec000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd0f8ff9700 1 -- 172.21.15.19:0/3169010980 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec005b30 con 0x7fd0fc159300 2024-08-17T02:29:36.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd0f8ff9700 1 -- 172.21.15.19:0/3169010980 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec005c90 con 0x7fd0fc159300 2024-08-17T02:29:36.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc155480 con 0x7fd0fc159300 2024-08-17T02:29:36.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd0f8ff9700 1 -- 172.21.15.19:0/3169010980 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec007320 con 0x7fd0fc159300 2024-08-17T02:29:36.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.223+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc151d10 con 0x7fd0fc159300 2024-08-17T02:29:36.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.227+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc0b5f10 con 0x7fd0fc159300 2024-08-17T02:29:36.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.227+0000 7fd0f8ff9700 1 -- 172.21.15.19:0/3169010980 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd0ec01b3b0 con 0x7fd0fc159300 2024-08-17T02:29:36.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.227+0000 7fd0f8ff9700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd0e8060860 0x7fd0e8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.227+0000 7fd0f8ff9700 1 -- 172.21.15.19:0/3169010980 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fd0ec07c4c0 con 0x7fd0fc159300 2024-08-17T02:29:36.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.227+0000 7fd0fbfff700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd0e8060860 0x7fd0e8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.227+0000 7fd0fbfff700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd0e8060860 0x7fd0e8062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc154620 tx=0x7fd0f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.235+0000 7fd0f8ff9700 1 -- 172.21.15.19:0/3169010980 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd0fc0b5f10 con 0x7fd0fc159300 2024-08-17T02:29:36.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:36.435+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd0fc0b5f10 con 0x7fd0fc159300 2024-08-17T02:29:37.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.091+0000 7fd0f8ff9700 1 -- 172.21.15.19:0/3169010980 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd0fc0b5f10 con 0x7fd0fc159300 2024-08-17T02:29:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd0e8060860 msgr2=0x7fd0e8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd0e8060860 0x7fd0e8062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc154620 tx=0x7fd0f0008040 comp rx=0 tx=0).stop 2024-08-17T02:29:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc159300 msgr2=0x7fd0fc154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc159300 0x7fd0fc154670 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c560 tx=0x7fd0ec000fe0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 shutdown_connections 2024-08-17T02:29:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fd0e8060860 0x7fd0e8062d10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc15dbc0 0x7fd0fc14f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc1596d0 0x7fd0fc0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 --2- 172.21.15.19:0/3169010980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc159300 0x7fd0fc154670 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 >> 172.21.15.19:0/3169010980 conn(0x7fd0fc0682c0 msgr2=0x7fd0fc0ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 shutdown_connections 2024-08-17T02:29:37.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.095+0000 7fd102fec700 1 -- 172.21.15.19:0/3169010980 wait complete. 2024-08-17T02:29:37.117 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:29:37.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.231+0000 7fb102486700 1 Processor -- start 2024-08-17T02:29:37.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.231+0000 7fb102486700 1 -- start start 2024-08-17T02:29:37.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb102486700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb0fc159570 0x7fb0fc068320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb102486700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc069560 con 0x7fb0fc1591a0 2024-08-17T02:29:37.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb102486700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc068950 con 0x7fb0fc0b24e0 2024-08-17T02:29:37.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb102486700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc068c30 con 0x7fb0fc159570 2024-08-17T02:29:37.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb100c83700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb0fc159570 0x7fb0fc068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb101484700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb0fc1591a0 0x7fb0fc0699f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59144/0 (socket says 172.21.15.19:59144) 2024-08-17T02:29:37.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb101484700 1 -- 172.21.15.19:0/1519983288 learned_addr learned my addr 172.21.15.19:0/1519983288 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb100c83700 1 -- 172.21.15.19:0/1519983288 >> v1:172.21.15.119:6789/0 conn(0x7fb0fc0b24e0 legacy=0x7fb0fc0b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb100c83700 1 -- 172.21.15.19:0/1519983288 >> v1:172.21.15.19:6789/0 conn(0x7fb0fc1591a0 legacy=0x7fb0fc0699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb100c83700 1 -- 172.21.15.19:0/1519983288 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc068f10 con 0x7fb0fc159570 2024-08-17T02:29:37.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb100c83700 1 --2- 172.21.15.19:0/1519983288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 0x7fb0fc068320 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80098e0 tx=0x7fb0f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df077101471f7c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb0f3fff700 1 -- 172.21.15.19:0/1519983288 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8009e80 con 0x7fb0fc159570 2024-08-17T02:29:37.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb0f3fff700 1 -- 172.21.15.19:0/1519983288 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f800b860 con 0x7fb0fc159570 2024-08-17T02:29:37.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb0f3fff700 1 -- 172.21.15.19:0/1519983288 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800bbe0 con 0x7fb0fc159570 2024-08-17T02:29:37.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb102486700 1 -- 172.21.15.19:0/1519983288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 msgr2=0x7fb0fc068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb102486700 1 --2- 172.21.15.19:0/1519983288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 0x7fb0fc068320 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80098e0 tx=0x7fb0f80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb102486700 1 -- 172.21.15.19:0/1519983288 shutdown_connections 2024-08-17T02:29:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb102486700 1 --2- 172.21.15.19:0/1519983288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 0x7fb0fc068320 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.235+0000 7fb102486700 1 -- 172.21.15.19:0/1519983288 >> 172.21.15.19:0/1519983288 conn(0x7fb0fc099430 msgr2=0x7fb0fc067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 -- 172.21.15.19:0/1519983288 shutdown_connections 2024-08-17T02:29:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 -- 172.21.15.19:0/1519983288 wait complete. 2024-08-17T02:29:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 Processor -- start 2024-08-17T02:29:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 -- start start 2024-08-17T02:29:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0fc0b24e0 0x7fb0fc0b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc1591a0 0x7fb0fc0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 0x7fb0fc09b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0b33f0 con 0x7fb0fc159570 2024-08-17T02:29:37.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc09bee0 con 0x7fb0fc1591a0 2024-08-17T02:29:37.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb102486700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc155a10 con 0x7fb0fc0b24e0 2024-08-17T02:29:37.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.239+0000 7fb101c85700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 0x7fb0fc09b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb100c83700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc1591a0 0x7fb0fc0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101c85700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 0x7fb0fc09b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53048/0 (socket says 172.21.15.19:53048) 2024-08-17T02:29:37.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101c85700 1 -- 172.21.15.19:0/1704006834 learned_addr learned my addr 172.21.15.19:0/1704006834 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:37.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101484700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0fc0b24e0 0x7fb0fc0b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101c85700 1 -- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0fc0b24e0 msgr2=0x7fb0fc0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101c85700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0fc0b24e0 0x7fb0fc0b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101c85700 1 -- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc1591a0 msgr2=0x7fb0fc0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101c85700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc1591a0 0x7fb0fc0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101c85700 1 -- 172.21.15.19:0/1704006834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f8009420 con 0x7fb0fc159570 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101484700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0fc0b24e0 0x7fb0fc0b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb101c85700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 0x7fb0fc09b170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c8e0 tx=0x7fb0f4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb0f17fa700 1 -- 172.21.15.19:0/1704006834 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4012630 con 0x7fb0fc159570 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb0f17fa700 1 -- 172.21.15.19:0/1704006834 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f40127b0 con 0x7fb0fc159570 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc0b35e0 con 0x7fb0fc159570 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc0b3ba0 con 0x7fb0fc159570 2024-08-17T02:29:37.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb0f17fa700 1 -- 172.21.15.19:0/1704006834 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4012b70 con 0x7fb0fc159570 2024-08-17T02:29:37.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.243+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc0052b0 con 0x7fb0fc159570 2024-08-17T02:29:37.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.247+0000 7fb0f17fa700 1 -- 172.21.15.19:0/1704006834 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb0f4003030 con 0x7fb0fc159570 2024-08-17T02:29:37.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.247+0000 7fb0f17fa700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0e0060860 0x7fb0e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.247+0000 7fb0f17fa700 1 -- 172.21.15.19:0/1704006834 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fb0f407ce90 con 0x7fb0fc159570 2024-08-17T02:29:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.247+0000 7fb101484700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0e0060860 0x7fb0e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.247+0000 7fb101484700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0e0060860 0x7fb0e0062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec001820 tx=0x7fb0ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.251+0000 7fb0f17fa700 1 -- 172.21.15.19:0/1704006834 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb0f404cf00 con 0x7fb0fc159570 2024-08-17T02:29:37.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:37.411+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb0dc005560 con 0x7fb0fc159570 2024-08-17T02:29:38.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.095+0000 7fb0f17fa700 1 -- 172.21.15.19:0/1704006834 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb0f4050520 con 0x7fb0fc159570 2024-08-17T02:29:38.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0e0060860 msgr2=0x7fb0e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0e0060860 0x7fb0e0062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec001820 tx=0x7fb0ec009040 comp rx=0 tx=0).stop 2024-08-17T02:29:38.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 msgr2=0x7fb0fc09b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 0x7fb0fc09b170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400c8e0 tx=0x7fb0f4001710 comp rx=0 tx=0).stop 2024-08-17T02:29:38.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 shutdown_connections 2024-08-17T02:29:38.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb0e0060860 0x7fb0e0062d10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0fc159570 0x7fb0fc09b170 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0fc1591a0 0x7fb0fc0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 --2- 172.21.15.19:0/1704006834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0fc0b24e0 0x7fb0fc0b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 >> 172.21.15.19:0/1704006834 conn(0x7fb0fc099430 msgr2=0x7fb0fc0d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.099+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 shutdown_connections 2024-08-17T02:29:38.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.103+0000 7fb102486700 1 -- 172.21.15.19:0/1704006834 wait complete. 2024-08-17T02:29:38.107 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:29:38.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:29:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.231+0000 7f04496c3700 1 Processor -- start 2024-08-17T02:29:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.231+0000 7f04496c3700 1 -- start start 2024-08-17T02:29:38.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f04441558f0 0x7f0444155d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0444156280 0x7f044406e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044406dec0 con 0x7f0444155520 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04440ae220 con 0x7f0444156280 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04440ae500 con 0x7f04441558f0 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0448ec2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0444156280 0x7f044406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0448ec2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0444156280 0x7f044406e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58156/0 (socket says 172.21.15.19:58156) 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0448ec2700 1 -- 172.21.15.19:0/4178057210 learned_addr learned my addr 172.21.15.19:0/4178057210 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04437fe700 1 --2- 172.21.15.19:0/4178057210 >> v2:172.21.15.119:3300/0 conn(0x7f04441558f0 0x7f0444155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0448ec2700 1 -- 172.21.15.19:0/4178057210 >> v2:172.21.15.119:3300/0 conn(0x7f04441558f0 msgr2=0x7f0444155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0448ec2700 1 --2- 172.21.15.19:0/4178057210 >> v2:172.21.15.119:3300/0 conn(0x7f04441558f0 0x7f0444155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0448ec2700 1 -- 172.21.15.19:0/4178057210 >> v1:172.21.15.119:6789/0 conn(0x7f0444155520 legacy=0x7f04440cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0448ec2700 1 -- 172.21.15.19:0/4178057210 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044406db50 con 0x7f0444156280 2024-08-17T02:29:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04437fe700 1 --2- 172.21.15.19:0/4178057210 >> v2:172.21.15.119:3300/0 conn(0x7f04441558f0 0x7f0444155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0448ec2700 1 --2- 172.21.15.19:0/4178057210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444156280 0x7f044406e350 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f04440701a0 tx=0x7f043c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb6812f9adf659b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0442ffd700 1 -- 172.21.15.19:0/4178057210 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c010070 con 0x7f0444156280 2024-08-17T02:29:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0442ffd700 1 -- 172.21.15.19:0/4178057210 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c00dc80 con 0x7f0444156280 2024-08-17T02:29:38.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f0442ffd700 1 -- 172.21.15.19:0/4178057210 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c016400 con 0x7f0444156280 2024-08-17T02:29:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 -- 172.21.15.19:0/4178057210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444156280 msgr2=0x7f044406e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 --2- 172.21.15.19:0/4178057210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444156280 0x7f044406e350 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f04440701a0 tx=0x7f043c00ba50 comp rx=0 tx=0).stop 2024-08-17T02:29:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 -- 172.21.15.19:0/4178057210 shutdown_connections 2024-08-17T02:29:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 --2- 172.21.15.19:0/4178057210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444156280 0x7f044406e350 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 --2- 172.21.15.19:0/4178057210 >> v2:172.21.15.119:3300/0 conn(0x7f04441558f0 0x7f0444155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 -- 172.21.15.19:0/4178057210 >> 172.21.15.19:0/4178057210 conn(0x7f0444066e00 msgr2=0x7f0444067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 -- 172.21.15.19:0/4178057210 shutdown_connections 2024-08-17T02:29:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.235+0000 7f04496c3700 1 -- 172.21.15.19:0/4178057210 wait complete. 2024-08-17T02:29:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 Processor -- start 2024-08-17T02:29:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 -- start start 2024-08-17T02:29:38.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444155520 0x7f04440ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04441558f0 0x7f0444142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0444156280 0x7f04440a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04440ac390 con 0x7f0444155520 2024-08-17T02:29:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04440c1a60 con 0x7f04441558f0 2024-08-17T02:29:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04440abd40 con 0x7f0444156280 2024-08-17T02:29:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0443fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444155520 0x7f04440ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04437fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04441558f0 0x7f0444142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0448ec2700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0444156280 0x7f04440a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0443fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444155520 0x7f04440ac820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58166/0 (socket says 172.21.15.19:58166) 2024-08-17T02:29:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0443fff700 1 -- 172.21.15.19:0/2098632198 learned_addr learned my addr 172.21.15.19:0/2098632198 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0443fff700 1 -- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0444156280 msgr2=0x7f04440a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0443fff700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0444156280 0x7f04440a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0443fff700 1 -- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04441558f0 msgr2=0x7f0444142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0443fff700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04441558f0 0x7f0444142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0443fff700 1 -- 172.21.15.19:0/2098632198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c00bcf0 con 0x7f0444155520 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04437fe700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04441558f0 0x7f0444142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f0443fff700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444155520 0x7f04440ac820 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f043400c4e0 tx=0x7f043400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f043bfff700 1 -- 172.21.15.19:0/2098632198 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434011590 con 0x7f0444155520 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f043bfff700 1 -- 172.21.15.19:0/2098632198 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434011710 con 0x7f0444155520 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04440ac020 con 0x7f0444155520 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f043bfff700 1 -- 172.21.15.19:0/2098632198 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434011ad0 con 0x7f0444155520 2024-08-17T02:29:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.239+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04440acf00 con 0x7f0444155520 2024-08-17T02:29:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.243+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04440644b0 con 0x7f0444155520 2024-08-17T02:29:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.243+0000 7f043bfff700 1 -- 172.21.15.19:0/2098632198 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f043401b3b0 con 0x7f0444155520 2024-08-17T02:29:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.243+0000 7f043bfff700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0424060890 0x7f0424062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.243+0000 7f043bfff700 1 -- 172.21.15.19:0/2098632198 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f043407c150 con 0x7f0444155520 2024-08-17T02:29:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.247+0000 7f04437fe700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0424060890 0x7f0424062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.247+0000 7f04437fe700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0424060890 0x7f0424062d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04441670d0 tx=0x7f042c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.251+0000 7f043bfff700 1 -- 172.21.15.19:0/2098632198 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f043404c380 con 0x7f0444155520 2024-08-17T02:29:38.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:38.415+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f04440af190 con 0x7f0444155520 2024-08-17T02:29:39.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.099+0000 7f043bfff700 1 -- 172.21.15.19:0/2098632198 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f043404f9a0 con 0x7f0444155520 2024-08-17T02:29:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0424060890 msgr2=0x7f0424062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0424060890 0x7f0424062d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04441670d0 tx=0x7f042c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444155520 msgr2=0x7f04440ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444155520 0x7f04440ac820 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f043400c4e0 tx=0x7f043400c7f0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 shutdown_connections 2024-08-17T02:29:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0424060890 0x7f0424062d40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0444156280 0x7f04440a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04441558f0 0x7f0444142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 --2- 172.21.15.19:0/2098632198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0444155520 0x7f04440ac820 secure :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f043400c4e0 tx=0x7f043400c7f0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 >> 172.21.15.19:0/2098632198 conn(0x7f0444066e00 msgr2=0x7f044406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.107+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 shutdown_connections 2024-08-17T02:29:39.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.111+0000 7f04496c3700 1 -- 172.21.15.19:0/2098632198 wait complete. 2024-08-17T02:29:39.115 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-08-17T02:29:39.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d2e9b700 1 Processor -- start 2024-08-17T02:29:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d2e9b700 1 -- start start 2024-08-17T02:29:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d2e9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc159040 0x7ff1cc0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d2e9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1cc15d5b0 0x7ff1cc0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d2e9b700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0cf190 con 0x7ff1cc0d0010 2024-08-17T02:29:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d2e9b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc0d09a0 con 0x7ff1cc15d5b0 2024-08-17T02:29:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d2e9b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0ce5e0 con 0x7ff1cc159040 2024-08-17T02:29:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d269a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1cc15d5b0 0x7ff1cc0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d269a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1cc15d5b0 0x7ff1cc0d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58168/0 (socket says 172.21.15.19:58168) 2024-08-17T02:29:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d269a700 1 -- 172.21.15.19:0/543419539 learned_addr learned my addr 172.21.15.19:0/543419539 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:39.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.231+0000 7ff1d1e99700 1 --2- 172.21.15.19:0/543419539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc159040 0x7ff1cc0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d1e99700 1 -- 172.21.15.19:0/543419539 >> v2:172.21.15.19:3300/0 conn(0x7ff1cc15d5b0 msgr2=0x7ff1cc0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d1e99700 1 --2- 172.21.15.19:0/543419539 >> v2:172.21.15.19:3300/0 conn(0x7ff1cc15d5b0 0x7ff1cc0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d1e99700 1 -- 172.21.15.19:0/543419539 >> v1:172.21.15.119:6789/0 conn(0x7ff1cc0d0010 legacy=0x7ff1cc15cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d1e99700 1 -- 172.21.15.19:0/543419539 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0ce860 con 0x7ff1cc159040 2024-08-17T02:29:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d269a700 1 --2- 172.21.15.19:0/543419539 >> v2:172.21.15.19:3300/0 conn(0x7ff1cc15d5b0 0x7ff1cc0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d1e99700 1 --2- 172.21.15.19:0/543419539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc159040 0x7ff1cc0cf620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0098e0 tx=0x7ff1bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40080d5aa12a73f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d0e97700 1 -- 172.21.15.19:0/543419539 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00b640 con 0x7ff1cc159040 2024-08-17T02:29:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d0e97700 1 -- 172.21.15.19:0/543419539 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00b7a0 con 0x7ff1cc159040 2024-08-17T02:29:39.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d0e97700 1 -- 172.21.15.19:0/543419539 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc00bb40 con 0x7ff1cc159040 2024-08-17T02:29:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/543419539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc159040 msgr2=0x7ff1cc0cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 --2- 172.21.15.19:0/543419539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc159040 0x7ff1cc0cf620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0098e0 tx=0x7ff1bc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/543419539 shutdown_connections 2024-08-17T02:29:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 --2- 172.21.15.19:0/543419539 >> v2:172.21.15.19:3300/0 conn(0x7ff1cc15d5b0 0x7ff1cc0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 --2- 172.21.15.19:0/543419539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc159040 0x7ff1cc0cf620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/543419539 >> 172.21.15.19:0/543419539 conn(0x7ff1cc068250 msgr2=0x7ff1cc068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/543419539 shutdown_connections 2024-08-17T02:29:39.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/543419539 wait complete. 2024-08-17T02:29:39.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 Processor -- start 2024-08-17T02:29:39.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.235+0000 7ff1d2e9b700 1 -- start start 2024-08-17T02:29:39.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d2e9b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc0d0010 0x7ff1cc15c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d2e9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc159040 0x7ff1cc149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d2e9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1cc15d5b0 0x7ff1cc14caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d2e9b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc15c270 con 0x7ff1cc159040 2024-08-17T02:29:39.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d2e9b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc15b940 con 0x7ff1cc15d5b0 2024-08-17T02:29:39.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d2e9b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc15bc20 con 0x7ff1cc0d0010 2024-08-17T02:29:39.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1698700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc159040 0x7ff1cc149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1e99700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc0d0010 0x7ff1cc15c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1e99700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc0d0010 0x7ff1cc15c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:36460/0 (socket says 172.21.15.19:36460) 2024-08-17T02:29:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1e99700 1 -- 172.21.15.19:0/2881838840 learned_addr learned my addr 172.21.15.19:0/2881838840 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d269a700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1cc15d5b0 0x7ff1cc14caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1e99700 1 -- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1cc15d5b0 msgr2=0x7ff1cc14caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1e99700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1cc15d5b0 0x7ff1cc14caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1e99700 1 -- 172.21.15.19:0/2881838840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc159040 msgr2=0x7ff1cc149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1e99700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc159040 0x7ff1cc149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1e99700 1 -- 172.21.15.19:0/2881838840 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4009ae0 con 0x7ff1cc0d0010 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1698700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc159040 0x7ff1cc149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d1e99700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc0d0010 0x7ff1cc15c700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00a010 tx=0x7ff1bc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1c9ffb700 1 -- 172.21.15.19:0/2881838840 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc01bc80 con 0x7ff1cc0d0010 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1c9ffb700 1 -- 172.21.15.19:0/2881838840 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc01bde0 con 0x7ff1cc0d0010 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc009420 con 0x7ff1cc0d0010 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1c9ffb700 1 -- 172.21.15.19:0/2881838840 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc011670 con 0x7ff1cc0d0010 2024-08-17T02:29:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.239+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc14a000 con 0x7ff1cc0d0010 2024-08-17T02:29:39.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.243+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc0643a0 con 0x7ff1cc0d0010 2024-08-17T02:29:39.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.243+0000 7ff1c9ffb700 1 -- 172.21.15.19:0/2881838840 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff1bc011aa0 con 0x7ff1cc0d0010 2024-08-17T02:29:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.243+0000 7ff1c9ffb700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff1b8060860 0x7ff1b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.243+0000 7ff1c9ffb700 1 -- 172.21.15.19:0/2881838840 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ff1bc07df90 con 0x7ff1cc0d0010 2024-08-17T02:29:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.243+0000 7ff1d1698700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff1b8060860 0x7ff1b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.243+0000 7ff1d1698700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff1b8060860 0x7ff1b8062d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc14a4d0 tx=0x7ff1c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.255+0000 7ff1c9ffb700 1 -- 172.21.15.19:0/2881838840 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff1bc0ae480 con 0x7ff1cc0d0010 2024-08-17T02:29:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.423+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1cc0b3480 con 0x7ff1cc0d0010 2024-08-17T02:29:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1c9ffb700 1 -- 172.21.15.19:0/2881838840 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15510 (secure 0 0 0) 0x7ff1bc04e3e0 con 0x7ff1cc0d0010 2024-08-17T02:29:39.430 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:39.430 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:29:39.093371+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000446940.meta","create_time":"2024-08-17T02:27:28.354322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000446940"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000446940.data","create_time":"2024-08-17T02:27:28.449086+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000446940"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/363347157":"2024-08-18T02:29:36.079948+0000","172.21.15.19:6834/363347157":"2024-08-18T02:29:36.079948+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff1b8060860 msgr2=0x7ff1b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff1b8060860 0x7ff1b8062d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc14a4d0 tx=0x7ff1c0009040 comp rx=0 tx=0).stop 2024-08-17T02:29:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc0d0010 msgr2=0x7ff1cc15c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc0d0010 0x7ff1cc15c700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00a010 tx=0x7ff1bc017000 comp rx=0 tx=0).stop 2024-08-17T02:29:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 shutdown_connections 2024-08-17T02:29:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7ff1b8060860 0x7ff1b8062d10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1cc15d5b0 0x7ff1cc14caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1cc159040 0x7ff1cc149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 --2- 172.21.15.19:0/2881838840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1cc0d0010 0x7ff1cc15c700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 >> 172.21.15.19:0/2881838840 conn(0x7ff1cc068250 msgr2=0x7ff1cc157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 shutdown_connections 2024-08-17T02:29:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.427+0000 7ff1d2e9b700 1 -- 172.21.15.19:0/2881838840 wait complete. 2024-08-17T02:29:39.445 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:26:16.814760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000446940.meta', 'create_time': '2024-08-17T02:27:28.354322+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000446940'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000446940.data', 'create_time': '2024-08-17T02:27:28.449086+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000446940'}}}] 2024-08-17T02:29:39.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:39.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.555+0000 7f9d01737700 1 Processor -- start 2024-08-17T02:29:39.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.555+0000 7f9d01737700 1 -- start start 2024-08-17T02:29:39.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9d01737700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc0b0390 0x7f9cfc0cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9d01737700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cc350 con 0x7f9cfc15cda0 2024-08-17T02:29:39.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9d01737700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cc630 con 0x7f9cfc15d920 2024-08-17T02:29:39.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9d01737700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0ca760 con 0x7f9cfc0b0390 2024-08-17T02:29:39.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfb7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9cfc15cda0 0x7f9cfc15d210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50140/0 (socket says 172.21.15.19:50140) 2024-08-17T02:29:39.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfb7fe700 1 -- 172.21.15.19:0/1516103146 learned_addr learned my addr 172.21.15.19:0/1516103146 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfbfff700 1 --2- 172.21.15.19:0/1516103146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc0b0390 0x7f9cfc0cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfaffd700 1 -- 172.21.15.19:0/1516103146 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788638322 0 0) 0x7f9cfc0cc350 con 0x7f9cfc15cda0 2024-08-17T02:29:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfaffd700 1 -- 172.21.15.19:0/1516103146 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce4003570 con 0x7f9cfc15cda0 2024-08-17T02:29:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfaffd700 1 -- 172.21.15.19:0/1516103146 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647944333 0 0) 0x7f9cfc0cc630 con 0x7f9cfc15d920 2024-08-17T02:29:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfaffd700 1 -- 172.21.15.19:0/1516103146 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cfc0cc350 con 0x7f9cfc15d920 2024-08-17T02:29:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfbfff700 1 -- 172.21.15.19:0/1516103146 >> v1:172.21.15.119:6789/0 conn(0x7f9cfc15d920 legacy=0x7f9cfc0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfbfff700 1 -- 172.21.15.19:0/1516103146 >> v1:172.21.15.19:6789/0 conn(0x7f9cfc15cda0 legacy=0x7f9cfc15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfaffd700 1 -- 172.21.15.19:0/1516103146 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1384359084 0 0) 0x7f9ce4003570 con 0x7f9cfc15cda0 2024-08-17T02:29:39.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfbfff700 1 -- 172.21.15.19:0/1516103146 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0cc910 con 0x7f9cfc0b0390 2024-08-17T02:29:39.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfbfff700 1 --2- 172.21.15.19:0/1516103146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc0b0390 0x7f9cfc0cbcc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009910 tx=0x7f9cec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb258c0e4fb2819 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfaffd700 1 -- 172.21.15.19:0/1516103146 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0001470 con 0x7f9cfc0b0390 2024-08-17T02:29:39.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfaffd700 1 -- 172.21.15.19:0/1516103146 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec011420 con 0x7f9cfc0b0390 2024-08-17T02:29:39.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.559+0000 7f9cfaffd700 1 -- 172.21.15.19:0/1516103146 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0117c0 con 0x7f9cfc0b0390 2024-08-17T02:29:39.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.563+0000 7f9d01737700 1 -- 172.21.15.19:0/1516103146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc0b0390 msgr2=0x7f9cfc0cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.563+0000 7f9d01737700 1 --2- 172.21.15.19:0/1516103146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc0b0390 0x7f9cfc0cbcc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009910 tx=0x7f9cec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.563+0000 7f9d01737700 1 -- 172.21.15.19:0/1516103146 shutdown_connections 2024-08-17T02:29:39.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.563+0000 7f9d01737700 1 --2- 172.21.15.19:0/1516103146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc0b0390 0x7f9cfc0cbcc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.563+0000 7f9d01737700 1 -- 172.21.15.19:0/1516103146 >> 172.21.15.19:0/1516103146 conn(0x7f9cfc0cdee0 msgr2=0x7f9cfc0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.563+0000 7f9d01737700 1 -- 172.21.15.19:0/1516103146 shutdown_connections 2024-08-17T02:29:39.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.563+0000 7f9d01737700 1 -- 172.21.15.19:0/1516103146 wait complete. 2024-08-17T02:29:39.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.563+0000 7f9d01737700 1 Processor -- start 2024-08-17T02:29:39.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.563+0000 7f9d01737700 1 -- start start 2024-08-17T02:29:39.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d01737700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cfc0b0390 0x7f9cfc068c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d01737700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc15cda0 0x7f9cfc0c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d01737700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc15d920 0x7f9cfc0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d01737700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc157750 con 0x7f9cfc0b0390 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d01737700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0692f0 con 0x7f9cfc15cda0 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d01737700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0695d0 con 0x7f9cfc15d920 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cfc0b0390 0x7f9cfc068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cfc0b0390 0x7f9cfc068c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58198/0 (socket says 172.21.15.19:58198) 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfbfff700 1 -- 172.21.15.19:0/274914291 learned_addr learned my addr 172.21.15.19:0/274914291 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfb7fe700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc15cda0 0x7f9cfc0c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d00f36700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc15d920 0x7f9cfc0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfbfff700 1 -- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc15d920 msgr2=0x7f9cfc0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfbfff700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc15d920 0x7f9cfc0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfbfff700 1 -- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc15cda0 msgr2=0x7f9cfc0c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfbfff700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc15cda0 0x7f9cfc0c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfbfff700 1 -- 172.21.15.19:0/274914291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec009420 con 0x7f9cfc0b0390 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d00f36700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc15d920 0x7f9cfc0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9cfbfff700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cfc0b0390 0x7f9cfc068c00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0091e0 tx=0x7f9cec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9ce3fff700 1 -- 172.21.15.19:0/274914291 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec01cbe0 con 0x7f9cfc0b0390 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9ce3fff700 1 -- 172.21.15.19:0/274914291 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec01cd40 con 0x7f9cfc0b0390 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc0698b0 con 0x7f9cfc0b0390 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9ce3fff700 1 -- 172.21.15.19:0/274914291 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec01a6a0 con 0x7f9cfc0b0390 2024-08-17T02:29:39.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.567+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc0c56d0 con 0x7f9cfc0b0390 2024-08-17T02:29:39.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.571+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc0638f0 con 0x7f9cfc0b0390 2024-08-17T02:29:39.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.571+0000 7f9ce3fff700 1 -- 172.21.15.19:0/274914291 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9cec01aad0 con 0x7f9cfc0b0390 2024-08-17T02:29:39.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.571+0000 7f9ce3fff700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce8060860 0x7f9ce8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.571+0000 7f9ce3fff700 1 -- 172.21.15.19:0/274914291 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f9cec07ea90 con 0x7f9cfc0b0390 2024-08-17T02:29:39.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.571+0000 7f9cfb7fe700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce8060860 0x7f9ce8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.575+0000 7f9cfb7fe700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce8060860 0x7f9ce8062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc069e00 tx=0x7f9cf0000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.583+0000 7f9ce3fff700 1 -- 172.21.15.19:0/274914291 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9cec04ee60 con 0x7f9cfc0b0390 2024-08-17T02:29:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.751+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cfc0ce550 con 0x7f9cfc0b0390 2024-08-17T02:29:39.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.751+0000 7f9ce3fff700 1 -- 172.21.15.19:0/274914291 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cec052480 con 0x7f9cfc0b0390 2024-08-17T02:29:39.756 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-08-17T02:29:39.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce8060860 msgr2=0x7f9ce8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce8060860 0x7f9ce8062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc069e00 tx=0x7f9cf0000bc0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cfc0b0390 msgr2=0x7f9cfc068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cfc0b0390 0x7f9cfc068c00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0091e0 tx=0x7f9cec016000 comp rx=0 tx=0).stop 2024-08-17T02:29:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 shutdown_connections 2024-08-17T02:29:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9ce8060860 0x7f9ce8062d10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9cfc15d920 0x7f9cfc0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9cfc15cda0 0x7f9cfc0c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 --2- 172.21.15.19:0/274914291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cfc0b0390 0x7f9cfc068c00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 >> 172.21.15.19:0/274914291 conn(0x7f9cfc0cdee0 msgr2=0x7f9cfc155310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 shutdown_connections 2024-08-17T02:29:39.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.755+0000 7f9d01737700 1 -- 172.21.15.19:0/274914291 wait complete. 2024-08-17T02:29:39.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000446940.meta pg_num 2024-08-17T02:29:39.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.879+0000 7fbab1407700 1 Processor -- start 2024-08-17T02:29:39.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.879+0000 7fbab1407700 1 -- start start 2024-08-17T02:29:39.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbaac1590b0 0x7fbaac066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac159480 0x7fbaac067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaac0ce210 con 0x7fbaac0cd2b0 2024-08-17T02:29:39.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaac0cba00 con 0x7fbaac1590b0 2024-08-17T02:29:39.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0cdc90 con 0x7fbaac159480 2024-08-17T02:29:39.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab0c06700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbaac0cd2b0 0x7fbaac15ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50152/0 (socket says 172.21.15.19:50152) 2024-08-17T02:29:39.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab0c06700 1 -- 172.21.15.19:0/4153713960 learned_addr learned my addr 172.21.15.19:0/4153713960 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:39.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaabfff700 1 --2- 172.21.15.19:0/4153713960 >> v2:172.21.15.19:3300/0 conn(0x7fbaac1590b0 0x7fbaac066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaa37fe700 1 --2- 172.21.15.19:0/4153713960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac159480 0x7fbaac067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaab7fe700 1 -- 172.21.15.19:0/4153713960 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373450447 0 0) 0x7fbaac0ce210 con 0x7fbaac0cd2b0 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaab7fe700 1 -- 172.21.15.19:0/4153713960 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba98003570 con 0x7fbaac0cd2b0 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaabfff700 1 -- 172.21.15.19:0/4153713960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac159480 msgr2=0x7fbaac067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaabfff700 1 --2- 172.21.15.19:0/4153713960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac159480 0x7fbaac067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaabfff700 1 -- 172.21.15.19:0/4153713960 >> v1:172.21.15.19:6789/0 conn(0x7fbaac0cd2b0 legacy=0x7fbaac15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaab7fe700 1 -- 172.21.15.19:0/4153713960 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2844844359 0 0) 0x7fba98003570 con 0x7fbaac0cd2b0 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaabfff700 1 -- 172.21.15.19:0/4153713960 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac0cb440 con 0x7fbaac1590b0 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaabfff700 1 --2- 172.21.15.19:0/4153713960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac1590b0 0x7fbaac066e00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0098e0 tx=0x7fba9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe0de43c8c081ca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaab7fe700 1 -- 172.21.15.19:0/4153713960 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40017f0 con 0x7fbaac1590b0 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaab7fe700 1 -- 172.21.15.19:0/4153713960 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c011420 con 0x7fbaac1590b0 2024-08-17T02:29:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbaab7fe700 1 -- 172.21.15.19:0/4153713960 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0117c0 con 0x7fbaac1590b0 2024-08-17T02:29:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 -- 172.21.15.19:0/4153713960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac1590b0 msgr2=0x7fbaac066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 --2- 172.21.15.19:0/4153713960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac1590b0 0x7fbaac066e00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0098e0 tx=0x7fba9c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 -- 172.21.15.19:0/4153713960 shutdown_connections 2024-08-17T02:29:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 --2- 172.21.15.19:0/4153713960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac159480 0x7fbaac067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 --2- 172.21.15.19:0/4153713960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac1590b0 0x7fbaac066e00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 -- 172.21.15.19:0/4153713960 >> 172.21.15.19:0/4153713960 conn(0x7fbaac0d0b90 msgr2=0x7fbaac0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 -- 172.21.15.19:0/4153713960 shutdown_connections 2024-08-17T02:29:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.883+0000 7fbab1407700 1 -- 172.21.15.19:0/4153713960 wait complete. 2024-08-17T02:29:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab1407700 1 Processor -- start 2024-08-17T02:29:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab1407700 1 -- start start 2024-08-17T02:29:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab1407700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cd2b0 0x7fbaac0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab1407700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac1590b0 0x7fbaac0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab1407700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac159480 0x7fbaac154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab1407700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0b33a0 con 0x7fbaac159480 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab1407700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac15cac0 con 0x7fbaac0cd2b0 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab1407700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac1573a0 con 0x7fbaac1590b0 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab0c06700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac159480 0x7fbaac154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbaabfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cd2b0 0x7fbaac0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbaa37fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac1590b0 0x7fbaac0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab0c06700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac159480 0x7fbaac154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58216/0 (socket says 172.21.15.19:58216) 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbaa37fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac1590b0 0x7fbaac0b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:36490/0 (socket says 172.21.15.19:36490) 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab0c06700 1 -- 172.21.15.19:0/2210589753 learned_addr learned my addr 172.21.15.19:0/2210589753 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab0c06700 1 -- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac1590b0 msgr2=0x7fbaac0b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab0c06700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac1590b0 0x7fbaac0b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab0c06700 1 -- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cd2b0 msgr2=0x7fbaac0b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab0c06700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cd2b0 0x7fbaac0b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.887+0000 7fbab0c06700 1 -- 172.21.15.19:0/2210589753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c009420 con 0x7fbaac159480 2024-08-17T02:29:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.891+0000 7fbab0c06700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac159480 0x7fbaac154fb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001560 tx=0x7fbaa4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.891+0000 7fbaa8ff9700 1 -- 172.21.15.19:0/2210589753 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4004dc0 con 0x7fbaac159480 2024-08-17T02:29:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.891+0000 7fbaa8ff9700 1 -- 172.21.15.19:0/2210589753 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa400a6a0 con 0x7fbaac159480 2024-08-17T02:29:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.891+0000 7fbaa8ff9700 1 -- 172.21.15.19:0/2210589753 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa400aa60 con 0x7fbaac159480 2024-08-17T02:29:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.891+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaac157680 con 0x7fbaac159480 2024-08-17T02:29:39.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.891+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac157c40 con 0x7fbaac159480 2024-08-17T02:29:39.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.891+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaac15cce0 con 0x7fbaac159480 2024-08-17T02:29:39.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.891+0000 7fbaa8ff9700 1 -- 172.21.15.19:0/2210589753 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbaa4007150 con 0x7fbaac159480 2024-08-17T02:29:39.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.891+0000 7fbaa8ff9700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba8c060860 0x7fba8c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.895+0000 7fbaa8ff9700 1 -- 172.21.15.19:0/2210589753 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fbaa407c1d0 con 0x7fbaac159480 2024-08-17T02:29:39.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.895+0000 7fbaabfff700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba8c060860 0x7fba8c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.895+0000 7fbaabfff700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba8c060860 0x7fba8c062d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0093f0 tx=0x7fba9c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:39.899+0000 7fbaa8ff9700 1 -- 172.21.15.19:0/2210589753 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbaac15cce0 con 0x7fbaac159480 2024-08-17T02:29:40.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.071+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000446940.meta", "var": "pg_num"} v 0) v1 -- 0x7fbaac15cc80 con 0x7fbaac159480 2024-08-17T02:29:40.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.071+0000 7fbaa8ff9700 1 -- 172.21.15.19:0/2210589753 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000446940.meta", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7fbaa404c620 con 0x7fbaac159480 2024-08-17T02:29:40.075 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.071+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba8c060860 msgr2=0x7fba8c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.071+0000 7fbab1407700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba8c060860 0x7fba8c062d10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0093f0 tx=0x7fba9c016000 comp rx=0 tx=0).stop 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.071+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac159480 msgr2=0x7fbaac154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.071+0000 7fbab1407700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac159480 0x7fbaac154fb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4001560 tx=0x7fbaa4001640 comp rx=0 tx=0).stop 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.075+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 shutdown_connections 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.075+0000 7fbab1407700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fba8c060860 0x7fba8c062d10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.075+0000 7fbab1407700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaac159480 0x7fbaac154fb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.075+0000 7fbab1407700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac1590b0 0x7fbaac0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.075+0000 7fbab1407700 1 --2- 172.21.15.19:0/2210589753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cd2b0 0x7fbaac0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.075+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 >> 172.21.15.19:0/2210589753 conn(0x7fbaac0d0b90 msgr2=0x7fbaac158070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.075+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 shutdown_connections 2024-08-17T02:29:40.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.075+0000 7fbab1407700 1 -- 172.21.15.19:0/2210589753 wait complete. 2024-08-17T02:29:40.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000446940.data pg_num 2024-08-17T02:29:40.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.199+0000 7f0c64838700 1 Processor -- start 2024-08-17T02:29:40.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.199+0000 7f0c64838700 1 -- start start 2024-08-17T02:29:40.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c601590b0 0x7f0c60066e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c600cd2b0 0x7f0c60067340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c600ce210 con 0x7f0c60159480 2024-08-17T02:29:40.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c600cba00 con 0x7f0c601590b0 2024-08-17T02:29:40.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600cdc90 con 0x7f0c600cd2b0 2024-08-17T02:29:40.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c601590b0 0x7f0c60066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c601590b0 0x7f0c60066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58224/0 (socket says 172.21.15.19:58224) 2024-08-17T02:29:40.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5ed9d700 1 -- 172.21.15.19:0/3224586675 learned_addr learned my addr 172.21.15.19:0/3224586675 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:40.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5f59e700 1 --2- 172.21.15.19:0/3224586675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c600cd2b0 0x7f0c60067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5e59c700 1 -- 172.21.15.19:0/3224586675 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966848731 0 0) 0x7f0c600ce210 con 0x7f0c60159480 2024-08-17T02:29:40.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5e59c700 1 -- 172.21.15.19:0/3224586675 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c4c003570 con 0x7f0c60159480 2024-08-17T02:29:40.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5ed9d700 1 -- 172.21.15.19:0/3224586675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c600cd2b0 msgr2=0x7f0c60067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5ed9d700 1 --2- 172.21.15.19:0/3224586675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c600cd2b0 0x7f0c60067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5ed9d700 1 -- 172.21.15.19:0/3224586675 >> v1:172.21.15.119:6789/0 conn(0x7f0c60159480 legacy=0x7f0c6015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5ed9d700 1 -- 172.21.15.19:0/3224586675 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600cb440 con 0x7f0c601590b0 2024-08-17T02:29:40.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5f59e700 1 --2- 172.21.15.19:0/3224586675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c600cd2b0 0x7f0c60067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5ed9d700 1 --2- 172.21.15.19:0/3224586675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c601590b0 0x7f0c60066e00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0c500099b0 tx=0x7f0c50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a550efbbb414f576 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5e59c700 1 -- 172.21.15.19:0/3224586675 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5000b680 con 0x7f0c601590b0 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5e59c700 1 -- 172.21.15.19:0/3224586675 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5000b7e0 con 0x7f0c601590b0 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c5e59c700 1 -- 172.21.15.19:0/3224586675 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5000bb80 con 0x7f0c601590b0 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 -- 172.21.15.19:0/3224586675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c601590b0 msgr2=0x7f0c60066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 --2- 172.21.15.19:0/3224586675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c601590b0 0x7f0c60066e00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0c500099b0 tx=0x7f0c50009250 comp rx=0 tx=0).stop 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 -- 172.21.15.19:0/3224586675 shutdown_connections 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 --2- 172.21.15.19:0/3224586675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c600cd2b0 0x7f0c60067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 --2- 172.21.15.19:0/3224586675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c601590b0 0x7f0c60066e00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 -- 172.21.15.19:0/3224586675 >> 172.21.15.19:0/3224586675 conn(0x7f0c600d0b90 msgr2=0x7f0c600ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 -- 172.21.15.19:0/3224586675 shutdown_connections 2024-08-17T02:29:40.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.203+0000 7f0c64838700 1 -- 172.21.15.19:0/3224586675 wait complete. 2024-08-17T02:29:40.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.207+0000 7f0c64838700 1 Processor -- start 2024-08-17T02:29:40.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.207+0000 7f0c64838700 1 -- start start 2024-08-17T02:29:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c64838700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c600cd2b0 0x7f0c60143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c64838700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c60159480 0x7f0c600b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c64838700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c600b49f0 0x7f0c60151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c64838700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600b31c0 con 0x7f0c600b49f0 2024-08-17T02:29:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c64838700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600b4020 con 0x7f0c600cd2b0 2024-08-17T02:29:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c64838700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600b3410 con 0x7f0c60159480 2024-08-17T02:29:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5f59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c600b49f0 0x7f0c60151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5f59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c600b49f0 0x7f0c60151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58238/0 (socket says 172.21.15.19:58238) 2024-08-17T02:29:40.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5ed9d700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c600cd2b0 0x7f0c60143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5f59e700 1 -- 172.21.15.19:0/949020346 learned_addr learned my addr 172.21.15.19:0/949020346 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:40.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c57fff700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c60159480 0x7f0c600b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5f59e700 1 -- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c60159480 msgr2=0x7f0c600b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5f59e700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c60159480 0x7f0c600b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5f59e700 1 -- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c600cd2b0 msgr2=0x7f0c60143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5f59e700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c600cd2b0 0x7f0c60143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5f59e700 1 -- 172.21.15.19:0/949020346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58009a20 con 0x7f0c600b49f0 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c5f59e700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c600b49f0 0x7f0c60151ce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800c0f0 tx=0x7f0c5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c56ffd700 1 -- 172.21.15.19:0/949020346 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800cc30 con 0x7f0c600b49f0 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c56ffd700 1 -- 172.21.15.19:0/949020346 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5800f040 con 0x7f0c600b49f0 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c500094f0 con 0x7f0c600b49f0 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c56ffd700 1 -- 172.21.15.19:0/949020346 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58014480 con 0x7f0c600b49f0 2024-08-17T02:29:40.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c600b39d0 con 0x7f0c600b49f0 2024-08-17T02:29:40.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.211+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c60064330 con 0x7f0c600b49f0 2024-08-17T02:29:40.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.215+0000 7f0c56ffd700 1 -- 172.21.15.19:0/949020346 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0c58003020 con 0x7f0c600b49f0 2024-08-17T02:29:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.215+0000 7f0c56ffd700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c40060860 0x7f0c40062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.215+0000 7f0c56ffd700 1 -- 172.21.15.19:0/949020346 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f0c5807d5b0 con 0x7f0c600b49f0 2024-08-17T02:29:40.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.215+0000 7f0c5ed9d700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c40060860 0x7f0c40062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.215+0000 7f0c5ed9d700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c40060860 0x7f0c40062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c500099b0 tx=0x7f0c50017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.223+0000 7f0c56ffd700 1 -- 172.21.15.19:0/949020346 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0c5804d980 con 0x7f0c600b49f0 2024-08-17T02:29:40.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.387+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000446940.data", "var": "pg_num"} v 0) v1 -- 0x7f0c600b4160 con 0x7f0c600b49f0 2024-08-17T02:29:40.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.387+0000 7f0c56ffd700 1 -- 172.21.15.19:0/949020346 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000446940.data", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7f0c58050fa0 con 0x7f0c600b49f0 2024-08-17T02:29:40.392 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-08-17T02:29:40.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c40060860 msgr2=0x7f0c40062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c40060860 0x7f0c40062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0c500099b0 tx=0x7f0c50017000 comp rx=0 tx=0).stop 2024-08-17T02:29:40.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c600b49f0 msgr2=0x7f0c60151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c600b49f0 0x7f0c60151ce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800c0f0 tx=0x7f0c5800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:40.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 shutdown_connections 2024-08-17T02:29:40.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0c40060860 0x7f0c40062d10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c600b49f0 0x7f0c60151ce0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c60159480 0x7f0c600b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 --2- 172.21.15.19:0/949020346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c600cd2b0 0x7f0c60143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 >> 172.21.15.19:0/949020346 conn(0x7f0c600d0b90 msgr2=0x7f0c600670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 shutdown_connections 2024-08-17T02:29:40.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.391+0000 7f0c64838700 1 -- 172.21.15.19:0/949020346 wait complete. 2024-08-17T02:29:40.406 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.507+0000 7febb4750700 1 Processor -- start 2024-08-17T02:29:40.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.507+0000 7febb4750700 1 -- start start 2024-08-17T02:29:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb4750700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febac15d890 0x7febac0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb4750700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac069040 con 0x7febac068be0 2024-08-17T02:29:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb4750700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0c7890 con 0x7febac15d4c0 2024-08-17T02:29:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb4750700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c6c80 con 0x7febac15d890 2024-08-17T02:29:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb2ced700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7febac068be0 0x7febac0c7d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50164/0 (socket says 172.21.15.19:50164) 2024-08-17T02:29:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb2ced700 1 -- 172.21.15.19:0/3831716527 learned_addr learned my addr 172.21.15.19:0/3831716527 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb1ceb700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febac15d890 0x7febac0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300076544 0 0) 0x7feba4001490 con 0x7febac068be0 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb98003570 con 0x7febac068be0 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249083803 0 0) 0x7febac0c7890 con 0x7febac15d4c0 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feba4001490 con 0x7febac15d4c0 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1483149551 0 0) 0x7feb98003570 con 0x7febac068be0 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febac15d890 msgr2=0x7febac0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febac15d890 0x7febac0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 >> v1:172.21.15.119:6789/0 conn(0x7febac15d4c0 legacy=0x7febac0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0c6f60 con 0x7febac068be0 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7feba4001980 con 0x7febac068be0 2024-08-17T02:29:40.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 >> v1:172.21.15.19:6789/0 conn(0x7febac068be0 legacy=0x7febac0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb98003c20 0x7feb98004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb98004810 0x7feb98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb980051c0 0x7feb9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c6c80 con 0x7feb980051c0 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9800c0b0 con 0x7feb98004810 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9800c270 con 0x7feb98003c20 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb2ced700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb980051c0 0x7feb9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb1ceb700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb98004810 0x7feb98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb24ec700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb98003c20 0x7feb98004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb2ced700 1 -- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb98003c20 msgr2=0x7feb98004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb2ced700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb98003c20 0x7feb98004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb2ced700 1 -- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb98004810 msgr2=0x7feb98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb2ced700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb98004810 0x7feb98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb2ced700 1 -- 172.21.15.19:0/3831716527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98003570 con 0x7feb980051c0 2024-08-17T02:29:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb24ec700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb98003c20 0x7feb98004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb2ced700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb980051c0 0x7feb9800ba60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feba400aa80 tx=0x7feba400a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb41b510a0c01cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba400a410 con 0x7feb980051c0 2024-08-17T02:29:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba400c5d0 con 0x7feb980051c0 2024-08-17T02:29:40.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.511+0000 7febb14ea700 1 -- 172.21.15.19:0/3831716527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba400c990 con 0x7feb980051c0 2024-08-17T02:29:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.515+0000 7febb4750700 1 -- 172.21.15.19:0/3831716527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb980051c0 msgr2=0x7feb9800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.515+0000 7febb4750700 1 --2- 172.21.15.19:0/3831716527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb980051c0 0x7feb9800ba60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feba400aa80 tx=0x7feba400a120 comp rx=0 tx=0).stop 2024-08-17T02:29:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.515+0000 7febb2ced700 1 -- 172.21.15.19:0/3831716527 reap_dead start 2024-08-17T02:29:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.515+0000 7febb4750700 1 -- 172.21.15.19:0/3831716527 shutdown_connections 2024-08-17T02:29:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.515+0000 7febb4750700 1 -- 172.21.15.19:0/3831716527 >> 172.21.15.19:0/3831716527 conn(0x7febac0c9c20 msgr2=0x7febac06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.515+0000 7febb4750700 1 -- 172.21.15.19:0/3831716527 shutdown_connections 2024-08-17T02:29:40.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.515+0000 7febb4750700 1 -- 172.21.15.19:0/3831716527 wait complete. 2024-08-17T02:29:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.515+0000 7febb4750700 1 Processor -- start 2024-08-17T02:29:40.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.515+0000 7febb4750700 1 -- start start 2024-08-17T02:29:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb4750700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febac14b0a0 0x7febac0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb4750700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febac0c42d0 0x7febac14b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb4750700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febac1711c0 0x7febac171640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb4750700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac171b80 con 0x7febac14b0a0 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb4750700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c5350 con 0x7febac1711c0 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb4750700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c4740 con 0x7febac0c42d0 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb24ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febac14b0a0 0x7febac0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb24ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febac14b0a0 0x7febac0c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58262/0 (socket says 172.21.15.19:58262) 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb24ec700 1 -- 172.21.15.19:0/4078127623 learned_addr learned my addr 172.21.15.19:0/4078127623 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb1ceb700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febac0c42d0 0x7febac14b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb2ced700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febac1711c0 0x7febac171640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb24ec700 1 -- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febac0c42d0 msgr2=0x7febac14b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb24ec700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febac0c42d0 0x7febac14b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb24ec700 1 -- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febac1711c0 msgr2=0x7febac171640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb24ec700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febac1711c0 0x7febac171640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb24ec700 1 -- 172.21.15.19:0/4078127623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0c4a20 con 0x7febac14b0a0 2024-08-17T02:29:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb24ec700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febac14b0a0 0x7febac0c3a70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7feba800e700 tx=0x7feba8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7feba27fc700 1 -- 172.21.15.19:0/4078127623 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8006820 con 0x7febac14b0a0 2024-08-17T02:29:40.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7feba27fc700 1 -- 172.21.15.19:0/4078127623 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba8010040 con 0x7febac14b0a0 2024-08-17T02:29:40.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac0c4d00 con 0x7febac14b0a0 2024-08-17T02:29:40.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7feba27fc700 1 -- 172.21.15.19:0/4078127623 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8006b90 con 0x7febac14b0a0 2024-08-17T02:29:40.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.519+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac14b470 con 0x7febac14b0a0 2024-08-17T02:29:40.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.523+0000 7feba27fc700 1 -- 172.21.15.19:0/4078127623 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7feba8007030 con 0x7febac14b0a0 2024-08-17T02:29:40.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.523+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac0645c0 con 0x7febac14b0a0 2024-08-17T02:29:40.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.523+0000 7feba27fc700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feb90060890 0x7feb90062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.523+0000 7feba27fc700 1 -- 172.21.15.19:0/4078127623 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7feba807c340 con 0x7febac14b0a0 2024-08-17T02:29:40.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.523+0000 7febb1ceb700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feb90060890 0x7feb90062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.523+0000 7febb1ceb700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feb90060890 0x7feb90062d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7febac0c2cb0 tx=0x7feb9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.531+0000 7feba27fc700 1 -- 172.21.15.19:0/4078127623 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7feba804c720 con 0x7febac14b0a0 2024-08-17T02:29:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.731+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febac0aed00 con 0x7febac14b0a0 2024-08-17T02:29:40.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.731+0000 7feba27fc700 1 -- 172.21.15.19:0/4078127623 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4625 (secure 0 0 0) 0x7feba804fd40 con 0x7febac14b0a0 2024-08-17T02:29:40.736 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:40.736 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1578749046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1578749046},{"type":"v1","addr":"172.21.15.19:6835","nonce":1578749046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:29.433713+0000","modified":"2024-08-17T02:27:31.418434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34643":{"gid":34643,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":8,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000446940","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feb90060890 msgr2=0x7feb90062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feb90060890 0x7feb90062d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7febac0c2cb0 tx=0x7feb9c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febac14b0a0 msgr2=0x7febac0c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febac14b0a0 0x7febac0c3a70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7feba800e700 tx=0x7feba8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 shutdown_connections 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7feb90060890 0x7feb90062d40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febac1711c0 0x7febac171640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febac0c42d0 0x7febac14b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 --2- 172.21.15.19:0/4078127623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7febac14b0a0 0x7febac0c3a70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 >> 172.21.15.19:0/4078127623 conn(0x7febac0c9c20 msgr2=0x7febac0c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 shutdown_connections 2024-08-17T02:29:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.735+0000 7febb4750700 1 -- 172.21.15.19:0/4078127623 wait complete. 2024-08-17T02:29:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 19 2024-08-17T02:29:40.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:40.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.847+0000 7f3ad5602700 1 Processor -- start 2024-08-17T02:29:40.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.847+0000 7f3ad5602700 1 -- start start 2024-08-17T02:29:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.847+0000 7f3ad5602700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad0140950 0x7f3ad00ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.847+0000 7f3ad5602700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3ad00ae800 0x7f3ad00c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.847+0000 7f3ad5602700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad00b0da0 con 0x7f3ad00c95e0 2024-08-17T02:29:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.847+0000 7f3ad5602700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad00aec30 con 0x7f3ad00ae800 2024-08-17T02:29:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.847+0000 7f3ad5602700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00c9dd0 con 0x7f3ad0140950 2024-08-17T02:29:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acf7fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3ad00ae800 0x7f3ad00c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad0140950 0x7f3ad00ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad0140950 0x7f3ad00ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:36552/0 (socket says 172.21.15.19:36552) 2024-08-17T02:29:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acf7fe700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3ad00ae800 0x7f3ad00c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:51152/0 (socket says 172.21.15.19:51152) 2024-08-17T02:29:40.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acffff700 1 -- 172.21.15.19:0/933802021 learned_addr learned my addr 172.21.15.19:0/933802021 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:40.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3ad4e01700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3ad00c95e0 0x7f3ad00cca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:37528/0 (socket says 172.21.15.19:37528) 2024-08-17T02:29:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acf7fe700 1 -- 172.21.15.19:0/933802021 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad0140950 msgr2=0x7f3ad00ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acf7fe700 1 --2- 172.21.15.19:0/933802021 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad0140950 0x7f3ad00ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acf7fe700 1 -- 172.21.15.19:0/933802021 >> v1:172.21.15.119:6789/0 conn(0x7f3ad00c95e0 legacy=0x7f3ad00cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acf7fe700 1 -- 172.21.15.19:0/933802021 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00ca0b0 con 0x7f3ad00ae800 2024-08-17T02:29:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acffff700 1 --2- 172.21.15.19:0/933802021 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad0140950 0x7f3ad00ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3acf7fe700 1 --2- 172.21.15.19:0/933802021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad00ae800 0x7f3ad00c90a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40098e0 tx=0x7f3ac40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46bf3988cdb8ca1f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3aceffd700 1 -- 172.21.15.19:0/933802021 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400b640 con 0x7f3ad00ae800 2024-08-17T02:29:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3aceffd700 1 -- 172.21.15.19:0/933802021 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac400b7a0 con 0x7f3ad00ae800 2024-08-17T02:29:40.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3aceffd700 1 -- 172.21.15.19:0/933802021 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400bb40 con 0x7f3ad00ae800 2024-08-17T02:29:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3ad5602700 1 -- 172.21.15.19:0/933802021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad00ae800 msgr2=0x7f3ad00c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3ad5602700 1 --2- 172.21.15.19:0/933802021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad00ae800 0x7f3ad00c90a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40098e0 tx=0x7f3ac40091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3ad5602700 1 -- 172.21.15.19:0/933802021 shutdown_connections 2024-08-17T02:29:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3ad5602700 1 --2- 172.21.15.19:0/933802021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad00ae800 0x7f3ad00c90a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3ad5602700 1 --2- 172.21.15.19:0/933802021 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad0140950 0x7f3ad00ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3ad5602700 1 -- 172.21.15.19:0/933802021 >> 172.21.15.19:0/933802021 conn(0x7f3ad00ca900 msgr2=0x7f3ad00cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3ad5602700 1 -- 172.21.15.19:0/933802021 shutdown_connections 2024-08-17T02:29:40.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.851+0000 7f3ad5602700 1 -- 172.21.15.19:0/933802021 wait complete. 2024-08-17T02:29:40.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad5602700 1 Processor -- start 2024-08-17T02:29:40.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad5602700 1 -- start start 2024-08-17T02:29:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad5602700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad00ae800 0x7f3ad013a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad5602700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad00c95e0 0x7f3ad0138940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad5602700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad0140950 0x7f3ad0158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad5602700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad013af80 con 0x7f3ad0140950 2024-08-17T02:29:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad5602700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad013ad30 con 0x7f3ad00ae800 2024-08-17T02:29:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad5602700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00c50c0 con 0x7f3ad00c95e0 2024-08-17T02:29:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad4e01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad0140950 0x7f3ad0158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3acf7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad00c95e0 0x7f3ad0138940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad4e01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad0140950 0x7f3ad0158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58276/0 (socket says 172.21.15.19:58276) 2024-08-17T02:29:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3acffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad00ae800 0x7f3ad013a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad4e01700 1 -- 172.21.15.19:0/404742390 learned_addr learned my addr 172.21.15.19:0/404742390 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3acf7fe700 1 -- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad00ae800 msgr2=0x7f3ad013a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3acf7fe700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad00ae800 0x7f3ad013a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3acf7fe700 1 -- 172.21.15.19:0/404742390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad0140950 msgr2=0x7f3ad0158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3acf7fe700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad0140950 0x7f3ad0158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3acf7fe700 1 -- 172.21.15.19:0/404742390 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac00094f0 con 0x7f3ad00c95e0 2024-08-17T02:29:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3ad4e01700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad0140950 0x7f3ad0158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.855+0000 7f3acf7fe700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad00c95e0 0x7f3ad0138940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4016000 tx=0x7f3ac4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3ab7fff700 1 -- 172.21.15.19:0/404742390 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac401bc40 con 0x7f3ad00c95e0 2024-08-17T02:29:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3ab7fff700 1 -- 172.21.15.19:0/404742390 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac401bde0 con 0x7f3ad00c95e0 2024-08-17T02:29:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac4009420 con 0x7f3ad00c95e0 2024-08-17T02:29:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3ab7fff700 1 -- 172.21.15.19:0/404742390 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4011670 con 0x7f3ad00c95e0 2024-08-17T02:29:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad00c5680 con 0x7f3ad00c95e0 2024-08-17T02:29:40.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad00643a0 con 0x7f3ad00c95e0 2024-08-17T02:29:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3ab7fff700 1 -- 172.21.15.19:0/404742390 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3ac40119e0 con 0x7f3ad00c95e0 2024-08-17T02:29:40.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3ab7fff700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3abc060860 0x7f3abc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3ab7fff700 1 -- 172.21.15.19:0/404742390 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f3ac407e1c0 con 0x7f3ad00c95e0 2024-08-17T02:29:40.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.859+0000 7f3acffff700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3abc060860 0x7f3abc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.863+0000 7f3acffff700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3abc060860 0x7f3abc062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0006d20 tx=0x7f3ac0009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:40.871+0000 7f3ab7fff700 1 -- 172.21.15.19:0/404742390 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3ac404e4f0 con 0x7f3ad00c95e0 2024-08-17T02:29:41.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.035+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ad00681a0 con 0x7f3ad00c95e0 2024-08-17T02:29:41.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.035+0000 7f3ab7fff700 1 -- 172.21.15.19:0/404742390 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15510 (secure 0 0 0) 0x7f3ac4051b10 con 0x7f3ad00c95e0 2024-08-17T02:29:41.041 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:41.042 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:29:39.093371+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000446940.meta","create_time":"2024-08-17T02:27:28.354322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000446940"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000446940.data","create_time":"2024-08-17T02:27:28.449086+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000446940"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/363347157":"2024-08-18T02:29:36.079948+0000","172.21.15.19:6834/363347157":"2024-08-18T02:29:36.079948+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3abc060860 msgr2=0x7f3abc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3abc060860 0x7f3abc062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0006d20 tx=0x7f3ac0009250 comp rx=0 tx=0).stop 2024-08-17T02:29:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad00c95e0 msgr2=0x7f3ad0138940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad00c95e0 0x7f3ad0138940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4016000 tx=0x7f3ac4017000 comp rx=0 tx=0).stop 2024-08-17T02:29:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 shutdown_connections 2024-08-17T02:29:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3abc060860 0x7f3abc062d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad0140950 0x7f3ad0158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ad00c95e0 0x7f3ad0138940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 --2- 172.21.15.19:0/404742390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad00ae800 0x7f3ad013a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 >> 172.21.15.19:0/404742390 conn(0x7f3ad00ca900 msgr2=0x7f3ad00cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 shutdown_connections 2024-08-17T02:29:41.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.039+0000 7f3ad5602700 1 -- 172.21.15.19:0/404742390 wait complete. 2024-08-17T02:29:41.056 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000446940 and related pools 2024-08-17T02:29:41.056 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:41.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec92523700 1 Processor -- start 2024-08-17T02:29:41.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec92523700 1 -- start start 2024-08-17T02:29:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec92523700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec8c0ace80 0x7fec8c157350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec92523700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fec8c157890 0x7fec8c0aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec92523700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c0adf50 con 0x7fec8c156f80 2024-08-17T02:29:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec92523700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8c0ad340 con 0x7fec8c0ace80 2024-08-17T02:29:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec92523700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8c0ad620 con 0x7fec8c157890 2024-08-17T02:29:41.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec8c0ace80 0x7fec8c157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec8c0ace80 0x7fec8c157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58278/0 (socket says 172.21.15.19:58278) 2024-08-17T02:29:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8b7fe700 1 -- 172.21.15.19:0/4089428798 learned_addr learned my addr 172.21.15.19:0/4089428798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:41.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec90ac0700 1 --2- 172.21.15.19:0/4089428798 >> v2:172.21.15.119:3300/0 conn(0x7fec8c157890 0x7fec8c0aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8b7fe700 1 -- 172.21.15.19:0/4089428798 >> v2:172.21.15.119:3300/0 conn(0x7fec8c157890 msgr2=0x7fec8c0aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8b7fe700 1 --2- 172.21.15.19:0/4089428798 >> v2:172.21.15.119:3300/0 conn(0x7fec8c157890 0x7fec8c0aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8b7fe700 1 -- 172.21.15.19:0/4089428798 >> v1:172.21.15.119:6789/0 conn(0x7fec8c156f80 legacy=0x7fec8c0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8b7fe700 1 -- 172.21.15.19:0/4089428798 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c0ad900 con 0x7fec8c0ace80 2024-08-17T02:29:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8b7fe700 1 --2- 172.21.15.19:0/4089428798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c0ace80 0x7fec8c157350 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0099b0 tx=0x7fec7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d1c583f0b7c8d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8affd700 1 -- 172.21.15.19:0/4089428798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c009ea0 con 0x7fec8c0ace80 2024-08-17T02:29:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8affd700 1 -- 172.21.15.19:0/4089428798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c00b820 con 0x7fec8c0ace80 2024-08-17T02:29:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.159+0000 7fec8affd700 1 -- 172.21.15.19:0/4089428798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00bbc0 con 0x7fec8c0ace80 2024-08-17T02:29:41.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 -- 172.21.15.19:0/4089428798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c0ace80 msgr2=0x7fec8c157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 --2- 172.21.15.19:0/4089428798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c0ace80 0x7fec8c157350 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0099b0 tx=0x7fec7c009250 comp rx=0 tx=0).stop 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 -- 172.21.15.19:0/4089428798 shutdown_connections 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 --2- 172.21.15.19:0/4089428798 >> v2:172.21.15.119:3300/0 conn(0x7fec8c157890 0x7fec8c0aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 --2- 172.21.15.19:0/4089428798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c0ace80 0x7fec8c157350 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 -- 172.21.15.19:0/4089428798 >> 172.21.15.19:0/4089428798 conn(0x7fec8c066e00 msgr2=0x7fec8c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 -- 172.21.15.19:0/4089428798 shutdown_connections 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 -- 172.21.15.19:0/4089428798 wait complete. 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 Processor -- start 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 -- start start 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec8c0ace80 0x7fec8c0979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c156f80 0x7fec8c0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec8c157890 0x7fec8c16c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0988f0 con 0x7fec8c156f80 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0aefe0 con 0x7fec8c157890 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec92523700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0b0d20 con 0x7fec8c0ace80 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c156f80 0x7fec8c0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c156f80 0x7fec8c0b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58292/0 (socket says 172.21.15.19:58292) 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8b7fe700 1 -- 172.21.15.19:0/418284521 learned_addr learned my addr 172.21.15.19:0/418284521 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec90ac0700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec8c157890 0x7fec8c16c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8bfff700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec8c0ace80 0x7fec8c0979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8b7fe700 1 -- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec8c0ace80 msgr2=0x7fec8c0979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8b7fe700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec8c0ace80 0x7fec8c0979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8b7fe700 1 -- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec8c157890 msgr2=0x7fec8c16c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8b7fe700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec8c157890 0x7fec8c16c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8b7fe700 1 -- 172.21.15.19:0/418284521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0094f0 con 0x7fec8c156f80 2024-08-17T02:29:41.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec8b7fe700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c156f80 0x7fec8c0b07e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fec8c06f870 tx=0x7fec7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec73fff700 1 -- 172.21.15.19:0/418284521 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00bba0 con 0x7fec8c156f80 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec73fff700 1 -- 172.21.15.19:0/418284521 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c011420 con 0x7fec8c156f80 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.163+0000 7fec73fff700 1 -- 172.21.15.19:0/418284521 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0117e0 con 0x7fec8c156f80 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.167+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c16cd70 con 0x7fec8c156f80 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.167+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c098330 con 0x7fec8c156f80 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.167+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c0af170 con 0x7fec8c156f80 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.167+0000 7fec73fff700 1 -- 172.21.15.19:0/418284521 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fec7c011b50 con 0x7fec8c156f80 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.167+0000 7fec73fff700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec78060890 0x7fec78062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.167+0000 7fec73fff700 1 -- 172.21.15.19:0/418284521 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fec7c07e170 con 0x7fec8c156f80 2024-08-17T02:29:41.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.167+0000 7fec8bfff700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec78060890 0x7fec78062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.171+0000 7fec8bfff700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec78060890 0x7fec78062d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0aa910 tx=0x7fec80009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.179+0000 7fec73fff700 1 -- 172.21.15.19:0/418284521 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fec7c04e520 con 0x7fec8c156f80 2024-08-17T02:29:41.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.375+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec8c0645c0 con 0x7fec8c156f80 2024-08-17T02:29:41.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.375+0000 7fec73fff700 1 -- 172.21.15.19:0/418284521 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4625 (secure 0 0 0) 0x7fec7c051b40 con 0x7fec8c156f80 2024-08-17T02:29:41.380 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:41.380 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1578749046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1578749046},{"type":"v1","addr":"172.21.15.19:6835","nonce":1578749046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:29.433713+0000","modified":"2024-08-17T02:27:31.418434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34643":{"gid":34643,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":8,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000446940","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec78060890 msgr2=0x7fec78062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec78060890 0x7fec78062d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0aa910 tx=0x7fec80009040 comp rx=0 tx=0).stop 2024-08-17T02:29:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c156f80 msgr2=0x7fec8c0b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c156f80 0x7fec8c0b07e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fec8c06f870 tx=0x7fec7c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 shutdown_connections 2024-08-17T02:29:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fec78060890 0x7fec78062d40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec8c157890 0x7fec8c16c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c156f80 0x7fec8c0b07e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 --2- 172.21.15.19:0/418284521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec8c0ace80 0x7fec8c0979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 >> 172.21.15.19:0/418284521 conn(0x7fec8c066e00 msgr2=0x7fec8c06afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 shutdown_connections 2024-08-17T02:29:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.379+0000 7fec92523700 1 -- 172.21.15.19:0/418284521 wait complete. 2024-08-17T02:29:41.384 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 19 2024-08-17T02:29:41.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:41.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88591a3700 1 Processor -- start 2024-08-17T02:29:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88591a3700 1 -- start start 2024-08-17T02:29:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88591a3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f88540688d0 0x7f8854068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88591a3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8854159200 0x7f88540a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88591a3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88540aa300 con 0x7f88540a9860 2024-08-17T02:29:41.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88591a3700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88540ac3b0 con 0x7f88540688d0 2024-08-17T02:29:41.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88591a3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88540aa5e0 con 0x7f8854159200 2024-08-17T02:29:41.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f884bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f88540a9860 0x7f8854158af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50168/0 (socket says 172.21.15.19:50168) 2024-08-17T02:29:41.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f884bfff700 1 -- 172.21.15.19:0/2173464586 learned_addr learned my addr 172.21.15.19:0/2173464586 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:41.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f8853fff700 1 --2- 172.21.15.19:0/2173464586 >> v2:172.21.15.119:3300/0 conn(0x7f88540688d0 0x7f8854068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88589a2700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8854159200 0x7f88540a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145147367 0 0) 0x7f88540aa300 con 0x7f88540a9860 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8840003570 con 0x7f88540a9860 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393227209 0 0) 0x7f8840003570 con 0x7f88540a9860 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8854159200 msgr2=0x7f88540a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8854159200 0x7f88540a9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 >> v2:172.21.15.119:3300/0 conn(0x7f88540688d0 msgr2=0x7f8854068ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 --2- 172.21.15.19:0/2173464586 >> v2:172.21.15.119:3300/0 conn(0x7f88540688d0 0x7f8854068ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540aa8c0 con 0x7f88540a9860 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f883c001470 con 0x7f88540a9860 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88589a2700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8854159200 0x7f88540a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:41.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 >> v1:172.21.15.19:6789/0 conn(0x7f88540a9860 legacy=0x7f8854158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8854159200 0x7f8840003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840003fa0 0x7f8840004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8840004d50 0x7f88400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88540ac3b0 con 0x7f8840004d50 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88540aa5e0 con 0x7f8840003fa0 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.503+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884000bb10 con 0x7f8854159200 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88589a2700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8840004d50 0x7f88400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f8853fff700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8854159200 0x7f8840003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f884bfff700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840003fa0 0x7f8840004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88589a2700 1 -- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8854159200 msgr2=0x7f8840003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88589a2700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8854159200 0x7f8840003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88589a2700 1 -- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840003fa0 msgr2=0x7f8840004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88589a2700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8840003fa0 0x7f8840004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88589a2700 1 -- 172.21.15.19:0/2173464586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840003570 con 0x7f8840004d50 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88589a2700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8840004d50 0x7f88400051c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f884c007550 tx=0x7f884c0097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892928d4b5cce329 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c009ae0 con 0x7f8840004d50 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c007da0 con 0x7f8840004d50 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88537fe700 1 -- 172.21.15.19:0/2173464586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c014630 con 0x7f8840004d50 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88591a3700 1 -- 172.21.15.19:0/2173464586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8840004d50 msgr2=0x7f88400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88591a3700 1 --2- 172.21.15.19:0/2173464586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8840004d50 0x7f88400051c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f884c007550 tx=0x7f884c0097d0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88589a2700 1 -- 172.21.15.19:0/2173464586 reap_dead start 2024-08-17T02:29:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88591a3700 1 -- 172.21.15.19:0/2173464586 shutdown_connections 2024-08-17T02:29:41.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88591a3700 1 -- 172.21.15.19:0/2173464586 >> 172.21.15.19:0/2173464586 conn(0x7f885406d790 msgr2=0x7f885406db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88591a3700 1 -- 172.21.15.19:0/2173464586 shutdown_connections 2024-08-17T02:29:41.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88591a3700 1 -- 172.21.15.19:0/2173464586 wait complete. 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88591a3700 1 Processor -- start 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.507+0000 7f88591a3700 1 -- start start 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f88591a3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88540ca100 0x7f88540b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f88591a3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8854169170 0x7f88540b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f88591a3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88540ca4d0 0x7f88540ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f88591a3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885414efa0 con 0x7f88540ca100 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f88591a3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88540c89c0 con 0x7f8854169170 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f88591a3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88540b1940 con 0x7f88540ca4d0 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f8853fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88540ca100 0x7f88540b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f884bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8854169170 0x7f88540b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f884bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8854169170 0x7f88540b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:51194/0 (socket says 172.21.15.19:51194) 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f884bfff700 1 -- 172.21.15.19:0/585863316 learned_addr learned my addr 172.21.15.19:0/585863316 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f88589a2700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88540ca4d0 0x7f88540ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f884bfff700 1 -- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88540ca4d0 msgr2=0x7f88540ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f884bfff700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88540ca4d0 0x7f88540ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f884bfff700 1 -- 172.21.15.19:0/585863316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88540ca100 msgr2=0x7f88540b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f884bfff700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88540ca100 0x7f88540b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f884bfff700 1 -- 172.21.15.19:0/585863316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540b1c20 con 0x7f8854169170 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f8853fff700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88540ca100 0x7f88540b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f884bfff700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8854169170 0x7f88540b1310 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f883c001050 tx=0x7f883c000d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f8850ff9700 1 -- 172.21.15.19:0/585863316 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00a760 con 0x7f8854169170 2024-08-17T02:29:41.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f8850ff9700 1 -- 172.21.15.19:0/585863316 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c010040 con 0x7f8854169170 2024-08-17T02:29:41.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88540b1f00 con 0x7f8854169170 2024-08-17T02:29:41.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f8850ff9700 1 -- 172.21.15.19:0/585863316 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00ab10 con 0x7f8854169170 2024-08-17T02:29:41.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.511+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88540caeb0 con 0x7f8854169170 2024-08-17T02:29:41.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.515+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885414f3d0 con 0x7f8854169170 2024-08-17T02:29:41.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.515+0000 7f8850ff9700 1 -- 172.21.15.19:0/585863316 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f883c013390 con 0x7f8854169170 2024-08-17T02:29:41.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.515+0000 7f8850ff9700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8834060890 0x7f8834062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.515+0000 7f8850ff9700 1 -- 172.21.15.19:0/585863316 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f883c07bea0 con 0x7f8854169170 2024-08-17T02:29:41.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.515+0000 7f8853fff700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8834060890 0x7f8834062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.515+0000 7f8853fff700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8834060890 0x7f8834062d40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8844009fd0 tx=0x7f8844008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.527+0000 7f8850ff9700 1 -- 172.21.15.19:0/585863316 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f883c04c270 con 0x7f8854169170 2024-08-17T02:29:41.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.731+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88540643a0 con 0x7f8854169170 2024-08-17T02:29:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.731+0000 7f8850ff9700 1 -- 172.21.15.19:0/585863316 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4625 (secure 0 0 0) 0x7f883c019020 con 0x7f8854169170 2024-08-17T02:29:41.736 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:41.736 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1578749046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1578749046},{"type":"v1","addr":"172.21.15.19:6835","nonce":1578749046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:29.433713+0000","modified":"2024-08-17T02:27:31.418434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34643":{"gid":34643,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":8,"addr":"172.21.15.119:6837/1526281711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1526281711},{"type":"v1","addr":"172.21.15.119:6837","nonce":1526281711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000446940","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:41.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8834060890 msgr2=0x7f8834062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8834060890 0x7f8834062d40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8844009fd0 tx=0x7f8844008040 comp rx=0 tx=0).stop 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8854169170 msgr2=0x7f88540b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8854169170 0x7f88540b1310 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f883c001050 tx=0x7f883c000d70 comp rx=0 tx=0).stop 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 shutdown_connections 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8834060890 0x7f8834062d40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88540ca4d0 0x7f88540ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8854169170 0x7f88540b1310 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 --2- 172.21.15.19:0/585863316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88540ca100 0x7f88540b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 >> 172.21.15.19:0/585863316 conn(0x7f885406d790 msgr2=0x7f8854067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 shutdown_connections 2024-08-17T02:29:41.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.735+0000 7f88591a3700 1 -- 172.21.15.19:0/585863316 wait complete. 2024-08-17T02:29:41.740 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 19 2024-08-17T02:29:41.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:41.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ef59e700 1 Processor -- start 2024-08-17T02:29:41.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ef59e700 1 -- start start 2024-08-17T02:29:41.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ef59e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39f00ae2c0 0x7f39f00af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ef59e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39f015cea0 0x7f39f015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ef59e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f00ca4c0 con 0x7f39f00aef40 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ef59e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f00c95d0 con 0x7f39f015cea0 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ef59e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f00c98b0 con 0x7f39f00ae2c0 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ee59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f39f00aef40 0x7f39f00adbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50176/0 (socket says 172.21.15.19:50176) 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ee59c700 1 -- 172.21.15.19:0/342621977 learned_addr learned my addr 172.21.15.19:0/342621977 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39eed9d700 1 --2- 172.21.15.19:0/342621977 >> v2:172.21.15.19:3300/0 conn(0x7f39f015cea0 0x7f39f015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39edd9b700 1 --2- 172.21.15.19:0/342621977 >> v2:172.21.15.119:3300/0 conn(0x7f39f00ae2c0 0x7f39f00af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ed59a700 1 -- 172.21.15.19:0/342621977 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347020341 0 0) 0x7f39f00ca4c0 con 0x7f39f00aef40 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ed59a700 1 -- 172.21.15.19:0/342621977 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39dc003570 con 0x7f39f00aef40 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ed59a700 1 -- 172.21.15.19:0/342621977 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1663167020 0 0) 0x7f39dc003570 con 0x7f39f00aef40 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39eed9d700 1 -- 172.21.15.19:0/342621977 >> v2:172.21.15.119:3300/0 conn(0x7f39f00ae2c0 msgr2=0x7f39f00af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39eed9d700 1 --2- 172.21.15.19:0/342621977 >> v2:172.21.15.119:3300/0 conn(0x7f39f00ae2c0 0x7f39f00af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39eed9d700 1 -- 172.21.15.19:0/342621977 >> v1:172.21.15.19:6789/0 conn(0x7f39f00aef40 legacy=0x7f39f00adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39eed9d700 1 -- 172.21.15.19:0/342621977 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00c9b90 con 0x7f39f015cea0 2024-08-17T02:29:41.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39edd9b700 1 --2- 172.21.15.19:0/342621977 >> v2:172.21.15.119:3300/0 conn(0x7f39f00ae2c0 0x7f39f00af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:41.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39eed9d700 1 --2- 172.21.15.19:0/342621977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f015cea0 0x7f39f015d320 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f39f006d4c0 tx=0x7f39e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95a6b2938fbafc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ed59a700 1 -- 172.21.15.19:0/342621977 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8001470 con 0x7f39f015cea0 2024-08-17T02:29:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ed59a700 1 -- 172.21.15.19:0/342621977 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e0011420 con 0x7f39f015cea0 2024-08-17T02:29:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.855+0000 7f39ed59a700 1 -- 172.21.15.19:0/342621977 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e00117a0 con 0x7f39f015cea0 2024-08-17T02:29:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 -- 172.21.15.19:0/342621977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f015cea0 msgr2=0x7f39f015d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 --2- 172.21.15.19:0/342621977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f015cea0 0x7f39f015d320 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f39f006d4c0 tx=0x7f39e00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 -- 172.21.15.19:0/342621977 shutdown_connections 2024-08-17T02:29:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 --2- 172.21.15.19:0/342621977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f015cea0 0x7f39f015d320 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 --2- 172.21.15.19:0/342621977 >> v2:172.21.15.119:3300/0 conn(0x7f39f00ae2c0 0x7f39f00af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 -- 172.21.15.19:0/342621977 >> 172.21.15.19:0/342621977 conn(0x7f39f006e070 msgr2=0x7f39f00b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 -- 172.21.15.19:0/342621977 shutdown_connections 2024-08-17T02:29:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 -- 172.21.15.19:0/342621977 wait complete. 2024-08-17T02:29:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 Processor -- start 2024-08-17T02:29:41.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 -- start start 2024-08-17T02:29:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.859+0000 7f39ef59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f00ae2c0 0x7f39f0154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ef59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39f00aef40 0x7f39f0157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ef59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39f015cea0 0x7f39f01551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ef59e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0068a00 con 0x7f39f00ae2c0 2024-08-17T02:29:41.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ef59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0157470 con 0x7f39f00aef40 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ef59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f015c840 con 0x7f39f015cea0 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ee59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f00ae2c0 0x7f39f0154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ee59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f00ae2c0 0x7f39f0154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58324/0 (socket says 172.21.15.19:58324) 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ee59c700 1 -- 172.21.15.19:0/3744588191 learned_addr learned my addr 172.21.15.19:0/3744588191 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39edd9b700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39f00aef40 0x7f39f0157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39eed9d700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39f015cea0 0x7f39f01551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ee59c700 1 -- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39f015cea0 msgr2=0x7f39f01551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ee59c700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39f015cea0 0x7f39f01551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ee59c700 1 -- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39f00aef40 msgr2=0x7f39f0157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ee59c700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39f00aef40 0x7f39f0157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ee59c700 1 -- 172.21.15.19:0/3744588191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8009a20 con 0x7f39f00ae2c0 2024-08-17T02:29:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ee59c700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f00ae2c0 0x7f39f0154790 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f39d800cbc0 tx=0x7f39d8001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39e67fc700 1 -- 172.21.15.19:0/3744588191 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8007150 con 0x7f39f00ae2c0 2024-08-17T02:29:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39e67fc700 1 -- 172.21.15.19:0/3744588191 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d80072d0 con 0x7f39f00ae2c0 2024-08-17T02:29:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39e67fc700 1 -- 172.21.15.19:0/3744588191 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8007690 con 0x7f39f00ae2c0 2024-08-17T02:29:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e0009420 con 0x7f39f00ae2c0 2024-08-17T02:29:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f015c280 con 0x7f39f00ae2c0 2024-08-17T02:29:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f015c0e0 con 0x7f39f00ae2c0 2024-08-17T02:29:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39e67fc700 1 -- 172.21.15.19:0/3744588191 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f39d8004a40 con 0x7f39f00ae2c0 2024-08-17T02:29:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39e67fc700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39d0060860 0x7f39d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.863+0000 7f39e67fc700 1 -- 172.21.15.19:0/3744588191 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f39d807c440 con 0x7f39f00ae2c0 2024-08-17T02:29:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.867+0000 7f39edd9b700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39d0060860 0x7f39d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.867+0000 7f39edd9b700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39d0060860 0x7f39d0062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009fd0 tx=0x7f39e800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:41.871+0000 7f39e67fc700 1 -- 172.21.15.19:0/3744588191 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f39f015c0e0 con 0x7f39f00ae2c0 2024-08-17T02:29:42.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.035+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39f015c0e0 con 0x7f39f00ae2c0 2024-08-17T02:29:42.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39e67fc700 1 -- 172.21.15.19:0/3744588191 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15510 (secure 0 0 0) 0x7f39f015c0e0 con 0x7f39f00ae2c0 2024-08-17T02:29:42.042 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:42.042 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:29:39.093371+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000446940.meta","create_time":"2024-08-17T02:27:28.354322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000446940"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000446940.data","create_time":"2024-08-17T02:27:28.449086+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000446940"}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6835/363347157":"2024-08-18T02:29:36.079948+0000","172.21.15.19:6834/363347157":"2024-08-18T02:29:36.079948+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39d0060860 msgr2=0x7f39d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39d0060860 0x7f39d0062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009fd0 tx=0x7f39e800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f00ae2c0 msgr2=0x7f39f0154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f00ae2c0 0x7f39f0154790 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f39d800cbc0 tx=0x7f39d8001ad0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 shutdown_connections 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f39d0060860 0x7f39d0062d10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39f015cea0 0x7f39f01551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39f00aef40 0x7f39f0157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 --2- 172.21.15.19:0/3744588191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39f00ae2c0 0x7f39f0154790 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 >> 172.21.15.19:0/3744588191 conn(0x7f39f006e070 msgr2=0x7f39f00b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 shutdown_connections 2024-08-17T02:29:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.039+0000 7f39ef59e700 1 -- 172.21.15.19:0/3744588191 wait complete. 2024-08-17T02:29:42.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000446940 2024-08-17T02:29:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94be8c7700 1 Processor -- start 2024-08-17T02:29:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94be8c7700 1 -- start start 2024-08-17T02:29:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94be8c7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94b8155de0 0x7f94b80ab030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94be8c7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b81561b0 0x7f94b80c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94be8c7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80c9410 con 0x7f94b80c75e0 2024-08-17T02:29:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94be8c7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80ac3e0 con 0x7f94b8155de0 2024-08-17T02:29:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94be8c7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80c7e30 con 0x7f94b81561b0 2024-08-17T02:29:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94b8155de0 0x7f94b80ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94bce64700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f94b80c75e0 0x7f94b80cbb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50188/0 (socket says 172.21.15.19:50188) 2024-08-17T02:29:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94b8155de0 0x7f94b80ab030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58332/0 (socket says 172.21.15.19:58332) 2024-08-17T02:29:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94bce64700 1 -- 172.21.15.19:0/1118141612 learned_addr learned my addr 172.21.15.19:0/1118141612 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b77fe700 1 --2- 172.21.15.19:0/1118141612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b81561b0 0x7f94b80c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b7fff700 1 -- 172.21.15.19:0/1118141612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b81561b0 msgr2=0x7f94b80c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b7fff700 1 --2- 172.21.15.19:0/1118141612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b81561b0 0x7f94b80c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b7fff700 1 -- 172.21.15.19:0/1118141612 >> v1:172.21.15.19:6789/0 conn(0x7f94b80c75e0 legacy=0x7f94b80cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b7fff700 1 -- 172.21.15.19:0/1118141612 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80c8110 con 0x7f94b8155de0 2024-08-17T02:29:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b7fff700 1 --2- 172.21.15.19:0/1118141612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 0x7f94b80ab030 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009e60 tx=0x7f94a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6094d68e150e9dc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b6ffd700 1 -- 172.21.15.19:0/1118141612 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a800e070 con 0x7f94b8155de0 2024-08-17T02:29:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b6ffd700 1 -- 172.21.15.19:0/1118141612 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a800bb60 con 0x7f94b8155de0 2024-08-17T02:29:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.167+0000 7f94b6ffd700 1 -- 172.21.15.19:0/1118141612 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8012430 con 0x7f94b8155de0 2024-08-17T02:29:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 -- 172.21.15.19:0/1118141612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 msgr2=0x7f94b80ab030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 --2- 172.21.15.19:0/1118141612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 0x7f94b80ab030 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009e60 tx=0x7f94a8009780 comp rx=0 tx=0).stop 2024-08-17T02:29:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 -- 172.21.15.19:0/1118141612 shutdown_connections 2024-08-17T02:29:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 --2- 172.21.15.19:0/1118141612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b81561b0 0x7f94b80c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 --2- 172.21.15.19:0/1118141612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 0x7f94b80ab030 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 -- 172.21.15.19:0/1118141612 >> 172.21.15.19:0/1118141612 conn(0x7f94b806e210 msgr2=0x7f94b806e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 -- 172.21.15.19:0/1118141612 shutdown_connections 2024-08-17T02:29:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 -- 172.21.15.19:0/1118141612 wait complete. 2024-08-17T02:29:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 Processor -- start 2024-08-17T02:29:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 -- start start 2024-08-17T02:29:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80c75e0 0x7f94b8152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 0x7f94b809a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b81561b0 0x7f94b80aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8097380 con 0x7f94b8155de0 2024-08-17T02:29:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8097ec0 con 0x7f94b81561b0 2024-08-17T02:29:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94be8c7700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8098350 con 0x7f94b80c75e0 2024-08-17T02:29:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94b77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 0x7f94b809a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94b7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80c75e0 0x7f94b8152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94b7fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80c75e0 0x7f94b8152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:36634/0 (socket says 172.21.15.19:36634) 2024-08-17T02:29:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94b7fff700 1 -- 172.21.15.19:0/3138121931 learned_addr learned my addr 172.21.15.19:0/3138121931 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94b77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 0x7f94b809a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58344/0 (socket says 172.21.15.19:58344) 2024-08-17T02:29:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.171+0000 7f94bce64700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b81561b0 0x7f94b80aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94b7fff700 1 -- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b81561b0 msgr2=0x7f94b80aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94b7fff700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b81561b0 0x7f94b80aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94b7fff700 1 -- 172.21.15.19:0/3138121931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 msgr2=0x7f94b809a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94b7fff700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 0x7f94b809a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94b7fff700 1 -- 172.21.15.19:0/3138121931 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8009a20 con 0x7f94b80c75e0 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94bce64700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b81561b0 0x7f94b80aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94b77fe700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 0x7f94b809a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94b7fff700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80c75e0 0x7f94b8152dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94a80097c0 tx=0x7f94a8019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94affff700 1 -- 172.21.15.19:0/3138121931 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8012c40 con 0x7f94b80c75e0 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94affff700 1 -- 172.21.15.19:0/3138121931 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a8012da0 con 0x7f94b80c75e0 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b8097590 con 0x7f94b80c75e0 2024-08-17T02:29:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94affff700 1 -- 172.21.15.19:0/3138121931 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80276c0 con 0x7f94b80c75e0 2024-08-17T02:29:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b8097b50 con 0x7f94b80c75e0 2024-08-17T02:29:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b80645c0 con 0x7f94b80c75e0 2024-08-17T02:29:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94affff700 1 -- 172.21.15.19:0/3138121931 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f94a8024070 con 0x7f94b80c75e0 2024-08-17T02:29:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.175+0000 7f94affff700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9498060860 0x7f9498062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.179+0000 7f94affff700 1 -- 172.21.15.19:0/3138121931 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f94a807f130 con 0x7f94b80c75e0 2024-08-17T02:29:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.179+0000 7f94b77fe700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9498060860 0x7f9498062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.179+0000 7f94b77fe700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9498060860 0x7f9498062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94b80c2330 tx=0x7f94a00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.187+0000 7f94affff700 1 -- 172.21.15.19:0/3138121931 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f94a804f500 con 0x7f94b80c75e0 2024-08-17T02:29:42.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.387+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000446940"} v 0) v1 -- 0x7f94b806f490 con 0x7f94b80c75e0 2024-08-17T02:29:42.395 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-08-17T02:29:42.391+0000 7fcb8c4f8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:42.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.403+0000 7f94affff700 1 -- 172.21.15.19:0/3138121931 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000446940"}]=0 volume_0000000000446940 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 195+0+0 (secure 0 0 0) 0x7f94a8052b20 con 0x7f94b80c75e0 2024-08-17T02:29:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9498060860 msgr2=0x7f9498062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9498060860 0x7f9498062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94b80c2330 tx=0x7f94a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80c75e0 msgr2=0x7f94b8152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80c75e0 0x7f94b8152dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94a80097c0 tx=0x7f94a8019000 comp rx=0 tx=0).stop 2024-08-17T02:29:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 shutdown_connections 2024-08-17T02:29:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f9498060860 0x7f9498062d10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b81561b0 0x7f94b80aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b8155de0 0x7f94b809a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 --2- 172.21.15.19:0/3138121931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80c75e0 0x7f94b8152dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 >> 172.21.15.19:0/3138121931 conn(0x7f94b806e210 msgr2=0x7f94b80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 shutdown_connections 2024-08-17T02:29:42.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.407+0000 7f94be8c7700 1 -- 172.21.15.19:0/3138121931 wait complete. 2024-08-17T02:29:42.412 INFO:teuthology.orchestra.run.smithi019.stderr:volume_0000000000446940 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:42.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000446940 --yes-i-really-mean-it 2024-08-17T02:29:42.434 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2024-08-17T02:29:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8ffff700 1 Processor -- start 2024-08-17T02:29:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8ffff700 1 -- start start 2024-08-17T02:29:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9006e720 0x7fca900aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8ffff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900b0810 con 0x7fca9013fa50 2024-08-17T02:29:42.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8ffff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900afc70 con 0x7fca9013f680 2024-08-17T02:29:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8ffff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca900af060 con 0x7fca9006e720 2024-08-17T02:29:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca867fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fca9013fa50 0x7fca9006e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50194/0 (socket says 172.21.15.19:50194) 2024-08-17T02:29:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca867fc700 1 -- 172.21.15.19:0/254351839 learned_addr learned my addr 172.21.15.19:0/254351839 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:42.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8f7fe700 1 --2- 172.21.15.19:0/254351839 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9006e720 0x7fca900aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8e7fc700 1 -- 172.21.15.19:0/254351839 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536343482 0 0) 0x7fca900b0810 con 0x7fca9013fa50 2024-08-17T02:29:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8e7fc700 1 -- 172.21.15.19:0/254351839 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca70003570 con 0x7fca9013fa50 2024-08-17T02:29:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8e7fc700 1 -- 172.21.15.19:0/254351839 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235637866 0 0) 0x7fca900afc70 con 0x7fca9013f680 2024-08-17T02:29:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8e7fc700 1 -- 172.21.15.19:0/254351839 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca900b0810 con 0x7fca9013f680 2024-08-17T02:29:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8f7fe700 1 -- 172.21.15.19:0/254351839 >> v1:172.21.15.119:6789/0 conn(0x7fca9013f680 legacy=0x7fca900b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8e7fc700 1 -- 172.21.15.19:0/254351839 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2528530636 0 0) 0x7fca70003570 con 0x7fca9013fa50 2024-08-17T02:29:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8f7fe700 1 -- 172.21.15.19:0/254351839 >> v1:172.21.15.19:6789/0 conn(0x7fca9013fa50 legacy=0x7fca9006e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8f7fe700 1 -- 172.21.15.19:0/254351839 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca900af340 con 0x7fca9006e720 2024-08-17T02:29:42.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8f7fe700 1 --2- 172.21.15.19:0/254351839 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9006e720 0x7fca900aea80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca88009e90 tx=0x7fca88009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff910661166554d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8e7fc700 1 -- 172.21.15.19:0/254351839 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8800e070 con 0x7fca9006e720 2024-08-17T02:29:42.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8e7fc700 1 -- 172.21.15.19:0/254351839 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8800bb80 con 0x7fca9006e720 2024-08-17T02:29:42.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.539+0000 7fca8e7fc700 1 -- 172.21.15.19:0/254351839 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88012430 con 0x7fca9006e720 2024-08-17T02:29:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 -- 172.21.15.19:0/254351839 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9006e720 msgr2=0x7fca900aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 --2- 172.21.15.19:0/254351839 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9006e720 0x7fca900aea80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca88009e90 tx=0x7fca88009780 comp rx=0 tx=0).stop 2024-08-17T02:29:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 -- 172.21.15.19:0/254351839 shutdown_connections 2024-08-17T02:29:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 --2- 172.21.15.19:0/254351839 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9006e720 0x7fca900aea80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 -- 172.21.15.19:0/254351839 >> 172.21.15.19:0/254351839 conn(0x7fca900678a0 msgr2=0x7fca90067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 -- 172.21.15.19:0/254351839 shutdown_connections 2024-08-17T02:29:42.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 -- 172.21.15.19:0/254351839 wait complete. 2024-08-17T02:29:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 Processor -- start 2024-08-17T02:29:42.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 -- start start 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca9006e720 0x7fca90157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9013f680 0x7fca900aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9013fa50 0x7fca9006a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901694c0 con 0x7fca9013f680 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900c0f70 con 0x7fca9006e720 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8ffff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca90158060 con 0x7fca9013fa50 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca867fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9013f680 0x7fca900aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca867fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9013f680 0x7fca900aa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58358/0 (socket says 172.21.15.19:58358) 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca867fc700 1 -- 172.21.15.19:0/3082981285 learned_addr learned my addr 172.21.15.19:0/3082981285 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8effd700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca9006e720 0x7fca90157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca8f7fe700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9013fa50 0x7fca9006a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca867fc700 1 -- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9013fa50 msgr2=0x7fca9006a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.543+0000 7fca867fc700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9013fa50 0x7fca9006a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca867fc700 1 -- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca9006e720 msgr2=0x7fca90157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca867fc700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca9006e720 0x7fca90157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca867fc700 1 -- 172.21.15.19:0/3082981285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88009a20 con 0x7fca9013f680 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca8effd700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca9006e720 0x7fca90157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca867fc700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9013f680 0x7fca900aa220 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c5e0 tx=0x7fca78007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca877fe700 1 -- 172.21.15.19:0/3082981285 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78007360 con 0x7fca9013f680 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca877fe700 1 -- 172.21.15.19:0/3082981285 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca780074e0 con 0x7fca9013f680 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca877fe700 1 -- 172.21.15.19:0/3082981285 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78004830 con 0x7fca9013f680 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca900aacf0 con 0x7fca9013f680 2024-08-17T02:29:42.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca900c0c00 con 0x7fca9013f680 2024-08-17T02:29:42.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca900c0a60 con 0x7fca9013f680 2024-08-17T02:29:42.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.547+0000 7fca877fe700 1 -- 172.21.15.19:0/3082981285 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fca78004c80 con 0x7fca9013f680 2024-08-17T02:29:42.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.551+0000 7fca877fe700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fca74060860 0x7fca74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.551+0000 7fca877fe700 1 -- 172.21.15.19:0/3082981285 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fca7807c930 con 0x7fca9013f680 2024-08-17T02:29:42.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.551+0000 7fca8effd700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fca74060860 0x7fca74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.551+0000 7fca8effd700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fca74060860 0x7fca74062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fca80007fd0 tx=0x7fca80007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.555+0000 7fca877fe700 1 -- 172.21.15.19:0/3082981285 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fca900c0a60 con 0x7fca9013f680 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:42.759+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000446940", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fca900c0a60 con 0x7fca9013f680 2024-08-17T02:29:43.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.407+0000 7fca877fe700 1 -- 172.21.15.19:0/3082981285 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000446940", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7fca900c0a60 con 0x7fca9013f680 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fca74060860 msgr2=0x7fca74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fca74060860 0x7fca74062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fca80007fd0 tx=0x7fca80007d50 comp rx=0 tx=0).stop 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9013f680 msgr2=0x7fca900aa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9013f680 0x7fca900aa220 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c5e0 tx=0x7fca78007b30 comp rx=0 tx=0).stop 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 shutdown_connections 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fca74060860 0x7fca74062d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca9013fa50 0x7fca9006a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca9013f680 0x7fca900aa220 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 --2- 172.21.15.19:0/3082981285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca9006e720 0x7fca90157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 >> 172.21.15.19:0/3082981285 conn(0x7fca900678a0 msgr2=0x7fca900ad4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 shutdown_connections 2024-08-17T02:29:43.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.411+0000 7fca8ffff700 1 -- 172.21.15.19:0/3082981285 wait complete. 2024-08-17T02:29:43.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000446940.meta cephfs.volume_0000000000446940.meta --yes-i-really-really-mean-it 2024-08-17T02:29:43.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd2a26700 1 Processor -- start 2024-08-17T02:29:43.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd2a26700 1 -- start start 2024-08-17T02:29:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd2a26700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5dcc140800 0x7f5dcc0af470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd2a26700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5dcc15b210 0x7f5dcc0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd2a26700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dcc0cd230 con 0x7f5dcc140bd0 2024-08-17T02:29:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd2a26700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc0b0fb0 con 0x7f5dcc140800 2024-08-17T02:29:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd2a26700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc0b03a0 con 0x7f5dcc15b210 2024-08-17T02:29:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd1a24700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5dcc140800 0x7f5dcc0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd1a24700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5dcc140800 0x7f5dcc0af470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58364/0 (socket says 172.21.15.19:58364) 2024-08-17T02:29:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd1a24700 1 -- 172.21.15.19:0/3868494460 learned_addr learned my addr 172.21.15.19:0/3868494460 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd2225700 1 --2- 172.21.15.19:0/3868494460 >> v2:172.21.15.119:3300/0 conn(0x7f5dcc15b210 0x7f5dcc0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd1a24700 1 -- 172.21.15.19:0/3868494460 >> v2:172.21.15.119:3300/0 conn(0x7f5dcc15b210 msgr2=0x7f5dcc0cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:43.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd1a24700 1 --2- 172.21.15.19:0/3868494460 >> v2:172.21.15.119:3300/0 conn(0x7f5dcc15b210 0x7f5dcc0cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd1a24700 1 -- 172.21.15.19:0/3868494460 >> v1:172.21.15.119:6789/0 conn(0x7f5dcc140bd0 legacy=0x7f5dcc15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd1a24700 1 -- 172.21.15.19:0/3868494460 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc0afb00 con 0x7f5dcc140800 2024-08-17T02:29:43.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd1a24700 1 --2- 172.21.15.19:0/3868494460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140800 0x7f5dcc0af470 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc068430 tx=0x7f5dc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25acf0d1e3397b00 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:43.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd0a22700 1 -- 172.21.15.19:0/3868494460 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8009e70 con 0x7f5dcc140800 2024-08-17T02:29:43.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd0a22700 1 -- 172.21.15.19:0/3868494460 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc800b860 con 0x7f5dcc140800 2024-08-17T02:29:43.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.547+0000 7f5dd0a22700 1 -- 172.21.15.19:0/3868494460 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800bc20 con 0x7f5dcc140800 2024-08-17T02:29:43.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 -- 172.21.15.19:0/3868494460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140800 msgr2=0x7f5dcc0af470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 --2- 172.21.15.19:0/3868494460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140800 0x7f5dcc0af470 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc068430 tx=0x7f5dc8009250 comp rx=0 tx=0).stop 2024-08-17T02:29:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 -- 172.21.15.19:0/3868494460 shutdown_connections 2024-08-17T02:29:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 --2- 172.21.15.19:0/3868494460 >> v2:172.21.15.119:3300/0 conn(0x7f5dcc15b210 0x7f5dcc0cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 --2- 172.21.15.19:0/3868494460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140800 0x7f5dcc0af470 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 -- 172.21.15.19:0/3868494460 >> 172.21.15.19:0/3868494460 conn(0x7f5dcc06cd20 msgr2=0x7f5dcc06d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 -- 172.21.15.19:0/3868494460 shutdown_connections 2024-08-17T02:29:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 -- 172.21.15.19:0/3868494460 wait complete. 2024-08-17T02:29:43.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 Processor -- start 2024-08-17T02:29:43.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.551+0000 7f5dd2a26700 1 -- start start 2024-08-17T02:29:43.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2a26700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dcc140800 0x7f5dcc0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2a26700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140bd0 0x7f5dcc0af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2a26700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dcc15b210 0x7f5dcc0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2a26700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc1684d0 con 0x7f5dcc140bd0 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2a26700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0c3c60 con 0x7f5dcc140800 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2a26700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0c3f40 con 0x7f5dcc15b210 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1223700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140bd0 0x7f5dcc0af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1223700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140bd0 0x7f5dcc0af0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58374/0 (socket says 172.21.15.19:58374) 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1223700 1 -- 172.21.15.19:0/2795911735 learned_addr learned my addr 172.21.15.19:0/2795911735 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1a24700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dcc140800 0x7f5dcc0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2225700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dcc15b210 0x7f5dcc0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1223700 1 -- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dcc15b210 msgr2=0x7f5dcc0c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1223700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dcc15b210 0x7f5dcc0c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1223700 1 -- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dcc140800 msgr2=0x7f5dcc0aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1223700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dcc140800 0x7f5dcc0aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1223700 1 -- 172.21.15.19:0/2795911735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc80094f0 con 0x7f5dcc140bd0 2024-08-17T02:29:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1a24700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dcc140800 0x7f5dcc0aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd1223700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140bd0 0x7f5dcc0af0e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c590 tx=0x7f5dbc007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dc1ffb700 1 -- 172.21.15.19:0/2795911735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc011590 con 0x7f5dcc140bd0 2024-08-17T02:29:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dc1ffb700 1 -- 172.21.15.19:0/2795911735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc011710 con 0x7f5dcc140bd0 2024-08-17T02:29:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dcc0c4220 con 0x7f5dcc140bd0 2024-08-17T02:29:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dc1ffb700 1 -- 172.21.15.19:0/2795911735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc011ad0 con 0x7f5dcc140bd0 2024-08-17T02:29:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dcc0c8820 con 0x7f5dcc140bd0 2024-08-17T02:29:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.555+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dcc168640 con 0x7f5dcc140bd0 2024-08-17T02:29:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.559+0000 7f5dc1ffb700 1 -- 172.21.15.19:0/2795911735 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5dbc01b3b0 con 0x7f5dcc140bd0 2024-08-17T02:29:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.559+0000 7f5dc1ffb700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5db0060890 0x7f5db0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.559+0000 7f5dc1ffb700 1 -- 172.21.15.19:0/2795911735 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f5dbc07bf70 con 0x7f5dcc140bd0 2024-08-17T02:29:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.559+0000 7f5dd1a24700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5db0060890 0x7f5db0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.559+0000 7f5dd1a24700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5db0060890 0x7f5db0062d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc068430 tx=0x7f5dc8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.571+0000 7f5dc1ffb700 1 -- 172.21.15.19:0/2795911735 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5dbc04c2e0 con 0x7f5dcc140bd0 2024-08-17T02:29:43.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:43.739+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000446940.meta", "pool2": "cephfs.volume_0000000000446940.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5dcc0cd230 con 0x7f5dcc140bd0 2024-08-17T02:29:44.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.411+0000 7f5dc1ffb700 1 -- 172.21.15.19:0/2795911735 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000446940.meta", "pool2": "cephfs.volume_0000000000446940.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000446940.meta' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f5dcc0cd230 con 0x7f5dcc140bd0 2024-08-17T02:29:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5db0060890 msgr2=0x7f5db0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5db0060890 0x7f5db0062d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc068430 tx=0x7f5dc8017000 comp rx=0 tx=0).stop 2024-08-17T02:29:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140bd0 msgr2=0x7f5dcc0af0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140bd0 0x7f5dcc0af0e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c590 tx=0x7f5dbc007f50 comp rx=0 tx=0).stop 2024-08-17T02:29:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 shutdown_connections 2024-08-17T02:29:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f5db0060890 0x7f5db0062d40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dcc15b210 0x7f5dcc0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dcc140bd0 0x7f5dcc0af0e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 --2- 172.21.15.19:0/2795911735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dcc140800 0x7f5dcc0aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 >> 172.21.15.19:0/2795911735 conn(0x7f5dcc06cd20 msgr2=0x7f5dcc0b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.415+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 shutdown_connections 2024-08-17T02:29:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.419+0000 7f5dd2a26700 1 -- 172.21.15.19:0/2795911735 wait complete. 2024-08-17T02:29:44.423 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs.volume_0000000000446940.meta' removed 2024-08-17T02:29:44.435 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000446940.data cephfs.volume_0000000000446940.data --yes-i-really-really-mean-it 2024-08-17T02:29:44.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4d23a6700 1 Processor -- start 2024-08-17T02:29:44.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4d23a6700 1 -- start start 2024-08-17T02:29:44.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4d23a6700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe4cc1555e0 0x7fe4cc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4d23a6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe4cc0aeda0 0x7fe4cc0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4d23a6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc06af40 con 0x7fe4cc1559b0 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4d23a6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc06abb0 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4d23a6700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc06c3e0 con 0x7fe4cc1555e0 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4cb7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe4cc0aeda0 0x7fe4cc0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4cb7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe4cc0aeda0 0x7fe4cc0686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58382/0 (socket says 172.21.15.19:58382) 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4cb7fe700 1 -- 172.21.15.19:0/1270930258 learned_addr learned my addr 172.21.15.19:0/1270930258 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.547+0000 7fe4cbfff700 1 --2- 172.21.15.19:0/1270930258 >> v2:172.21.15.119:3300/0 conn(0x7fe4cc1555e0 0x7fe4cc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4cb7fe700 1 -- 172.21.15.19:0/1270930258 >> v2:172.21.15.119:3300/0 conn(0x7fe4cc1555e0 msgr2=0x7fe4cc0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4cb7fe700 1 --2- 172.21.15.19:0/1270930258 >> v2:172.21.15.119:3300/0 conn(0x7fe4cc1555e0 0x7fe4cc0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4cb7fe700 1 -- 172.21.15.19:0/1270930258 >> v1:172.21.15.119:6789/0 conn(0x7fe4cc1559b0 legacy=0x7fe4cc159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4cb7fe700 1 -- 172.21.15.19:0/1270930258 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc06a310 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4cb7fe700 1 --2- 172.21.15.19:0/1270930258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 0x7fe4cc0686a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc06d120 tx=0x7fe4c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68881ce85e25082d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4caffd700 1 -- 172.21.15.19:0/1270930258 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0009e70 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4caffd700 1 -- 172.21.15.19:0/1270930258 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c000b860 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4caffd700 1 -- 172.21.15.19:0/1270930258 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c000bc00 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4d23a6700 1 -- 172.21.15.19:0/1270930258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 msgr2=0x7fe4cc0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4d23a6700 1 --2- 172.21.15.19:0/1270930258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 0x7fe4cc0686a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc06d120 tx=0x7fe4c0009250 comp rx=0 tx=0).stop 2024-08-17T02:29:44.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4d23a6700 1 -- 172.21.15.19:0/1270930258 shutdown_connections 2024-08-17T02:29:44.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4d23a6700 1 --2- 172.21.15.19:0/1270930258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 0x7fe4cc0686a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4d23a6700 1 --2- 172.21.15.19:0/1270930258 >> v2:172.21.15.119:3300/0 conn(0x7fe4cc1555e0 0x7fe4cc0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4d23a6700 1 -- 172.21.15.19:0/1270930258 >> 172.21.15.19:0/1270930258 conn(0x7fe4cc06d9f0 msgr2=0x7fe4cc06ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:44.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4d23a6700 1 -- 172.21.15.19:0/1270930258 shutdown_connections 2024-08-17T02:29:44.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.551+0000 7fe4d23a6700 1 -- 172.21.15.19:0/1270930258 wait complete. 2024-08-17T02:29:44.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 Processor -- start 2024-08-17T02:29:44.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 -- start start 2024-08-17T02:29:44.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 0x7fe4cc156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc1555e0 0x7fe4cc147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc1559b0 0x7fe4cc148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc146490 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0abac0 con 0x7fe4cc1555e0 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0aa740 con 0x7fe4cc1559b0 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 0x7fe4cc156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 0x7fe4cc156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58394/0 (socket says 172.21.15.19:58394) 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cbfff700 1 -- 172.21.15.19:0/3853164306 learned_addr learned my addr 172.21.15.19:0/3853164306 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cb7fe700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc1555e0 0x7fe4cc147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d0943700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc1559b0 0x7fe4cc148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cbfff700 1 -- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc1559b0 msgr2=0x7fe4cc148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cbfff700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc1559b0 0x7fe4cc148190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cbfff700 1 -- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc1555e0 msgr2=0x7fe4cc147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cbfff700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc1555e0 0x7fe4cc147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cbfff700 1 -- 172.21.15.19:0/3853164306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00094f0 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d0943700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc1559b0 0x7fe4cc148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:44.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4cbfff700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 0x7fe4cc156ba0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00ec80 tx=0x7fe4bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4b3fff700 1 -- 172.21.15.19:0/3853164306 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00c850 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4b3fff700 1 -- 172.21.15.19:0/3853164306 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc00c9b0 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc0aaa20 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4b3fff700 1 -- 172.21.15.19:0/3853164306 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00cd50 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.555+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc1570e0 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.559+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc0ab8f0 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.559+0000 7fe4b3fff700 1 -- 172.21.15.19:0/3853164306 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe4bc013680 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.559+0000 7fe4b3fff700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe4b8060860 0x7fe4b8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.559+0000 7fe4b3fff700 1 -- 172.21.15.19:0/3853164306 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5448+0+0 (secure 0 0 0) 0x7fe4bc07ce30 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.559+0000 7fe4cb7fe700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe4b8060860 0x7fe4b8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.559+0000 7fe4cb7fe700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe4b8060860 0x7fe4b8062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc06d120 tx=0x7fe4c0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.571+0000 7fe4b3fff700 1 -- 172.21.15.19:0/3853164306 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe4bc04d2e0 con 0x7fe4cc0aeda0 2024-08-17T02:29:44.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:44.735+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000446940.data", "pool2": "cephfs.volume_0000000000446940.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe4cc0638f0 con 0x7fe4cc0aeda0 2024-08-17T02:29:45.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.419+0000 7fe4b3fff700 1 -- 172.21.15.19:0/3853164306 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000446940.data", "pool2": "cephfs.volume_0000000000446940.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000446940.data' removed v44) v1 ==== 241+0+0 (secure 0 0 0) 0x7fe4bc050900 con 0x7fe4cc0aeda0 2024-08-17T02:29:45.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe4b8060860 msgr2=0x7fe4b8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe4b8060860 0x7fe4b8062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc06d120 tx=0x7fe4c0017000 comp rx=0 tx=0).stop 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 msgr2=0x7fe4cc156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 0x7fe4cc156ba0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00ec80 tx=0x7fe4bc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 shutdown_connections 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe4b8060860 0x7fe4b8062d10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc1559b0 0x7fe4cc148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc1555e0 0x7fe4cc147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 --2- 172.21.15.19:0/3853164306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4cc0aeda0 0x7fe4cc156ba0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 >> 172.21.15.19:0/3853164306 conn(0x7fe4cc06d9f0 msgr2=0x7fe4cc066e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 shutdown_connections 2024-08-17T02:29:45.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.423+0000 7fe4d23a6700 1 -- 172.21.15.19:0/3853164306 wait complete. 2024-08-17T02:29:45.430 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs.volume_0000000000446940.data' removed 2024-08-17T02:29:45.442 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:29:45.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.547+0000 7fa9a224c700 1 Processor -- start 2024-08-17T02:29:45.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a224c700 1 -- start start 2024-08-17T02:29:45.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a224c700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa99c0aab10 0x7fa99c068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a224c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa99c158b70 0x7fa99c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a224c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c159510 con 0x7fa99c0688d0 2024-08-17T02:29:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a224c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0ab0f0 con 0x7fa99c158b70 2024-08-17T02:29:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a224c700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0ab3d0 con 0x7fa99c0aab10 2024-08-17T02:29:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a124a700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa99c0688d0 0x7fa99c066ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50200/0 (socket says 172.21.15.19:50200) 2024-08-17T02:29:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a124a700 1 -- 172.21.15.19:0/2578416295 learned_addr learned my addr 172.21.15.19:0/2578416295 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a0a49700 1 --2- 172.21.15.19:0/2578416295 >> v2:172.21.15.119:3300/0 conn(0x7fa99c0aab10 0x7fa99c068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a1a4b700 1 --2- 172.21.15.19:0/2578416295 >> v2:172.21.15.19:3300/0 conn(0x7fa99c158b70 0x7fa99c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa993fff700 1 -- 172.21.15.19:0/2578416295 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349935837 0 0) 0x7fa99c159510 con 0x7fa99c0688d0 2024-08-17T02:29:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa993fff700 1 -- 172.21.15.19:0/2578416295 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa988003570 con 0x7fa99c0688d0 2024-08-17T02:29:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a0a49700 1 -- 172.21.15.19:0/2578416295 >> v2:172.21.15.19:3300/0 conn(0x7fa99c158b70 msgr2=0x7fa99c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a0a49700 1 --2- 172.21.15.19:0/2578416295 >> v2:172.21.15.19:3300/0 conn(0x7fa99c158b70 0x7fa99c158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a0a49700 1 -- 172.21.15.19:0/2578416295 >> v1:172.21.15.19:6789/0 conn(0x7fa99c0688d0 legacy=0x7fa99c066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a0a49700 1 -- 172.21.15.19:0/2578416295 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c0ab6b0 con 0x7fa99c0aab10 2024-08-17T02:29:45.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa9a0a49700 1 --2- 172.21.15.19:0/2578416295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99c0aab10 0x7fa99c068ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa99c069820 tx=0x7fa98c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eeb8967176726cb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa993fff700 1 -- 172.21.15.19:0/2578416295 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c011630 con 0x7fa99c0aab10 2024-08-17T02:29:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa993fff700 1 -- 172.21.15.19:0/2578416295 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c0117b0 con 0x7fa99c0aab10 2024-08-17T02:29:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.551+0000 7fa993fff700 1 -- 172.21.15.19:0/2578416295 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c011b70 con 0x7fa99c0aab10 2024-08-17T02:29:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 -- 172.21.15.19:0/2578416295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99c0aab10 msgr2=0x7fa99c068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 --2- 172.21.15.19:0/2578416295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99c0aab10 0x7fa99c068ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa99c069820 tx=0x7fa98c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 -- 172.21.15.19:0/2578416295 shutdown_connections 2024-08-17T02:29:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 --2- 172.21.15.19:0/2578416295 >> v2:172.21.15.19:3300/0 conn(0x7fa99c158b70 0x7fa99c158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 --2- 172.21.15.19:0/2578416295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99c0aab10 0x7fa99c068ca0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 -- 172.21.15.19:0/2578416295 >> 172.21.15.19:0/2578416295 conn(0x7fa99c06e310 msgr2=0x7fa99c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 -- 172.21.15.19:0/2578416295 shutdown_connections 2024-08-17T02:29:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 -- 172.21.15.19:0/2578416295 wait complete. 2024-08-17T02:29:45.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 Processor -- start 2024-08-17T02:29:45.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 -- start start 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99c0688d0 0x7fa99c16d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99c0aab10 0x7fa99c141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa99c158b70 0x7fa99c156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c1be0 con 0x7fa99c0aab10 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c15c6f0 con 0x7fa99c0688d0 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a224c700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c16d630 con 0x7fa99c158b70 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a0a49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99c0aab10 0x7fa99c141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a0a49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99c0aab10 0x7fa99c141b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58412/0 (socket says 172.21.15.19:58412) 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a0a49700 1 -- 172.21.15.19:0/2248762384 learned_addr learned my addr 172.21.15.19:0/2248762384 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a1a4b700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa99c158b70 0x7fa99c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a124a700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99c0688d0 0x7fa99c16d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a0a49700 1 -- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa99c158b70 msgr2=0x7fa99c156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a0a49700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa99c158b70 0x7fa99c156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a0a49700 1 -- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99c0688d0 msgr2=0x7fa99c16d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a0a49700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99c0688d0 0x7fa99c16d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.555+0000 7fa9a0a49700 1 -- 172.21.15.19:0/2248762384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c009420 con 0x7fa99c0aab10 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.559+0000 7fa9a0a49700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99c0aab10 0x7fa99c141b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa98c013000 tx=0x7fa98c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.559+0000 7fa9917fa700 1 -- 172.21.15.19:0/2248762384 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c01f070 con 0x7fa99c0aab10 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.559+0000 7fa9917fa700 1 -- 172.21.15.19:0/2248762384 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c000bc0 con 0x7fa99c0aab10 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.559+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c1420d0 con 0x7fa99c0aab10 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.559+0000 7fa9917fa700 1 -- 172.21.15.19:0/2248762384 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c011b70 con 0x7fa99c0aab10 2024-08-17T02:29:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.559+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c1690f0 con 0x7fa99c0aab10 2024-08-17T02:29:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.559+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c0638f0 con 0x7fa99c0aab10 2024-08-17T02:29:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.559+0000 7fa9917fa700 1 -- 172.21.15.19:0/2248762384 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa98c023070 con 0x7fa99c0aab10 2024-08-17T02:29:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.563+0000 7fa9917fa700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa980060860 0x7fa980062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.563+0000 7fa9917fa700 1 -- 172.21.15.19:0/2248762384 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa98c07db80 con 0x7fa99c0aab10 2024-08-17T02:29:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.563+0000 7fa9a124a700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa980060860 0x7fa980062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.563+0000 7fa9a124a700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa980060860 0x7fa980062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa998007fd0 tx=0x7fa998009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.571+0000 7fa9917fa700 1 -- 172.21.15.19:0/2248762384 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa98c04e270 con 0x7fa99c0aab10 2024-08-17T02:29:45.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.735+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa99c0cbc60 con 0x7fa99c0aab10 2024-08-17T02:29:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.743+0000 7fa9917fa700 1 -- 172.21.15.19:0/2248762384 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa98c051890 con 0x7fa99c0aab10 2024-08-17T02:29:45.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa980060860 msgr2=0x7fa980062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa980060860 0x7fa980062d10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa998007fd0 tx=0x7fa998009040 comp rx=0 tx=0).stop 2024-08-17T02:29:45.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99c0aab10 msgr2=0x7fa99c141b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99c0aab10 0x7fa99c141b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa98c013000 tx=0x7fa98c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:45.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 shutdown_connections 2024-08-17T02:29:45.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fa980060860 0x7fa980062d10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa99c158b70 0x7fa99c156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99c0aab10 0x7fa99c141b90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 --2- 172.21.15.19:0/2248762384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99c0688d0 0x7fa99c16d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 >> 172.21.15.19:0/2248762384 conn(0x7fa99c06e310 msgr2=0x7fa99c06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 shutdown_connections 2024-08-17T02:29:45.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.747+0000 7fa9a224c700 1 -- 172.21.15.19:0/2248762384 wait complete. 2024-08-17T02:29:45.764 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:29:45.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.867+0000 7f8b9c7db700 1 Processor -- start 2024-08-17T02:29:45.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.867+0000 7f8b9c7db700 1 -- start start 2024-08-17T02:29:45.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.867+0000 7f8b9c7db700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8b94155380 0x7f8b940a9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.867+0000 7f8b9c7db700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159300 0x7f8b94159730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.867+0000 7f8b9c7db700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b940a9f60 con 0x7f8b94159c70 2024-08-17T02:29:45.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.867+0000 7f8b9c7db700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9406e4b0 con 0x7f8b94155380 2024-08-17T02:29:45.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.867+0000 7f8b9c7db700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9415a0f0 con 0x7f8b94159300 2024-08-17T02:29:45.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99d76700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159300 0x7f8b94159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9a577700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8b94155380 0x7f8b940a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99d76700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159300 0x7f8b94159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:36678/0 (socket says 172.21.15.19:36678) 2024-08-17T02:29:45.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99d76700 1 -- 172.21.15.19:0/2739168155 learned_addr learned my addr 172.21.15.19:0/2739168155 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99d76700 1 -- 172.21.15.19:0/2739168155 >> v2:172.21.15.119:3300/0 conn(0x7f8b94155380 msgr2=0x7f8b940a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99d76700 1 --2- 172.21.15.19:0/2739168155 >> v2:172.21.15.119:3300/0 conn(0x7f8b94155380 0x7f8b940a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99d76700 1 -- 172.21.15.19:0/2739168155 >> v1:172.21.15.119:6789/0 conn(0x7f8b94159c70 legacy=0x7f8b940af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99d76700 1 -- 172.21.15.19:0/2739168155 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9406e6a0 con 0x7f8b94159300 2024-08-17T02:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9a577700 1 --2- 172.21.15.19:0/2739168155 >> v2:172.21.15.119:3300/0 conn(0x7f8b94155380 0x7f8b940a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99d76700 1 --2- 172.21.15.19:0/2739168155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159300 0x7f8b94159730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009f20 tx=0x7f8b8c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29d121391a7473ab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99575700 1 -- 172.21.15.19:0/2739168155 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00e070 con 0x7f8b94159300 2024-08-17T02:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99575700 1 -- 172.21.15.19:0/2739168155 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c00b9d0 con 0x7f8b94159300 2024-08-17T02:29:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b99575700 1 -- 172.21.15.19:0/2739168155 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c0092e0 con 0x7f8b94159300 2024-08-17T02:29:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2739168155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159300 msgr2=0x7f8b94159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9c7db700 1 --2- 172.21.15.19:0/2739168155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159300 0x7f8b94159730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009f20 tx=0x7f8b8c009840 comp rx=0 tx=0).stop 2024-08-17T02:29:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2739168155 shutdown_connections 2024-08-17T02:29:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9c7db700 1 --2- 172.21.15.19:0/2739168155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159300 0x7f8b94159730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9c7db700 1 --2- 172.21.15.19:0/2739168155 >> v2:172.21.15.119:3300/0 conn(0x7f8b94155380 0x7f8b940a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2739168155 >> 172.21.15.19:0/2739168155 conn(0x7f8b94066e00 msgr2=0x7f8b94067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2739168155 shutdown_connections 2024-08-17T02:29:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.871+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2739168155 wait complete. 2024-08-17T02:29:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 Processor -- start 2024-08-17T02:29:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 -- start start 2024-08-17T02:29:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b94155380 0x7f8b94144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b94159300 0x7f8b94157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159c70 0x7f8b940969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94098500 con 0x7f8b94159300 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940ae3d0 con 0x7f8b94155380 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94097730 con 0x7f8b94159c70 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b99d76700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b94159300 0x7f8b94157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b99d76700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b94159300 0x7f8b94157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58414/0 (socket says 172.21.15.19:58414) 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b99d76700 1 -- 172.21.15.19:0/2181655397 learned_addr learned my addr 172.21.15.19:0/2181655397 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9a577700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b94155380 0x7f8b94144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9ad78700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159c70 0x7f8b940969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b99d76700 1 -- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159c70 msgr2=0x7f8b940969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b99d76700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159c70 0x7f8b940969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b99d76700 1 -- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b94155380 msgr2=0x7f8b94144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b99d76700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b94155380 0x7f8b94144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b99d76700 1 -- 172.21.15.19:0/2181655397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009420 con 0x7f8b94159300 2024-08-17T02:29:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9a577700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b94155380 0x7f8b94144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b99d76700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b94159300 0x7f8b94157f60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c003440 tx=0x7f8b8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b927fc700 1 -- 172.21.15.19:0/2181655397 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c0089b0 con 0x7f8b94159300 2024-08-17T02:29:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b927fc700 1 -- 172.21.15.19:0/2181655397 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c008b30 con 0x7f8b94159300 2024-08-17T02:29:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8c009ae0 con 0x7f8b94159300 2024-08-17T02:29:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b927fc700 1 -- 172.21.15.19:0/2181655397 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c026460 con 0x7f8b94159300 2024-08-17T02:29:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.875+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b94097c60 con 0x7f8b94159300 2024-08-17T02:29:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.879+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b940645c0 con 0x7f8b94159300 2024-08-17T02:29:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.879+0000 7f8b927fc700 1 -- 172.21.15.19:0/2181655397 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8b8c003040 con 0x7f8b94159300 2024-08-17T02:29:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.879+0000 7f8b927fc700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8b80060860 0x7f8b80062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.879+0000 7f8b927fc700 1 -- 172.21.15.19:0/2181655397 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8b8c07e6f0 con 0x7f8b94159300 2024-08-17T02:29:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.879+0000 7f8b9a577700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8b80060860 0x7f8b80062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.879+0000 7f8b9a577700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8b80060860 0x7f8b80062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8b840093f0 tx=0x7f8b84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:45.883+0000 7f8b927fc700 1 -- 172.21.15.19:0/2181655397 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8b8c04ee90 con 0x7f8b94159300 2024-08-17T02:29:46.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.111+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f8b94159860 con 0x7f8b94159300 2024-08-17T02:29:46.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.419+0000 7f8b927fc700 1 -- 172.21.15.19:0/2181655397 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v159) v1 ==== 135+0+0 (secure 0 0 0) 0x7f8b8c0524b0 con 0x7f8b94159300 2024-08-17T02:29:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8b80060860 msgr2=0x7f8b80062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8b80060860 0x7f8b80062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8b840093f0 tx=0x7f8b84008040 comp rx=0 tx=0).stop 2024-08-17T02:29:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b94159300 msgr2=0x7f8b94157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b94159300 0x7f8b94157f60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c003440 tx=0x7f8b8c018000 comp rx=0 tx=0).stop 2024-08-17T02:29:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 shutdown_connections 2024-08-17T02:29:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f8b80060860 0x7f8b80062d10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b94159c70 0x7f8b940969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b94159300 0x7f8b94157f60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 --2- 172.21.15.19:0/2181655397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b94155380 0x7f8b94144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 >> 172.21.15.19:0/2181655397 conn(0x7f8b94066e00 msgr2=0x7f8b94067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 shutdown_connections 2024-08-17T02:29:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:46.423+0000 7f8b9c7db700 1 -- 172.21.15.19:0/2181655397 wait complete. 2024-08-17T02:29:46.449 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:29:46.450 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:46.450 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:46.450 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:46.450 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:46.450 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:46.450 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:46.450 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000446940 --yes-i-really-mean-it' 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.617s 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:46.452 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:46.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:46.454 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:46.454 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:46.454 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:46.454 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000446940 --yes-i-really-mean-it' 2024-08-17T02:29:46.454 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:46.454 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:46.678 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ada7c5437c3e47f391ba58c7d0ed06c5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:46.680 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:29:46.711 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-17T02:29:46.723 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-17T02:29:46.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:46.724 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-08-17T02:29:46.738 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:29:46.738 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:29:46.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:46.738 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:29:46.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:46.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:29:46.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:46.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-08-17T02:29:46.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:46.956 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-08-17T02:29:46.963 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:29:46.964 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:29:46.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:46.964 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:29:46.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:46.981 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:29:47.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:47.038 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-08-17T02:29:47.162 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:29:47.178 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:29:47.179 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:47.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.291+0000 7f3d92277700 1 Processor -- start 2024-08-17T02:29:47.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.291+0000 7f3d92277700 1 -- start start 2024-08-17T02:29:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d8c142880 0x7f3d8c0c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142c50 0x7f3d8c15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c15b880 con 0x7f3d8c0b1d90 2024-08-17T02:29:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c15ac70 con 0x7f3d8c142880 2024-08-17T02:29:47.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c15af50 con 0x7f3d8c142c50 2024-08-17T02:29:47.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d91275700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d8c142880 0x7f3d8c0c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d91275700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d8c142880 0x7f3d8c0c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58422/0 (socket says 172.21.15.19:58422) 2024-08-17T02:29:47.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d91275700 1 -- 172.21.15.19:0/2925505888 learned_addr learned my addr 172.21.15.19:0/2925505888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:47.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d90a74700 1 --2- 172.21.15.19:0/2925505888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142c50 0x7f3d8c15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d7ffff700 1 -- 172.21.15.19:0/2925505888 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660063072 0 0) 0x7f3d8c15b880 con 0x7f3d8c0b1d90 2024-08-17T02:29:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d7ffff700 1 -- 172.21.15.19:0/2925505888 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d78003570 con 0x7f3d8c0b1d90 2024-08-17T02:29:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d91275700 1 -- 172.21.15.19:0/2925505888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142c50 msgr2=0x7f3d8c15d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d91275700 1 --2- 172.21.15.19:0/2925505888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142c50 0x7f3d8c15d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d91275700 1 -- 172.21.15.19:0/2925505888 >> v1:172.21.15.119:6789/0 conn(0x7f3d8c0b1d90 legacy=0x7f3d8c15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d91275700 1 -- 172.21.15.19:0/2925505888 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c15b230 con 0x7f3d8c142880 2024-08-17T02:29:47.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d91275700 1 --2- 172.21.15.19:0/2925505888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142880 0x7f3d8c0c70e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d880099e0 tx=0x7f3d88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae91096cadc1ff1d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d7ffff700 1 -- 172.21.15.19:0/2925505888 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800b640 con 0x7f3d8c142880 2024-08-17T02:29:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d7ffff700 1 -- 172.21.15.19:0/2925505888 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8800b7a0 con 0x7f3d8c142880 2024-08-17T02:29:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d7ffff700 1 -- 172.21.15.19:0/2925505888 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800bb40 con 0x7f3d8c142880 2024-08-17T02:29:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 -- 172.21.15.19:0/2925505888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142880 msgr2=0x7f3d8c0c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 --2- 172.21.15.19:0/2925505888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142880 0x7f3d8c0c70e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d880099e0 tx=0x7f3d88009250 comp rx=0 tx=0).stop 2024-08-17T02:29:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 -- 172.21.15.19:0/2925505888 shutdown_connections 2024-08-17T02:29:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 --2- 172.21.15.19:0/2925505888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142c50 0x7f3d8c15d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 --2- 172.21.15.19:0/2925505888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142880 0x7f3d8c0c70e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 -- 172.21.15.19:0/2925505888 >> 172.21.15.19:0/2925505888 conn(0x7f3d8c06cc40 msgr2=0x7f3d8c06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 -- 172.21.15.19:0/2925505888 shutdown_connections 2024-08-17T02:29:47.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.295+0000 7f3d92277700 1 -- 172.21.15.19:0/2925505888 wait complete. 2024-08-17T02:29:47.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.299+0000 7f3d92277700 1 Processor -- start 2024-08-17T02:29:47.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.299+0000 7f3d92277700 1 -- start start 2024-08-17T02:29:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d92277700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c0b1d90 0x7f3d8c16a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d92277700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142880 0x7f3d8c0affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d92277700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142c50 0x7f3d8c06a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d92277700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c06bbf0 con 0x7f3d8c142c50 2024-08-17T02:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d92277700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0b0510 con 0x7f3d8c0b1d90 2024-08-17T02:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d92277700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c06c080 con 0x7f3d8c142880 2024-08-17T02:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91a76700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142c50 0x7f3d8c06a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91a76700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142c50 0x7f3d8c06a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58434/0 (socket says 172.21.15.19:58434) 2024-08-17T02:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91a76700 1 -- 172.21.15.19:0/3333055382 learned_addr learned my addr 172.21.15.19:0/3333055382 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91275700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c0b1d90 0x7f3d8c16a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d90a74700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142880 0x7f3d8c0affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91a76700 1 -- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142880 msgr2=0x7f3d8c0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91a76700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142880 0x7f3d8c0affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91a76700 1 -- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c0b1d90 msgr2=0x7f3d8c16a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91a76700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c0b1d90 0x7f3d8c16a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91a76700 1 -- 172.21.15.19:0/3333055382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880094f0 con 0x7f3d8c142c50 2024-08-17T02:29:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d91a76700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142c50 0x7f3d8c06a7b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c910 tx=0x7f3d840027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d7d7fa700 1 -- 172.21.15.19:0/3333055382 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84012630 con 0x7f3d8c142c50 2024-08-17T02:29:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d7d7fa700 1 -- 172.21.15.19:0/3333055382 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d840127b0 con 0x7f3d8c142c50 2024-08-17T02:29:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c06afe0 con 0x7f3d8c142c50 2024-08-17T02:29:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d7d7fa700 1 -- 172.21.15.19:0/3333055382 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84012b70 con 0x7f3d8c142c50 2024-08-17T02:29:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.303+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c06b5a0 con 0x7f3d8c142c50 2024-08-17T02:29:47.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.307+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c06bd60 con 0x7f3d8c142c50 2024-08-17T02:29:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.307+0000 7f3d7d7fa700 1 -- 172.21.15.19:0/3333055382 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3d8401b400 con 0x7f3d8c142c50 2024-08-17T02:29:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.307+0000 7f3d7d7fa700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3d70060860 0x7f3d70062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.307+0000 7f3d7d7fa700 1 -- 172.21.15.19:0/3333055382 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3d8407ccd0 con 0x7f3d8c142c50 2024-08-17T02:29:47.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.307+0000 7f3d91275700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3d70060860 0x7f3d70062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.307+0000 7f3d91275700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3d70060860 0x7f3d70062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d880099e0 tx=0x7f3d88017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.315+0000 7f3d7d7fa700 1 -- 172.21.15.19:0/3333055382 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3d8404d320 con 0x7f3d8c142c50 2024-08-17T02:29:47.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.483+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d8c0638f0 con 0x7f3d8c142c50 2024-08-17T02:29:47.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d7d7fa700 1 -- 172.21.15.19:0/3333055382 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12393 (secure 0 0 0) 0x7f3d84016090 con 0x7f3d8c142c50 2024-08-17T02:29:47.491 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:47.491 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":44,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:29:45.408715+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6837/1526281711":"2024-08-18T02:29:42.394441+0000","172.21.15.119:6836/1526281711":"2024-08-18T02:29:42.394441+0000","172.21.15.19:6835/363347157":"2024-08-18T02:29:36.079948+0000","172.21.15.19:6834/363347157":"2024-08-18T02:29:36.079948+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:47.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3d70060860 msgr2=0x7f3d70062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3d70060860 0x7f3d70062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d880099e0 tx=0x7f3d88017000 comp rx=0 tx=0).stop 2024-08-17T02:29:47.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142c50 msgr2=0x7f3d8c06a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142c50 0x7f3d8c06a7b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c910 tx=0x7f3d840027a0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 shutdown_connections 2024-08-17T02:29:47.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3d70060860 0x7f3d70062d10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d8c142c50 0x7f3d8c06a7b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d8c142880 0x7f3d8c0affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 --2- 172.21.15.19:0/3333055382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d8c0b1d90 0x7f3d8c16a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 >> 172.21.15.19:0/3333055382 conn(0x7f3d8c06cc40 msgr2=0x7f3d8c0c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 shutdown_connections 2024-08-17T02:29:47.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.487+0000 7f3d92277700 1 -- 172.21.15.19:0/3333055382 wait complete. 2024-08-17T02:29:47.504 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:29:47.504 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:47.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f42041f6700 1 Processor -- start 2024-08-17T02:29:47.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f42041f6700 1 -- start start 2024-08-17T02:29:47.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f42041f6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f41fc15c5e0 0x7f41fc0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f42041f6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 0x7f41fc142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f42041f6700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc0c9800 con 0x7f41fc15c9b0 2024-08-17T02:29:47.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f42041f6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc0cc4c0 con 0x7f41fc15c5e0 2024-08-17T02:29:47.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f42041f6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc142d90 con 0x7f41fc1423d0 2024-08-17T02:29:47.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4201f92700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f41fc15c5e0 0x7f41fc0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4201f92700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f41fc15c5e0 0x7f41fc0cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58450/0 (socket says 172.21.15.19:58450) 2024-08-17T02:29:47.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4201f92700 1 -- 172.21.15.19:0/3019503282 learned_addr learned my addr 172.21.15.19:0/3019503282 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:47.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4202793700 1 --2- 172.21.15.19:0/3019503282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 0x7f41fc142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4201f92700 1 -- 172.21.15.19:0/3019503282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 msgr2=0x7f41fc142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4201f92700 1 --2- 172.21.15.19:0/3019503282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 0x7f41fc142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4201f92700 1 -- 172.21.15.19:0/3019503282 >> v1:172.21.15.119:6789/0 conn(0x7f41fc15c9b0 legacy=0x7f41fc0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4201f92700 1 -- 172.21.15.19:0/3019503282 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc0c9ae0 con 0x7f41fc15c5e0 2024-08-17T02:29:47.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4201f92700 1 --2- 172.21.15.19:0/3019503282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c5e0 0x7f41fc0cbf80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f41f80099e0 tx=0x7f41f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7e418a4e0ca5a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4200f90700 1 -- 172.21.15.19:0/3019503282 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800b820 con 0x7f41fc15c5e0 2024-08-17T02:29:47.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4200f90700 1 -- 172.21.15.19:0/3019503282 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f800b980 con 0x7f41fc15c5e0 2024-08-17T02:29:47.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.603+0000 7f4200f90700 1 -- 172.21.15.19:0/3019503282 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800bd20 con 0x7f41fc15c5e0 2024-08-17T02:29:47.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 -- 172.21.15.19:0/3019503282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c5e0 msgr2=0x7f41fc0cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 --2- 172.21.15.19:0/3019503282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c5e0 0x7f41fc0cbf80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f41f80099e0 tx=0x7f41f8009250 comp rx=0 tx=0).stop 2024-08-17T02:29:47.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 -- 172.21.15.19:0/3019503282 shutdown_connections 2024-08-17T02:29:47.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 --2- 172.21.15.19:0/3019503282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 0x7f41fc142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 --2- 172.21.15.19:0/3019503282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c5e0 0x7f41fc0cbf80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 -- 172.21.15.19:0/3019503282 >> 172.21.15.19:0/3019503282 conn(0x7f41fc0caad0 msgr2=0x7f41fc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 -- 172.21.15.19:0/3019503282 shutdown_connections 2024-08-17T02:29:47.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 -- 172.21.15.19:0/3019503282 wait complete. 2024-08-17T02:29:47.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 Processor -- start 2024-08-17T02:29:47.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 -- start start 2024-08-17T02:29:47.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 0x7f41fc15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41fc15c5e0 0x7f41fc16ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c9b0 0x7f41fc169800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc169d40 con 0x7f41fc15c9b0 2024-08-17T02:29:47.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc16dd70 con 0x7f41fc15c5e0 2024-08-17T02:29:47.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f42041f6700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc16d4d0 con 0x7f41fc1423d0 2024-08-17T02:29:47.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f4202793700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c9b0 0x7f41fc169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f4202793700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c9b0 0x7f41fc169800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58466/0 (socket says 172.21.15.19:58466) 2024-08-17T02:29:47.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f4202793700 1 -- 172.21.15.19:0/2531340961 learned_addr learned my addr 172.21.15.19:0/2531340961 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:47.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f4201f92700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 0x7f41fc15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.607+0000 7f4201791700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41fc15c5e0 0x7f41fc16ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f4202793700 1 -- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 msgr2=0x7f41fc15fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f4202793700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 0x7f41fc15fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f4202793700 1 -- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41fc15c5e0 msgr2=0x7f41fc16ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f4202793700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41fc15c5e0 0x7f41fc16ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f4202793700 1 -- 172.21.15.19:0/2531340961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f80094f0 con 0x7f41fc15c9b0 2024-08-17T02:29:47.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f4202793700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c9b0 0x7f41fc169800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009df0 tx=0x7f41f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f41edffb700 1 -- 172.21.15.19:0/2531340961 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400cb50 con 0x7f41fc15c9b0 2024-08-17T02:29:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f41edffb700 1 -- 172.21.15.19:0/2531340961 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f400f040 con 0x7f41fc15c9b0 2024-08-17T02:29:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f41edffb700 1 -- 172.21.15.19:0/2531340961 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4014480 con 0x7f41fc15c9b0 2024-08-17T02:29:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41fc16d7b0 con 0x7f41fc15c9b0 2024-08-17T02:29:47.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41fc0c5240 con 0x7f41fc15c9b0 2024-08-17T02:29:47.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41fc0b3580 con 0x7f41fc15c9b0 2024-08-17T02:29:47.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.611+0000 7f41edffb700 1 -- 172.21.15.19:0/2531340961 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f41f4014830 con 0x7f41fc15c9b0 2024-08-17T02:29:47.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.615+0000 7f41edffb700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f41e0060860 0x7f41e0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.615+0000 7f41edffb700 1 -- 172.21.15.19:0/2531340961 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f41f407d530 con 0x7f41fc15c9b0 2024-08-17T02:29:47.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.615+0000 7f4201f92700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f41e0060860 0x7f41e0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.615+0000 7f4201f92700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f41e0060860 0x7f41e0062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41f80099e0 tx=0x7f41f8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.623+0000 7f41edffb700 1 -- 172.21.15.19:0/2531340961 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f41fc0b3580 con 0x7f41fc15c9b0 2024-08-17T02:29:47.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.783+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41fc0b3580 con 0x7f41e0060860 2024-08-17T02:29:47.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f41edffb700 1 -- 172.21.15.19:0/2531340961 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48807 (secure 0 0 0) 0x7f41fc0b3580 con 0x7f41e0060860 2024-08-17T02:29:47.794 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f41e0060860 msgr2=0x7f41e0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f41e0060860 0x7f41e0062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41f80099e0 tx=0x7f41f8017000 comp rx=0 tx=0).stop 2024-08-17T02:29:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c9b0 msgr2=0x7f41fc169800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c9b0 0x7f41fc169800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009df0 tx=0x7f41f400b040 comp rx=0 tx=0).stop 2024-08-17T02:29:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 shutdown_connections 2024-08-17T02:29:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f41e0060860 0x7f41e0062d10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41fc15c9b0 0x7f41fc169800 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41fc15c5e0 0x7f41fc16ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 --2- 172.21.15.19:0/2531340961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41fc1423d0 0x7f41fc15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 >> 172.21.15.19:0/2531340961 conn(0x7f41fc0caad0 msgr2=0x7f41fc0b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 shutdown_connections 2024-08-17T02:29:47.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.791+0000 7f42041f6700 1 -- 172.21.15.19:0/2531340961 wait complete. 2024-08-17T02:29:47.798 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:29:47.807 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-17T02:29:46.840430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":2388112,"kb_used_data":5096,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586608,"statfs":{"total":773094113280,"available":770648686592,"internally_reserved":0,"allocated":5218304,"data_stored":2864960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001802"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:42.405325+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:29:42.405325+0000","last_peered":"2024-08-17T02:29:42.405325+0000","last_clean":"2024-08-17T02:29:42.405325+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:29:42.405325+0000","last_undegraded":"2024-08-17T02:29:42.405325+0000","last_fullsized":"2024-08-17T02:29:42.405325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68999999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":1.107,"15min":1.107},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76400000000000001,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0649999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.073,"5min":1.121,"15min":1.121},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92600000000000005},"min":{"1min":0.64400000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3089999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.327,"5min":1.425,"15min":1.425},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.60599999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.82199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0109999999999999,"15min":1.0309999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.745},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.069,"15min":1.0940000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.179,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0669999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1259999999999999,"15min":1.155},"min":{"1min":0.85499999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.1930000000000001,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1930000000000001,"15min":1.2190000000000001},"min":{"1min":0.85299999999999998,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.3819999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.83899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.369,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2210000000000001,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.879}]},{"osd":7,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.244,"15min":1.262},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.4370000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.25,"15min":1.2729999999999999},"min":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.4410000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":0.61899999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.54800000000000004,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.032,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.51500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0569999999999999,"5min":4.0860000000000003,"15min":4.0860000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.74099999999999999},"min":{"1min":0.61899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1519999999999999,"5min":1.704,"15min":1.704},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.60599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1040000000000001,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.997,"5min":0.91000000000000003,"15min":0.89000000000000001},"min":{"1min":0.85499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.286,"5min":1.486,"15min":1.486},"last":0.84999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.034,"15min":1.006},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3720000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.0449999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.097},"min":{"1min":0.81200000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3009999999999999,"5min":3.484,"15min":3.484},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1499999999999999,"15min":1.1220000000000001},"min":{"1min":0.96899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4950000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1519999999999999,"15min":1.151},"min":{"1min":0.86299999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.486,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.181,"15min":1.2070000000000001},"min":{"1min":0.88900000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4390000000000001,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":1.077}]},{"osd":7,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2290000000000001,"15min":1.2210000000000001},"min":{"1min":1.03,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5740000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.24,"15min":1.264},"min":{"1min":0.89500000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.3779999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":1.1619999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95099999999999996,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.54300000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.80200000000000005},"min":{"1min":0.67100000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.153,"15min":1.153},"last":0.84799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.83699999999999997,"15min":0.82299999999999995},"min":{"1min":0.69599999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.149,"5min":1.381,"15min":1.381},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.80500000000000005,"15min":0.77500000000000002},"min":{"1min":0.624,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1950000000000001,"5min":1.468,"15min":1.468},"last":1.3029999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.97799999999999998,"15min":0.95199999999999996},"min":{"1min":0.79500000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.98999999999999999,"15min":0.97199999999999998},"min":{"1min":0.79800000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.01}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":0.995,"15min":0.98599999999999999},"min":{"1min":0.77800000000000002,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.145,"5min":1.137,"15min":1.121},"min":{"1min":0.80100000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.196}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0700000000000001,"15min":1.04},"min":{"1min":0.85899999999999999,"5min":0.62,"15min":0.62},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.089,"15min":1.071},"min":{"1min":0.84599999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.4399999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.121}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1839999999999999,"15min":1.169},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5780000000000001,"5min":1.825,"15min":1.825},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.177,"15min":1.1599999999999999},"min":{"1min":0.97599999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4830000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.48}]}]},{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298428,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073412,"statfs":{"total":96636764160,"available":96331173888,"internally_reserved":0,"allocated":1093632,"data_stored":799484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98899999999999999,"15min":1.036},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3380000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.137}]},{"osd":1,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.998,"15min":1.048},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.3660000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.097},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.27,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.88200000000000001,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.083,"5min":1.452,"15min":1.452},"last":1.171},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.022,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.117,"5min":2.056,"15min":2.056},"last":0.69499999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.226,"5min":1.409,"15min":1.409},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1739999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.0589999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.008,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.238,"5min":1.431,"15min":1.431},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0329999999999999,"15min":1.0529999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2170000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.129,"15min":1.1879999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2889999999999999,"5min":2,"15min":2},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1519999999999999,"15min":1.1759999999999999},"min":{"1min":0.79500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.282,"5min":1.53,"15min":1.53},"last":1.018}]},{"osd":6,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0820000000000001,"15min":1.1080000000000001},"min":{"1min":0.79900000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.27,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.319,"15min":1.391},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5109999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":0.98399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.3069999999999999,"5min":1.335,"15min":1.335},"last":0.63},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1200000000000001,"5min":1.216,"15min":1.216},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.69399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.3340000000000001,"5min":1.359,"15min":1.359},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.90200000000000002,"15min":0.91800000000000004},"min":{"1min":0.65800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.224,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0960000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0029999999999999,"15min":1.014},"min":{"1min":0.66700000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.107,"15min":1.1060000000000001},"min":{"1min":0.81699999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.248,"5min":1.373,"15min":1.373},"last":1.028}]},{"osd":3,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91300000000000003,"15min":0.90700000000000003},"min":{"1min":0.66600000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.165,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.79200000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.3200000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.0029999999999999,"15min":1.0429999999999999},"min":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1819999999999999,"5min":1.548,"15min":1.548},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.351,"5min":1.681,"15min":1.681},"last":1.399}]},{"osd":5,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.78100000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2010000000000001,"5min":1.341,"15min":1.341},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.135},"min":{"1min":0.80600000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.3260000000000001,"5min":1.397,"15min":1.397},"last":1.4390000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.143,"15min":1.133},"min":{"1min":0.90700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3819999999999999,"5min":1.744,"15min":1.744},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1299999999999999,"15min":1.129},"min":{"1min":0.91400000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.47,"5min":1.52,"15min":1.52},"last":1.641}]}]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.85999999999999999},"min":{"1min":0.67500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.1579999999999999,"5min":1.2,"15min":1.2},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.74399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90000000000000002,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2529999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.133},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.139,"15min":1.2370000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1579999999999999,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.96099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.94999999999999996,"15min":0.93799999999999994},"min":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95699999999999996},"min":{"1min":0.71499999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.1779999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.02,"15min":1.028},"min":{"1min":0.78200000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.228,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.82399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.327,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.98499999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.753,"5min":0.63,"15min":0.63},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1060000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.387,"15min":1.387},"last":1.246}]},{"osd":6,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4019999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.755,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3140000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0660000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.204,"15min":1.218},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.367,"5min":1.738,"15min":1.738},"last":1.319},{"interface":"front","average":{"1min":1.161,"5min":1.181,"15min":1.1919999999999999},"min":{"1min":0.64000000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.458,"5min":1.536,"15min":1.536},"last":1.202}]}]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.66100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.169,"5min":1.194,"15min":1.194},"last":1.089},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91800000000000004,"15min":0.92400000000000004},"min":{"1min":0.69699999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1910000000000001,"5min":1.381,"15min":1.381},"last":1.1930000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.98399999999999999,"15min":0.97399999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3120000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.998,"15min":1.04},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.085,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.014}]},{"osd":2,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.98199999999999998,"15min":1.0049999999999999},"min":{"1min":0.70999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2829999999999999,"5min":1.96,"15min":1.96},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0549999999999999},"min":{"1min":0.71099999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3360000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.407}]},{"osd":3,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.216,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.141},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0009999999999999,"15min":1.032},"min":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2270000000000001,"5min":1.601,"15min":1.601},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.95799999999999996,"15min":0.96999999999999997},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.228,"5min":1.288,"15min":1.288},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0289999999999999},"min":{"1min":0.67100000000000004,"5min":0.628,"15min":0.628},"max":{"1min":1.385,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.2190000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.751,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2569999999999999,"5min":1.518,"15min":1.518},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.103,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.292,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.1439999999999999,"15min":1.1870000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.2949999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.169},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.226,"15min":1.2509999999999999},"min":{"1min":0.76000000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.409,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.304}]}]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1093632,"data_stored":799484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.52400000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.58099999999999996,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0389999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97199999999999998,"5min":1.018,"15min":1.018},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.59699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1779999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.78900000000000003},"min":{"1min":0.61199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1559999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.88,"15min":0.84199999999999997},"min":{"1min":0.83999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.1879999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.018,"15min":0.98799999999999999},"min":{"1min":0.80700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4059999999999999,"5min":1.901,"15min":1.901},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.109,"15min":1.109},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.587,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.80600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1040000000000001,"15min":1.0840000000000001},"min":{"1min":0.85799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.472,"5min":1.984,"15min":1.984},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.173,"5min":1.1439999999999999,"15min":1.1180000000000001},"min":{"1min":0.90700000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.454,"5min":2.012,"15min":2.012},"last":0.89800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.117,"15min":1.109},"min":{"1min":0.80400000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.347,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.012},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.179,"15min":1.151},"min":{"1min":1.0049999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5409999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2090000000000001,"15min":1.1779999999999999},"min":{"1min":0.93999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.544,"5min":2.081,"15min":2.081},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2,"15min":1.177},"min":{"1min":0.95799999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.4359999999999999,"5min":1.667,"15min":1.667},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:47.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:47.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f43a5bc8700 1 Processor -- start 2024-08-17T02:29:47.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f43a5bc8700 1 -- start start 2024-08-17T02:29:47.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f43a5bc8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43a00af030 0x7f43a00a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f43a5bc8700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f43a01598a0 0x7f43a00b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f43a5bc8700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a00b00d0 con 0x7f43a00a8f50 2024-08-17T02:29:47.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f43a5bc8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a00b11b0 con 0x7f43a00af030 2024-08-17T02:29:47.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f43a5bc8700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a0159d40 con 0x7f43a01598a0 2024-08-17T02:29:47.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f439effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43a00af030 0x7f43a00a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f439effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43a00af030 0x7f43a00a9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38426/0 (socket says 172.21.15.19:38426) 2024-08-17T02:29:47.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f439effd700 1 -- 172.21.15.19:0/1863662696 learned_addr learned my addr 172.21.15.19:0/1863662696 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:47.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f439ffff700 1 --2- 172.21.15.19:0/1863662696 >> v2:172.21.15.119:3300/0 conn(0x7f43a01598a0 0x7f43a00b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f439effd700 1 -- 172.21.15.19:0/1863662696 >> v2:172.21.15.119:3300/0 conn(0x7f43a01598a0 msgr2=0x7f43a00b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f439effd700 1 --2- 172.21.15.19:0/1863662696 >> v2:172.21.15.119:3300/0 conn(0x7f43a01598a0 0x7f43a00b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f439effd700 1 -- 172.21.15.19:0/1863662696 >> v1:172.21.15.119:6789/0 conn(0x7f43a00a8f50 legacy=0x7f43a00b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f439effd700 1 -- 172.21.15.19:0/1863662696 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a00af4c0 con 0x7f43a00af030 2024-08-17T02:29:47.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.911+0000 7f439effd700 1 --2- 172.21.15.19:0/1863662696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 0x7f43a00a9320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f43a006ccf0 tx=0x7f4390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c2b28a75a74431 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f439e7fc700 1 -- 172.21.15.19:0/1863662696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439000b860 con 0x7f43a00af030 2024-08-17T02:29:47.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f439e7fc700 1 -- 172.21.15.19:0/1863662696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439000b9c0 con 0x7f43a00af030 2024-08-17T02:29:47.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f439e7fc700 1 -- 172.21.15.19:0/1863662696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439000bd60 con 0x7f43a00af030 2024-08-17T02:29:47.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1863662696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 msgr2=0x7f43a00a9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f43a5bc8700 1 --2- 172.21.15.19:0/1863662696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 0x7f43a00a9320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f43a006ccf0 tx=0x7f4390009250 comp rx=0 tx=0).stop 2024-08-17T02:29:47.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1863662696 shutdown_connections 2024-08-17T02:29:47.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f43a5bc8700 1 --2- 172.21.15.19:0/1863662696 >> v2:172.21.15.119:3300/0 conn(0x7f43a01598a0 0x7f43a00b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f43a5bc8700 1 --2- 172.21.15.19:0/1863662696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 0x7f43a00a9320 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1863662696 >> 172.21.15.19:0/1863662696 conn(0x7f43a0066e00 msgr2=0x7f43a0067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1863662696 shutdown_connections 2024-08-17T02:29:47.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.915+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1863662696 wait complete. 2024-08-17T02:29:47.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 Processor -- start 2024-08-17T02:29:47.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 -- start start 2024-08-17T02:29:47.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a00a8f50 0x7f43a015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 0x7f43a00ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43a01598a0 0x7f43a0141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0097970 con 0x7f43a00af030 2024-08-17T02:29:47.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0096d60 con 0x7f43a00a8f50 2024-08-17T02:29:47.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0097040 con 0x7f43a01598a0 2024-08-17T02:29:47.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 0x7f43a00ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 0x7f43a00ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38440/0 (socket says 172.21.15.19:38440) 2024-08-17T02:29:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439effd700 1 -- 172.21.15.19:0/1159350039 learned_addr learned my addr 172.21.15.19:0/1159350039 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439ffff700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43a01598a0 0x7f43a0141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439f7fe700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a00a8f50 0x7f43a015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439effd700 1 -- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43a01598a0 msgr2=0x7f43a0141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439effd700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43a01598a0 0x7f43a0141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439effd700 1 -- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a00a8f50 msgr2=0x7f43a015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439effd700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a00a8f50 0x7f43a015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439effd700 1 -- 172.21.15.19:0/1159350039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900094f0 con 0x7f43a00af030 2024-08-17T02:29:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f439effd700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 0x7f43a00ac5c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f43a006f870 tx=0x7f4390017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43877fe700 1 -- 172.21.15.19:0/1159350039 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390024440 con 0x7f43a00af030 2024-08-17T02:29:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43877fe700 1 -- 172.21.15.19:0/1159350039 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43900245a0 con 0x7f43a00af030 2024-08-17T02:29:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a0097320 con 0x7f43a00af030 2024-08-17T02:29:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43877fe700 1 -- 172.21.15.19:0/1159350039 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390024960 con 0x7f43a00af030 2024-08-17T02:29:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.919+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a00969f0 con 0x7f43a00af030 2024-08-17T02:29:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.923+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a00977a0 con 0x7f43a00af030 2024-08-17T02:29:47.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.923+0000 7f43877fe700 1 -- 172.21.15.19:0/1159350039 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f439001a420 con 0x7f43a00af030 2024-08-17T02:29:47.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.923+0000 7f43877fe700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f438c060860 0x7f438c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.923+0000 7f43877fe700 1 -- 172.21.15.19:0/1159350039 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f439007e6d0 con 0x7f43a00af030 2024-08-17T02:29:47.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.923+0000 7f439f7fe700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f438c060860 0x7f438c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.923+0000 7f439f7fe700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f438c060860 0x7f438c062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4394003a80 tx=0x7f4394007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:47.931+0000 7f43877fe700 1 -- 172.21.15.19:0/1159350039 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f439004ed20 con 0x7f43a00af030 2024-08-17T02:29:48.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.091+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43a00645c0 con 0x7f438c060860 2024-08-17T02:29:48.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43877fe700 1 -- 172.21.15.19:0/1159350039 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48807 (secure 0 0 0) 0x7f43a00645c0 con 0x7f438c060860 2024-08-17T02:29:48.102 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f438c060860 msgr2=0x7f438c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f438c060860 0x7f438c062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4394003a80 tx=0x7f4394007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 msgr2=0x7f43a00ac5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 0x7f43a00ac5c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f43a006f870 tx=0x7f4390017000 comp rx=0 tx=0).stop 2024-08-17T02:29:48.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 shutdown_connections 2024-08-17T02:29:48.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f438c060860 0x7f438c062d10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43a01598a0 0x7f43a0141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a00af030 0x7f43a00ac5c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 --2- 172.21.15.19:0/1159350039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43a00a8f50 0x7f43a015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 >> 172.21.15.19:0/1159350039 conn(0x7f43a0066e00 msgr2=0x7f43a006acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 shutdown_connections 2024-08-17T02:29:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.099+0000 7f43a5bc8700 1 -- 172.21.15.19:0/1159350039 wait complete. 2024-08-17T02:29:48.106 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:29:48.116 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-17T02:29:46.840430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":2388112,"kb_used_data":5096,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586608,"statfs":{"total":773094113280,"available":770648686592,"internally_reserved":0,"allocated":5218304,"data_stored":2864960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001802"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:42.405325+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:29:42.405325+0000","last_peered":"2024-08-17T02:29:42.405325+0000","last_clean":"2024-08-17T02:29:42.405325+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:29:42.405325+0000","last_undegraded":"2024-08-17T02:29:42.405325+0000","last_fullsized":"2024-08-17T02:29:42.405325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68999999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":1.107,"15min":1.107},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76400000000000001,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0649999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.073,"5min":1.121,"15min":1.121},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92600000000000005},"min":{"1min":0.64400000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3089999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.327,"5min":1.425,"15min":1.425},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.60599999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.82199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0109999999999999,"15min":1.0309999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.745},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.069,"15min":1.0940000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.179,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0669999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1259999999999999,"15min":1.155},"min":{"1min":0.85499999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.1930000000000001,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1930000000000001,"15min":1.2190000000000001},"min":{"1min":0.85299999999999998,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.3819999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.83899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.369,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2210000000000001,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.879}]},{"osd":7,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.244,"15min":1.262},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.4370000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.25,"15min":1.2729999999999999},"min":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.4410000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":0.61899999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.54800000000000004,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.032,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.51500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0569999999999999,"5min":4.0860000000000003,"15min":4.0860000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.74099999999999999},"min":{"1min":0.61899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1519999999999999,"5min":1.704,"15min":1.704},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.60599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1040000000000001,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.997,"5min":0.91000000000000003,"15min":0.89000000000000001},"min":{"1min":0.85499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.286,"5min":1.486,"15min":1.486},"last":0.84999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.034,"15min":1.006},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3720000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.0449999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.097},"min":{"1min":0.81200000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3009999999999999,"5min":3.484,"15min":3.484},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1499999999999999,"15min":1.1220000000000001},"min":{"1min":0.96899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4950000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1519999999999999,"15min":1.151},"min":{"1min":0.86299999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.486,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.181,"15min":1.2070000000000001},"min":{"1min":0.88900000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4390000000000001,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":1.077}]},{"osd":7,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2290000000000001,"15min":1.2210000000000001},"min":{"1min":1.03,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5740000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.24,"15min":1.264},"min":{"1min":0.89500000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.3779999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":1.1619999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95099999999999996,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.54300000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.80200000000000005},"min":{"1min":0.67100000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.153,"15min":1.153},"last":0.84799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.83699999999999997,"15min":0.82299999999999995},"min":{"1min":0.69599999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.149,"5min":1.381,"15min":1.381},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.80500000000000005,"15min":0.77500000000000002},"min":{"1min":0.624,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1950000000000001,"5min":1.468,"15min":1.468},"last":1.3029999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.97799999999999998,"15min":0.95199999999999996},"min":{"1min":0.79500000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.98999999999999999,"15min":0.97199999999999998},"min":{"1min":0.79800000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.01}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":0.995,"15min":0.98599999999999999},"min":{"1min":0.77800000000000002,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.145,"5min":1.137,"15min":1.121},"min":{"1min":0.80100000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.196}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0700000000000001,"15min":1.04},"min":{"1min":0.85899999999999999,"5min":0.62,"15min":0.62},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.089,"15min":1.071},"min":{"1min":0.84599999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.4399999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.121}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1839999999999999,"15min":1.169},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5780000000000001,"5min":1.825,"15min":1.825},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.177,"15min":1.1599999999999999},"min":{"1min":0.97599999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4830000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.48}]}]},{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298428,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073412,"statfs":{"total":96636764160,"available":96331173888,"internally_reserved":0,"allocated":1093632,"data_stored":799484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98899999999999999,"15min":1.036},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3380000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.137}]},{"osd":1,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.998,"15min":1.048},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.3660000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.097},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.27,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.88200000000000001,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.083,"5min":1.452,"15min":1.452},"last":1.171},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.022,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.117,"5min":2.056,"15min":2.056},"last":0.69499999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.226,"5min":1.409,"15min":1.409},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1739999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.0589999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.008,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.238,"5min":1.431,"15min":1.431},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0329999999999999,"15min":1.0529999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2170000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.129,"15min":1.1879999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2889999999999999,"5min":2,"15min":2},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1519999999999999,"15min":1.1759999999999999},"min":{"1min":0.79500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.282,"5min":1.53,"15min":1.53},"last":1.018}]},{"osd":6,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0820000000000001,"15min":1.1080000000000001},"min":{"1min":0.79900000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.27,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.319,"15min":1.391},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5109999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":0.98399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.3069999999999999,"5min":1.335,"15min":1.335},"last":0.63},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1200000000000001,"5min":1.216,"15min":1.216},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.69399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.3340000000000001,"5min":1.359,"15min":1.359},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.90200000000000002,"15min":0.91800000000000004},"min":{"1min":0.65800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.224,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0960000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0029999999999999,"15min":1.014},"min":{"1min":0.66700000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.107,"15min":1.1060000000000001},"min":{"1min":0.81699999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.248,"5min":1.373,"15min":1.373},"last":1.028}]},{"osd":3,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91300000000000003,"15min":0.90700000000000003},"min":{"1min":0.66600000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.165,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.79200000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.3200000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.0029999999999999,"15min":1.0429999999999999},"min":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1819999999999999,"5min":1.548,"15min":1.548},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.351,"5min":1.681,"15min":1.681},"last":1.399}]},{"osd":5,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.78100000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2010000000000001,"5min":1.341,"15min":1.341},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.135},"min":{"1min":0.80600000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.3260000000000001,"5min":1.397,"15min":1.397},"last":1.4390000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.143,"15min":1.133},"min":{"1min":0.90700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3819999999999999,"5min":1.744,"15min":1.744},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1299999999999999,"15min":1.129},"min":{"1min":0.91400000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.47,"5min":1.52,"15min":1.52},"last":1.641}]}]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.85999999999999999},"min":{"1min":0.67500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.1579999999999999,"5min":1.2,"15min":1.2},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.74399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90000000000000002,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2529999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.133},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.139,"15min":1.2370000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1579999999999999,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.96099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.94999999999999996,"15min":0.93799999999999994},"min":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95699999999999996},"min":{"1min":0.71499999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.1779999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.02,"15min":1.028},"min":{"1min":0.78200000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.228,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.82399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.327,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.98499999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.753,"5min":0.63,"15min":0.63},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1060000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.387,"15min":1.387},"last":1.246}]},{"osd":6,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4019999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.755,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3140000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0660000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.204,"15min":1.218},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.367,"5min":1.738,"15min":1.738},"last":1.319},{"interface":"front","average":{"1min":1.161,"5min":1.181,"15min":1.1919999999999999},"min":{"1min":0.64000000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.458,"5min":1.536,"15min":1.536},"last":1.202}]}]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.66100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.169,"5min":1.194,"15min":1.194},"last":1.089},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91800000000000004,"15min":0.92400000000000004},"min":{"1min":0.69699999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1910000000000001,"5min":1.381,"15min":1.381},"last":1.1930000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.98399999999999999,"15min":0.97399999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3120000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.998,"15min":1.04},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.085,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.014}]},{"osd":2,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.98199999999999998,"15min":1.0049999999999999},"min":{"1min":0.70999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2829999999999999,"5min":1.96,"15min":1.96},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0549999999999999},"min":{"1min":0.71099999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3360000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.407}]},{"osd":3,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.216,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.141},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0009999999999999,"15min":1.032},"min":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2270000000000001,"5min":1.601,"15min":1.601},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.95799999999999996,"15min":0.96999999999999997},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.228,"5min":1.288,"15min":1.288},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0289999999999999},"min":{"1min":0.67100000000000004,"5min":0.628,"15min":0.628},"max":{"1min":1.385,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.2190000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.751,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2569999999999999,"5min":1.518,"15min":1.518},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.103,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.292,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.1439999999999999,"15min":1.1870000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.2949999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.169},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.226,"15min":1.2509999999999999},"min":{"1min":0.76000000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.409,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.304}]}]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1093632,"data_stored":799484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.52400000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.58099999999999996,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0389999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97199999999999998,"5min":1.018,"15min":1.018},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.59699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1779999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.78900000000000003},"min":{"1min":0.61199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1559999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.88,"15min":0.84199999999999997},"min":{"1min":0.83999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.1879999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.018,"15min":0.98799999999999999},"min":{"1min":0.80700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4059999999999999,"5min":1.901,"15min":1.901},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.109,"15min":1.109},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.587,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.80600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1040000000000001,"15min":1.0840000000000001},"min":{"1min":0.85799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.472,"5min":1.984,"15min":1.984},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.173,"5min":1.1439999999999999,"15min":1.1180000000000001},"min":{"1min":0.90700000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.454,"5min":2.012,"15min":2.012},"last":0.89800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.117,"15min":1.109},"min":{"1min":0.80400000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.347,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.012},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.179,"15min":1.151},"min":{"1min":1.0049999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5409999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2090000000000001,"15min":1.1779999999999999},"min":{"1min":0.93999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.544,"5min":2.081,"15min":2.081},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2,"15min":1.177},"min":{"1min":0.95799999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.4359999999999999,"5min":1.667,"15min":1.667},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:48.118 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:29:48.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f275d78b700 1 Processor -- start 2024-08-17T02:29:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f275d78b700 1 -- start start 2024-08-17T02:29:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f275d78b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f275815d540 0x7f27580af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f275d78b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f275806e830 0x7f27580a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f275d78b700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580b0270 con 0x7f27580a9260 2024-08-17T02:29:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f275d78b700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580af660 con 0x7f275806e830 2024-08-17T02:29:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f275d78b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27580af940 con 0x7f275815d540 2024-08-17T02:29:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2756ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f275815d540 0x7f27580af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2756ffd700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f275815d540 0x7f27580af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:42646/0 (socket says 172.21.15.19:42646) 2024-08-17T02:29:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2756ffd700 1 -- 172.21.15.19:0/275685503 learned_addr learned my addr 172.21.15.19:0/275685503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f27567fc700 1 --2- 172.21.15.19:0/275685503 >> v2:172.21.15.119:3300/0 conn(0x7f275806e830 0x7f27580a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2756ffd700 1 -- 172.21.15.19:0/275685503 >> v2:172.21.15.119:3300/0 conn(0x7f275806e830 msgr2=0x7f27580a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2756ffd700 1 --2- 172.21.15.19:0/275685503 >> v2:172.21.15.119:3300/0 conn(0x7f275806e830 0x7f27580a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2756ffd700 1 -- 172.21.15.19:0/275685503 >> v1:172.21.15.119:6789/0 conn(0x7f27580a9260 legacy=0x7f27580b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2756ffd700 1 -- 172.21.15.19:0/275685503 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580afc20 con 0x7f275815d540 2024-08-17T02:29:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2756ffd700 1 --2- 172.21.15.19:0/275685503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f275815d540 0x7f27580af030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2740009f20 tx=0x7f2740009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4317b47d8637b032 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2755ffb700 1 -- 172.21.15.19:0/275685503 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274000e070 con 0x7f275815d540 2024-08-17T02:29:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2755ffb700 1 -- 172.21.15.19:0/275685503 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274000b9d0 con 0x7f275815d540 2024-08-17T02:29:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f2755ffb700 1 -- 172.21.15.19:0/275685503 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400092e0 con 0x7f275815d540 2024-08-17T02:29:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f275d78b700 1 -- 172.21.15.19:0/275685503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f275815d540 msgr2=0x7f27580af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.223+0000 7f275d78b700 1 --2- 172.21.15.19:0/275685503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f275815d540 0x7f27580af030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2740009f20 tx=0x7f2740009840 comp rx=0 tx=0).stop 2024-08-17T02:29:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 -- 172.21.15.19:0/275685503 shutdown_connections 2024-08-17T02:29:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 --2- 172.21.15.19:0/275685503 >> v2:172.21.15.119:3300/0 conn(0x7f275806e830 0x7f27580a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 --2- 172.21.15.19:0/275685503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f275815d540 0x7f27580af030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 -- 172.21.15.19:0/275685503 >> 172.21.15.19:0/275685503 conn(0x7f2758066e00 msgr2=0x7f2758067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 -- 172.21.15.19:0/275685503 shutdown_connections 2024-08-17T02:29:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 -- 172.21.15.19:0/275685503 wait complete. 2024-08-17T02:29:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 Processor -- start 2024-08-17T02:29:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 -- start start 2024-08-17T02:29:48.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f275806e830 0x7f2758146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580a9260 0x7f27580aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275815d540 0x7f27580ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2758147190 con 0x7f275806e830 2024-08-17T02:29:48.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2758096fc0 con 0x7f275815d540 2024-08-17T02:29:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f275d78b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2758097e20 con 0x7f27580a9260 2024-08-17T02:29:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f2756ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f275806e830 0x7f2758146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f27567fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580a9260 0x7f27580aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f27567fc700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580a9260 0x7f27580aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:42648/0 (socket says 172.21.15.19:42648) 2024-08-17T02:29:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f27567fc700 1 -- 172.21.15.19:0/3260668095 learned_addr learned my addr 172.21.15.19:0/3260668095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f2756ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f275806e830 0x7f2758146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38442/0 (socket says 172.21.15.19:38442) 2024-08-17T02:29:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f27577fe700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275815d540 0x7f27580ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f2756ffd700 1 -- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580a9260 msgr2=0x7f27580aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f2756ffd700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580a9260 0x7f27580aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f2756ffd700 1 -- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275815d540 msgr2=0x7f27580ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f2756ffd700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275815d540 0x7f27580ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.227+0000 7f2756ffd700 1 -- 172.21.15.19:0/3260668095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740009ae0 con 0x7f275806e830 2024-08-17T02:29:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.231+0000 7f2756ffd700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f275806e830 0x7f2758146c50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f27581623b0 tx=0x7f2740018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.231+0000 7f274effd700 1 -- 172.21.15.19:0/3260668095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400078e0 con 0x7f275806e830 2024-08-17T02:29:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.231+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2758097210 con 0x7f275806e830 2024-08-17T02:29:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.231+0000 7f274effd700 1 -- 172.21.15.19:0/3260668095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740007a80 con 0x7f275806e830 2024-08-17T02:29:48.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.231+0000 7f274effd700 1 -- 172.21.15.19:0/3260668095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740007e40 con 0x7f275806e830 2024-08-17T02:29:48.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.231+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27580977d0 con 0x7f275806e830 2024-08-17T02:29:48.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.231+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27580645c0 con 0x7f275806e830 2024-08-17T02:29:48.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.231+0000 7f274effd700 1 -- 172.21.15.19:0/3260668095 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2740003040 con 0x7f275806e830 2024-08-17T02:29:48.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.235+0000 7f274effd700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f273c060860 0x7f273c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.235+0000 7f274effd700 1 -- 172.21.15.19:0/3260668095 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f274007e220 con 0x7f275806e830 2024-08-17T02:29:48.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.235+0000 7f27567fc700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f273c060860 0x7f273c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.235+0000 7f27567fc700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f273c060860 0x7f273c062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2758096d40 tx=0x7f27500091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.243+0000 7f274effd700 1 -- 172.21.15.19:0/3260668095 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f274004e870 con 0x7f275806e830 2024-08-17T02:29:48.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.403+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f275806f360 con 0x7f273c060860 2024-08-17T02:29:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f274effd700 1 -- 172.21.15.19:0/3260668095 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48807 (secure 0 0 0) 0x7f275806f360 con 0x7f273c060860 2024-08-17T02:29:48.416 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f273c060860 msgr2=0x7f273c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f273c060860 0x7f273c062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2758096d40 tx=0x7f27500091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f275806e830 msgr2=0x7f2758146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f275806e830 0x7f2758146c50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f27581623b0 tx=0x7f2740018000 comp rx=0 tx=0).stop 2024-08-17T02:29:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 shutdown_connections 2024-08-17T02:29:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f273c060860 0x7f273c062d10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f275815d540 0x7f27580ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580a9260 0x7f27580aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 --2- 172.21.15.19:0/3260668095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f275806e830 0x7f2758146c50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.411+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 >> 172.21.15.19:0/3260668095 conn(0x7f2758066e00 msgr2=0x7f27580ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.415+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 shutdown_connections 2024-08-17T02:29:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.415+0000 7f275d78b700 1 -- 172.21.15.19:0/3260668095 wait complete. 2024-08-17T02:29:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:29:48.430 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-08-17T02:29:46.840430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":2388112,"kb_used_data":5096,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586608,"statfs":{"total":773094113280,"available":770648686592,"internally_reserved":0,"allocated":5218304,"data_stored":2864960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001802"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:42.405325+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:29:42.405325+0000","last_peered":"2024-08-17T02:29:42.405325+0000","last_clean":"2024-08-17T02:29:42.405325+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:29:42.405325+0000","last_undegraded":"2024-08-17T02:29:42.405325+0000","last_fullsized":"2024-08-17T02:29:42.405325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509486,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68999999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":1.107,"15min":1.107},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76400000000000001,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0649999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.073,"5min":1.121,"15min":1.121},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92600000000000005},"min":{"1min":0.64400000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3089999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.327,"5min":1.425,"15min":1.425},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.60599999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.82199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0109999999999999,"15min":1.0309999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.745},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.069,"15min":1.0940000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.179,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0669999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1259999999999999,"15min":1.155},"min":{"1min":0.85499999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.1930000000000001,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1930000000000001,"15min":1.2190000000000001},"min":{"1min":0.85299999999999998,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.3819999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.83899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.369,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2210000000000001,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.879}]},{"osd":7,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.244,"15min":1.262},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.4370000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.25,"15min":1.2729999999999999},"min":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.4410000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":0.61899999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.54800000000000004,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.032,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.51500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0569999999999999,"5min":4.0860000000000003,"15min":4.0860000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.74099999999999999},"min":{"1min":0.61899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1519999999999999,"5min":1.704,"15min":1.704},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.60599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1040000000000001,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.997,"5min":0.91000000000000003,"15min":0.89000000000000001},"min":{"1min":0.85499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.286,"5min":1.486,"15min":1.486},"last":0.84999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.034,"15min":1.006},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3720000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.0449999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.097},"min":{"1min":0.81200000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3009999999999999,"5min":3.484,"15min":3.484},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1499999999999999,"15min":1.1220000000000001},"min":{"1min":0.96899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4950000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1519999999999999,"15min":1.151},"min":{"1min":0.86299999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.486,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.181,"15min":1.2070000000000001},"min":{"1min":0.88900000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4390000000000001,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":1.077}]},{"osd":7,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2290000000000001,"15min":1.2210000000000001},"min":{"1min":1.03,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5740000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.24,"15min":1.264},"min":{"1min":0.89500000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.3779999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":1.1619999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95099999999999996,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.54300000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.80200000000000005},"min":{"1min":0.67100000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.153,"15min":1.153},"last":0.84799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.83699999999999997,"15min":0.82299999999999995},"min":{"1min":0.69599999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.149,"5min":1.381,"15min":1.381},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.80500000000000005,"15min":0.77500000000000002},"min":{"1min":0.624,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1950000000000001,"5min":1.468,"15min":1.468},"last":1.3029999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.97799999999999998,"15min":0.95199999999999996},"min":{"1min":0.79500000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.98999999999999999,"15min":0.97199999999999998},"min":{"1min":0.79800000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.01}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":0.995,"15min":0.98599999999999999},"min":{"1min":0.77800000000000002,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.145,"5min":1.137,"15min":1.121},"min":{"1min":0.80100000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.196}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0700000000000001,"15min":1.04},"min":{"1min":0.85899999999999999,"5min":0.62,"15min":0.62},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.089,"15min":1.071},"min":{"1min":0.84599999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.4399999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.121}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1839999999999999,"15min":1.169},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5780000000000001,"5min":1.825,"15min":1.825},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.177,"15min":1.1599999999999999},"min":{"1min":0.97599999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4830000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.48}]}]},{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298428,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073412,"statfs":{"total":96636764160,"available":96331173888,"internally_reserved":0,"allocated":1093632,"data_stored":799484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98899999999999999,"15min":1.036},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3380000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.137}]},{"osd":1,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.998,"15min":1.048},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.3660000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.097},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.27,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.88200000000000001,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.083,"5min":1.452,"15min":1.452},"last":1.171},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.022,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.117,"5min":2.056,"15min":2.056},"last":0.69499999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.226,"5min":1.409,"15min":1.409},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1739999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.0589999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.008,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.238,"5min":1.431,"15min":1.431},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0329999999999999,"15min":1.0529999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2170000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.129,"15min":1.1879999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2889999999999999,"5min":2,"15min":2},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1519999999999999,"15min":1.1759999999999999},"min":{"1min":0.79500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.282,"5min":1.53,"15min":1.53},"last":1.018}]},{"osd":6,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0820000000000001,"15min":1.1080000000000001},"min":{"1min":0.79900000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.27,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.141,"5min":1.319,"15min":1.391},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5109999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":0.98399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.3069999999999999,"5min":1.335,"15min":1.335},"last":0.63},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1200000000000001,"5min":1.216,"15min":1.216},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.69399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.3340000000000001,"5min":1.359,"15min":1.359},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.90200000000000002,"15min":0.91800000000000004},"min":{"1min":0.65800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.224,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0960000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0029999999999999,"15min":1.014},"min":{"1min":0.66700000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.093,"5min":1.107,"15min":1.1060000000000001},"min":{"1min":0.81699999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.248,"5min":1.373,"15min":1.373},"last":1.028}]},{"osd":3,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91300000000000003,"15min":0.90700000000000003},"min":{"1min":0.66600000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.165,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.79200000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.3200000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.0029999999999999,"15min":1.0429999999999999},"min":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1819999999999999,"5min":1.548,"15min":1.548},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.351,"5min":1.681,"15min":1.681},"last":1.399}]},{"osd":5,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.78100000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2010000000000001,"5min":1.341,"15min":1.341},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.135},"min":{"1min":0.80600000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.3260000000000001,"5min":1.397,"15min":1.397},"last":1.4390000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.143,"15min":1.133},"min":{"1min":0.90700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3819999999999999,"5min":1.744,"15min":1.744},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1299999999999999,"15min":1.129},"min":{"1min":0.91400000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.47,"5min":1.52,"15min":1.52},"last":1.641}]}]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.85999999999999999},"min":{"1min":0.67500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.1579999999999999,"5min":1.2,"15min":1.2},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.74399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90000000000000002,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2529999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.133},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.139,"15min":1.2370000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1579999999999999,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.96099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.94999999999999996,"15min":0.93799999999999994},"min":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95699999999999996},"min":{"1min":0.71499999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.1779999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.02,"15min":1.028},"min":{"1min":0.78200000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.228,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.82399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.327,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.98499999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.753,"5min":0.63,"15min":0.63},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1060000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.387,"15min":1.387},"last":1.246}]},{"osd":6,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4019999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.755,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3140000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0660000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.204,"15min":1.218},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.367,"5min":1.738,"15min":1.738},"last":1.319},{"interface":"front","average":{"1min":1.161,"5min":1.181,"15min":1.1919999999999999},"min":{"1min":0.64000000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.458,"5min":1.536,"15min":1.536},"last":1.202}]}]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":499712,"data_stored":209116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.66100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.169,"5min":1.194,"15min":1.194},"last":1.089},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91800000000000004,"15min":0.92400000000000004},"min":{"1min":0.69699999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1910000000000001,"5min":1.381,"15min":1.381},"last":1.1930000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.98399999999999999,"15min":0.97399999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3120000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.998,"15min":1.04},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.085,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.014}]},{"osd":2,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.98199999999999998,"15min":1.0049999999999999},"min":{"1min":0.70999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2829999999999999,"5min":1.96,"15min":1.96},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0549999999999999},"min":{"1min":0.71099999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3360000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.407}]},{"osd":3,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.216,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.141},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0009999999999999,"15min":1.032},"min":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2270000000000001,"5min":1.601,"15min":1.601},"last":1.2789999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.95799999999999996,"15min":0.96999999999999997},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.228,"5min":1.288,"15min":1.288},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0289999999999999},"min":{"1min":0.67100000000000004,"5min":0.628,"15min":0.628},"max":{"1min":1.385,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.2190000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.751,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2569999999999999,"5min":1.518,"15min":1.518},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.103,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.292,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.1439999999999999,"15min":1.1870000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.2949999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.169},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.226,"15min":1.2509999999999999},"min":{"1min":0.76000000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.409,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.304}]}]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1093632,"data_stored":799484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.52400000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.58099999999999996,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0389999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97199999999999998,"5min":1.018,"15min":1.018},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.59699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1779999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.78900000000000003},"min":{"1min":0.61199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1559999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.88,"15min":0.84199999999999997},"min":{"1min":0.83999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.1879999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.018,"15min":0.98799999999999999},"min":{"1min":0.80700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4059999999999999,"5min":1.901,"15min":1.901},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.109,"15min":1.109},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.587,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.80600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1040000000000001,"15min":1.0840000000000001},"min":{"1min":0.85799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.472,"5min":1.984,"15min":1.984},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.173,"5min":1.1439999999999999,"15min":1.1180000000000001},"min":{"1min":0.90700000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.454,"5min":2.012,"15min":2.012},"last":0.89800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.117,"15min":1.109},"min":{"1min":0.80400000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.347,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.012},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.179,"15min":1.151},"min":{"1min":1.0049999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5409999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2090000000000001,"15min":1.1779999999999999},"min":{"1min":0.93999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.544,"5min":2.081,"15min":2.081},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2,"15min":1.177},"min":{"1min":0.95799999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.4359999999999999,"5min":1.667,"15min":1.667},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:48.432 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:48.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562b54700 1 Processor -- start 2024-08-17T02:29:48.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562b54700 1 -- start start 2024-08-17T02:29:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562b54700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb55c1617b0 0x7fb55c0b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562b54700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb55c0adfa0 0x7fb55c0ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562b54700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0acf00 con 0x7fb55c1613e0 2024-08-17T02:29:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562b54700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0ad1e0 con 0x7fb55c0adfa0 2024-08-17T02:29:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562b54700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0ad4c0 con 0x7fb55c1617b0 2024-08-17T02:29:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb561b52700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb55c1613e0 0x7fb55c0ac6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52320/0 (socket says 172.21.15.19:52320) 2024-08-17T02:29:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb561b52700 1 -- 172.21.15.19:0/45945737 learned_addr learned my addr 172.21.15.19:0/45945737 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562353700 1 --2- 172.21.15.19:0/45945737 >> v2:172.21.15.19:3300/0 conn(0x7fb55c0adfa0 0x7fb55c0ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb561351700 1 --2- 172.21.15.19:0/45945737 >> v2:172.21.15.119:3300/0 conn(0x7fb55c1617b0 0x7fb55c0b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb560b50700 1 -- 172.21.15.19:0/45945737 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597335335 0 0) 0x7fb55c0acf00 con 0x7fb55c1613e0 2024-08-17T02:29:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb560b50700 1 -- 172.21.15.19:0/45945737 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb548003570 con 0x7fb55c1613e0 2024-08-17T02:29:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562353700 1 -- 172.21.15.19:0/45945737 >> v2:172.21.15.119:3300/0 conn(0x7fb55c1617b0 msgr2=0x7fb55c0b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562353700 1 --2- 172.21.15.19:0/45945737 >> v2:172.21.15.119:3300/0 conn(0x7fb55c1617b0 0x7fb55c0b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562353700 1 -- 172.21.15.19:0/45945737 >> v1:172.21.15.19:6789/0 conn(0x7fb55c1613e0 legacy=0x7fb55c0ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562353700 1 -- 172.21.15.19:0/45945737 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0ad7a0 con 0x7fb55c0adfa0 2024-08-17T02:29:48.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb562353700 1 --2- 172.21.15.19:0/45945737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c0adfa0 0x7fb55c0ae400 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb55c06df00 tx=0x7fb5540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8a5370f2afa3ad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb560b50700 1 -- 172.21.15.19:0/45945737 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554011630 con 0x7fb55c0adfa0 2024-08-17T02:29:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.531+0000 7fb560b50700 1 -- 172.21.15.19:0/45945737 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5540117b0 con 0x7fb55c0adfa0 2024-08-17T02:29:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb560b50700 1 -- 172.21.15.19:0/45945737 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554011b70 con 0x7fb55c0adfa0 2024-08-17T02:29:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 -- 172.21.15.19:0/45945737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c0adfa0 msgr2=0x7fb55c0ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 --2- 172.21.15.19:0/45945737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c0adfa0 0x7fb55c0ae400 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb55c06df00 tx=0x7fb5540091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 -- 172.21.15.19:0/45945737 shutdown_connections 2024-08-17T02:29:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 --2- 172.21.15.19:0/45945737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c0adfa0 0x7fb55c0ae400 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 --2- 172.21.15.19:0/45945737 >> v2:172.21.15.119:3300/0 conn(0x7fb55c1617b0 0x7fb55c0b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 -- 172.21.15.19:0/45945737 >> 172.21.15.19:0/45945737 conn(0x7fb55c0c9840 msgr2=0x7fb55c0c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 -- 172.21.15.19:0/45945737 shutdown_connections 2024-08-17T02:29:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 -- 172.21.15.19:0/45945737 wait complete. 2024-08-17T02:29:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 Processor -- start 2024-08-17T02:29:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 -- start start 2024-08-17T02:29:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55c0adfa0 0x7fb55c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c1613e0 0x7fb55c06b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55c1617b0 0x7fb55c15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c147870 con 0x7fb55c1613e0 2024-08-17T02:29:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c146c40 con 0x7fb55c0adfa0 2024-08-17T02:29:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562b54700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c147a60 con 0x7fb55c1617b0 2024-08-17T02:29:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561351700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c1613e0 0x7fb55c06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561351700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c1613e0 0x7fb55c06b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38474/0 (socket says 172.21.15.19:38474) 2024-08-17T02:29:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561351700 1 -- 172.21.15.19:0/301625193 learned_addr learned my addr 172.21.15.19:0/301625193 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561b52700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55c0adfa0 0x7fb55c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb562353700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55c1617b0 0x7fb55c15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561b52700 1 -- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55c1617b0 msgr2=0x7fb55c15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561b52700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55c1617b0 0x7fb55c15b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561b52700 1 -- 172.21.15.19:0/301625193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c1613e0 msgr2=0x7fb55c06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561b52700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c1613e0 0x7fb55c06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561b52700 1 -- 172.21.15.19:0/301625193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb554009420 con 0x7fb55c0adfa0 2024-08-17T02:29:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.535+0000 7fb561351700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c1613e0 0x7fb55c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.539+0000 7fb561b52700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55c0adfa0 0x7fb55c146700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00cc20 tx=0x7fb54c001a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.539+0000 7fb559ffb700 1 -- 172.21.15.19:0/301625193 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00a8b0 con 0x7fb55c0adfa0 2024-08-17T02:29:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.539+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c147d40 con 0x7fb55c0adfa0 2024-08-17T02:29:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.539+0000 7fb559ffb700 1 -- 172.21.15.19:0/301625193 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00aa30 con 0x7fb55c0adfa0 2024-08-17T02:29:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.539+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c148300 con 0x7fb55c0adfa0 2024-08-17T02:29:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.539+0000 7fb559ffb700 1 -- 172.21.15.19:0/301625193 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00adf0 con 0x7fb55c0adfa0 2024-08-17T02:29:48.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.539+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c0638f0 con 0x7fb55c0adfa0 2024-08-17T02:29:48.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.539+0000 7fb559ffb700 1 -- 172.21.15.19:0/301625193 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb54c007300 con 0x7fb55c0adfa0 2024-08-17T02:29:48.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.539+0000 7fb559ffb700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb53c060860 0x7fb53c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.543+0000 7fb559ffb700 1 -- 172.21.15.19:0/301625193 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb54c07cc60 con 0x7fb55c0adfa0 2024-08-17T02:29:48.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.543+0000 7fb561351700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb53c060860 0x7fb53c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.543+0000 7fb561351700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb53c060860 0x7fb53c062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb55c06d6b0 tx=0x7fb5440091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.555+0000 7fb559ffb700 1 -- 172.21.15.19:0/301625193 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb54c04d400 con 0x7fb55c0adfa0 2024-08-17T02:29:48.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.719+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb55c160f20 con 0x7fb55c0adfa0 2024-08-17T02:29:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.723+0000 7fb559ffb700 1 -- 172.21.15.19:0/301625193 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12393 (secure 0 0 0) 0x7fb54c050a20 con 0x7fb55c0adfa0 2024-08-17T02:29:48.728 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:48.728 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":44,"fsid":"1a630ac0-5cc8-463b-a63c-db2f048e27a8","created":"2024-08-17T02:26:04.435168+0000","modified":"2024-08-17T02:29:45.408715+0000","last_up_change":"2024-08-17T02:26:16.527650+0000","last_in_change":"2024-08-17T02:26:07.445054+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:26:16.814760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c6e9266d-5f6c-4327-aaec-6938eacc3f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":24143},{"type":"v1","addr":"172.21.15.19:6801","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":24143},{"type":"v1","addr":"172.21.15.19:6803","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":24143},{"type":"v1","addr":"172.21.15.19:6810","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":24143},{"type":"v1","addr":"172.21.15.19:6806","nonce":24143}]},"public_addr":"172.21.15.19:6801/24143","cluster_addr":"172.21.15.19:6803/24143","heartbeat_back_addr":"172.21.15.19:6810/24143","heartbeat_front_addr":"172.21.15.19:6806/24143","state":["exists","up"]},{"osd":1,"uuid":"689e83b1-86c1-4c9f-befa-a6ba82b34a98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":24141},{"type":"v1","addr":"172.21.15.19:6817","nonce":24141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":24141},{"type":"v1","addr":"172.21.15.19:6819","nonce":24141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":24141},{"type":"v1","addr":"172.21.15.19:6823","nonce":24141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":24141},{"type":"v1","addr":"172.21.15.19:6821","nonce":24141}]},"public_addr":"172.21.15.19:6817/24141","cluster_addr":"172.21.15.19:6819/24141","heartbeat_back_addr":"172.21.15.19:6823/24141","heartbeat_front_addr":"172.21.15.19:6821/24141","state":["exists","up"]},{"osd":2,"uuid":"3baa2f45-afde-49eb-9956-3cb368a42cf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":24142},{"type":"v1","addr":"172.21.15.19:6807","nonce":24142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6809","nonce":24142},{"type":"v1","addr":"172.21.15.19:6811","nonce":24142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":24142},{"type":"v1","addr":"172.21.15.19:6815","nonce":24142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":24142},{"type":"v1","addr":"172.21.15.19:6813","nonce":24142}]},"public_addr":"172.21.15.19:6807/24142","cluster_addr":"172.21.15.19:6811/24142","heartbeat_back_addr":"172.21.15.19:6815/24142","heartbeat_front_addr":"172.21.15.19:6813/24142","state":["exists","up"]},{"osd":3,"uuid":"6a303011-b8e6-49e8-abdc-db3500d77e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":24152},{"type":"v1","addr":"172.21.15.19:6825","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":24152},{"type":"v1","addr":"172.21.15.19:6827","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":24152},{"type":"v1","addr":"172.21.15.19:6831","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":24152},{"type":"v1","addr":"172.21.15.19:6829","nonce":24152}]},"public_addr":"172.21.15.19:6825/24152","cluster_addr":"172.21.15.19:6827/24152","heartbeat_back_addr":"172.21.15.19:6831/24152","heartbeat_front_addr":"172.21.15.19:6829/24152","state":["exists","up"]},{"osd":4,"uuid":"d1b54d11-84a8-44e6-9c75-bcfa4d4820e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":24494},{"type":"v1","addr":"172.21.15.119:6825","nonce":24494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":24494},{"type":"v1","addr":"172.21.15.119:6827","nonce":24494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":24494},{"type":"v1","addr":"172.21.15.119:6831","nonce":24494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":24494},{"type":"v1","addr":"172.21.15.119:6829","nonce":24494}]},"public_addr":"172.21.15.119:6825/24494","cluster_addr":"172.21.15.119:6827/24494","heartbeat_back_addr":"172.21.15.119:6831/24494","heartbeat_front_addr":"172.21.15.119:6829/24494","state":["exists","up"]},{"osd":5,"uuid":"fb65c9d4-fe1a-4691-9e07-c04f8b44b769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":24492},{"type":"v1","addr":"172.21.15.119:6801","nonce":24492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":24492},{"type":"v1","addr":"172.21.15.119:6803","nonce":24492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":24492},{"type":"v1","addr":"172.21.15.119:6807","nonce":24492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":24492},{"type":"v1","addr":"172.21.15.119:6805","nonce":24492}]},"public_addr":"172.21.15.119:6801/24492","cluster_addr":"172.21.15.119:6803/24492","heartbeat_back_addr":"172.21.15.119:6807/24492","heartbeat_front_addr":"172.21.15.119:6805/24492","state":["exists","up"]},{"osd":6,"uuid":"5abac1db-7197-4124-a005-d24e2f630501","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":24496},{"type":"v1","addr":"172.21.15.119:6817","nonce":24496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":24496},{"type":"v1","addr":"172.21.15.119:6819","nonce":24496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":24496},{"type":"v1","addr":"172.21.15.119:6823","nonce":24496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":24496},{"type":"v1","addr":"172.21.15.119:6821","nonce":24496}]},"public_addr":"172.21.15.119:6817/24496","cluster_addr":"172.21.15.119:6819/24496","heartbeat_back_addr":"172.21.15.119:6823/24496","heartbeat_front_addr":"172.21.15.119:6821/24496","state":["exists","up"]},{"osd":7,"uuid":"c227f270-7015-4604-8bcd-7ea1152aa67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":24493},{"type":"v1","addr":"172.21.15.119:6809","nonce":24493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":24493},{"type":"v1","addr":"172.21.15.119:6811","nonce":24493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":24493},{"type":"v1","addr":"172.21.15.119:6815","nonce":24493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":24493},{"type":"v1","addr":"172.21.15.119:6813","nonce":24493}]},"public_addr":"172.21.15.119:6809/24493","cluster_addr":"172.21.15.119:6811/24493","heartbeat_back_addr":"172.21.15.119:6815/24493","heartbeat_front_addr":"172.21.15.119:6813/24493","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.350528+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.852774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.718401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:13.040233+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.602413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.626424+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.728464+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:26:12.493683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6837/1526281711":"2024-08-18T02:29:42.394441+0000","172.21.15.119:6836/1526281711":"2024-08-18T02:29:42.394441+0000","172.21.15.19:6835/363347157":"2024-08-18T02:29:36.079948+0000","172.21.15.19:6834/363347157":"2024-08-18T02:29:36.079948+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb53c060860 msgr2=0x7fb53c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb53c060860 0x7fb53c062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb55c06d6b0 tx=0x7fb5440091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55c0adfa0 msgr2=0x7fb55c146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55c0adfa0 0x7fb55c146700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00cc20 tx=0x7fb54c001a60 comp rx=0 tx=0).stop 2024-08-17T02:29:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 shutdown_connections 2024-08-17T02:29:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb53c060860 0x7fb53c062d10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55c1617b0 0x7fb55c15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb55c1613e0 0x7fb55c06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 --2- 172.21.15.19:0/301625193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55c0adfa0 0x7fb55c146700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 >> 172.21.15.19:0/301625193 conn(0x7fb55c0c9840 msgr2=0x7fb55c0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 shutdown_connections 2024-08-17T02:29:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:48.727+0000 7fb562b54700 1 -- 172.21.15.19:0/301625193 wait complete. 2024-08-17T02:29:49.743 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:29:49.744 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:49.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f5460c89700 1 Processor -- start 2024-08-17T02:29:49.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f5460c89700 1 -- start start 2024-08-17T02:29:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f5460c89700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 0x7f545c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f5460c89700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f545c0abdd0 0x7f545c0ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f5460c89700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c06dbf0 con 0x7f545c140730 2024-08-17T02:29:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f5460c89700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545c0ae820 con 0x7f545c0abdd0 2024-08-17T02:29:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f5460c89700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c06d2c0 con 0x7f545c140360 2024-08-17T02:29:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f545c0abdd0 0x7f545c0ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545affd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f545c140730 0x7f545c0ab6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52330/0 (socket says 172.21.15.19:52330) 2024-08-17T02:29:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545affd700 1 -- 172.21.15.19:0/1041248225 learned_addr learned my addr 172.21.15.19:0/1041248225 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545b7fe700 1 --2- 172.21.15.19:0/1041248225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 0x7f545c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545a7fc700 1 -- 172.21.15.19:0/1041248225 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504326423 0 0) 0x7f545c06dbf0 con 0x7f545c140730 2024-08-17T02:29:49.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545a7fc700 1 -- 172.21.15.19:0/1041248225 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5448003570 con 0x7f545c140730 2024-08-17T02:29:49.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545bfff700 1 -- 172.21.15.19:0/1041248225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 msgr2=0x7f545c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:49.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545bfff700 1 --2- 172.21.15.19:0/1041248225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 0x7f545c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545bfff700 1 -- 172.21.15.19:0/1041248225 >> v1:172.21.15.19:6789/0 conn(0x7f545c140730 legacy=0x7f545c0ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545a7fc700 1 -- 172.21.15.19:0/1041248225 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2102321117 0 0) 0x7f5448003570 con 0x7f545c140730 2024-08-17T02:29:49.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545bfff700 1 -- 172.21.15.19:0/1041248225 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c06d5a0 con 0x7f545c0abdd0 2024-08-17T02:29:49.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545b7fe700 1 --2- 172.21.15.19:0/1041248225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 0x7f545c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:49.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545bfff700 1 --2- 172.21.15.19:0/1041248225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 0x7f545c0ada50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5454009e60 tx=0x7f5454009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7781f8448d9e9421 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545a7fc700 1 -- 172.21.15.19:0/1041248225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545400e070 con 0x7f545c0abdd0 2024-08-17T02:29:49.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545a7fc700 1 -- 172.21.15.19:0/1041248225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545400b7a0 con 0x7f545c0abdd0 2024-08-17T02:29:49.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.866+0000 7f545a7fc700 1 -- 172.21.15.19:0/1041248225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c001470 con 0x7f545c0abdd0 2024-08-17T02:29:49.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.870+0000 7f5460c89700 1 -- 172.21.15.19:0/1041248225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 msgr2=0x7f545c0ada50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.870+0000 7f5460c89700 1 --2- 172.21.15.19:0/1041248225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 0x7f545c0ada50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5454009e60 tx=0x7f5454009780 comp rx=0 tx=0).stop 2024-08-17T02:29:49.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.870+0000 7f5460c89700 1 -- 172.21.15.19:0/1041248225 shutdown_connections 2024-08-17T02:29:49.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.870+0000 7f5460c89700 1 --2- 172.21.15.19:0/1041248225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 0x7f545c0ada50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.870+0000 7f5460c89700 1 --2- 172.21.15.19:0/1041248225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 0x7f545c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.870+0000 7f5460c89700 1 -- 172.21.15.19:0/1041248225 >> 172.21.15.19:0/1041248225 conn(0x7f545c066e00 msgr2=0x7f545c067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:49.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.870+0000 7f5460c89700 1 -- 172.21.15.19:0/1041248225 shutdown_connections 2024-08-17T02:29:49.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.870+0000 7f5460c89700 1 -- 172.21.15.19:0/1041248225 wait complete. 2024-08-17T02:29:49.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 Processor -- start 2024-08-17T02:29:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 -- start start 2024-08-17T02:29:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 0x7f545c13c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 0x7f545c171d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f545c140730 0x7f545c16ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c16edd0 con 0x7f545c0abdd0 2024-08-17T02:29:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c13c6b0 con 0x7f545c140730 2024-08-17T02:29:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c1722a0 con 0x7f545c140360 2024-08-17T02:29:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 0x7f545c13c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 0x7f545c13c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38494/0 (socket says 172.21.15.19:38494) 2024-08-17T02:29:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545b7fe700 1 -- 172.21.15.19:0/3775501397 learned_addr learned my addr 172.21.15.19:0/3775501397 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545affd700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 0x7f545c171d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545bfff700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f545c140730 0x7f545c16ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545b7fe700 1 -- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 msgr2=0x7f545c171d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545b7fe700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f545c140360 0x7f545c171d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545b7fe700 1 -- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f545c140730 msgr2=0x7f545c16ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545b7fe700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f545c140730 0x7f545c16ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545b7fe700 1 -- 172.21.15.19:0/3775501397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444009420 con 0x7f545c0abdd0 2024-08-17T02:29:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545bfff700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f545c140730 0x7f545c16ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f545b7fe700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 0x7f545c13c170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f544400ec80 tx=0x7f54440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f54537fe700 1 -- 172.21.15.19:0/3775501397 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400c8f0 con 0x7f545c0abdd0 2024-08-17T02:29:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f54537fe700 1 -- 172.21.15.19:0/3775501397 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400ca50 con 0x7f545c0abdd0 2024-08-17T02:29:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5454009a20 con 0x7f545c0abdd0 2024-08-17T02:29:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f54537fe700 1 -- 172.21.15.19:0/3775501397 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400cdd0 con 0x7f545c0abdd0 2024-08-17T02:29:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.874+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c16e810 con 0x7f545c0abdd0 2024-08-17T02:29:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f545c0644b0 con 0x7f545c0abdd0 2024-08-17T02:29:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f54537fe700 1 -- 172.21.15.19:0/3775501397 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5444013680 con 0x7f545c0abdd0 2024-08-17T02:29:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f54537fe700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f543c060860 0x7f543c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f54537fe700 1 -- 172.21.15.19:0/3775501397 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f544407cf70 con 0x7f545c0abdd0 2024-08-17T02:29:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f54537fe700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f543c066750 0x7f543c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f54537fe700 1 -- 172.21.15.19:0/3775501397 --> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f543c069210 con 0x7f543c066750 2024-08-17T02:29:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f54537fe700 1 -- 172.21.15.19:0/3775501397 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f544407f5b0 con 0x7f545c0abdd0 2024-08-17T02:29:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f545affd700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f543c060860 0x7f543c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f545bfff700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f543c066750 0x7f543c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f545bfff700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f543c066750 0x7f543c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.878+0000 7f545affd700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f543c060860 0x7f543c062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f545c160410 tx=0x7f544c001a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.882+0000 7f54537fe700 1 -- 172.21.15.19:0/3775501397 <== osd.0 v2:172.21.15.19:6800/24143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f543c069210 con 0x7f543c066750 2024-08-17T02:29:49.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 --> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f545c06b440 con 0x7f543c066750 2024-08-17T02:29:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f54537fe700 1 -- 172.21.15.19:0/3775501397 <== osd.0 v2:172.21.15.19:6800/24143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f545c06b440 con 0x7f543c066750 2024-08-17T02:29:49.903 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:29:49.904 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:49.904 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:29:49.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f543c066750 msgr2=0x7f543c068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.19:6800/24143,v1:172.21.15.19:6801/24143] conn(0x7f543c066750 0x7f543c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f543c060860 msgr2=0x7f543c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f543c060860 0x7f543c062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f545c160410 tx=0x7f544c001a00 comp rx=0 tx=0).stop 2024-08-17T02:29:49.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 msgr2=0x7f545c13c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 --2- 172.21.15.19:0/3775501397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f545c0abdd0 0x7f545c13c170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f544400ec80 tx=0x7f54440091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f545bfff700 1 -- 172.21.15.19:0/3775501397 reap_dead start 2024-08-17T02:29:49.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 shutdown_connections 2024-08-17T02:29:49.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 >> 172.21.15.19:0/3775501397 conn(0x7f545c066e00 msgr2=0x7f545c06e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:49.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 shutdown_connections 2024-08-17T02:29:49.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:49.898+0000 7f5460c89700 1 -- 172.21.15.19:0/3775501397 wait complete. 2024-08-17T02:29:49.917 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:29:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.026+0000 7f670359e700 1 Processor -- start 2024-08-17T02:29:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.026+0000 7f670359e700 1 -- start start 2024-08-17T02:29:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6704158000 0x7f67040adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040ad670 con 0x7f6704157070 2024-08-17T02:29:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040acd80 con 0x7f67040ae040 2024-08-17T02:29:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6704157440 con 0x7f6704158000 2024-08-17T02:29:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6704157070 0x7f67040c8780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52338/0 (socket says 172.21.15.19:52338) 2024-08-17T02:29:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670259c700 1 -- 172.21.15.19:0/1865390492 learned_addr learned my addr 172.21.15.19:0/1865390492 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f66fbfff700 1 --2- 172.21.15.19:0/1865390492 >> v2:172.21.15.119:3300/0 conn(0x7f6704158000 0x7f67040adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f6701d9b700 1 -- 172.21.15.19:0/1865390492 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678824154 0 0) 0x7f67040ad670 con 0x7f6704157070 2024-08-17T02:29:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f6701d9b700 1 -- 172.21.15.19:0/1865390492 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f0003570 con 0x7f6704157070 2024-08-17T02:29:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f66fbfff700 1 -- 172.21.15.19:0/1865390492 >> v1:172.21.15.119:6789/0 conn(0x7f67040ae040 legacy=0x7f67040c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f66fbfff700 1 -- 172.21.15.19:0/1865390492 >> v1:172.21.15.19:6789/0 conn(0x7f6704157070 legacy=0x7f67040c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f66fbfff700 1 -- 172.21.15.19:0/1865390492 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67041585d0 con 0x7f6704158000 2024-08-17T02:29:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f66fbfff700 1 --2- 172.21.15.19:0/1865390492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704158000 0x7f67040adb00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f66f40098e0 tx=0x7f66f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a0f8df8fe27de8c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f6701d9b700 1 -- 172.21.15.19:0/1865390492 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f400b640 con 0x7f6704158000 2024-08-17T02:29:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f6701d9b700 1 -- 172.21.15.19:0/1865390492 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f400b7a0 con 0x7f6704158000 2024-08-17T02:29:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f6701d9b700 1 -- 172.21.15.19:0/1865390492 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f400bb20 con 0x7f6704158000 2024-08-17T02:29:50.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 -- 172.21.15.19:0/1865390492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704158000 msgr2=0x7f67040adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 --2- 172.21.15.19:0/1865390492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704158000 0x7f67040adb00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f66f40098e0 tx=0x7f66f40091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 -- 172.21.15.19:0/1865390492 shutdown_connections 2024-08-17T02:29:50.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 --2- 172.21.15.19:0/1865390492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704158000 0x7f67040adb00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 -- 172.21.15.19:0/1865390492 >> 172.21.15.19:0/1865390492 conn(0x7f67040ccfc0 msgr2=0x7f67040c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 -- 172.21.15.19:0/1865390492 shutdown_connections 2024-08-17T02:29:50.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.030+0000 7f670359e700 1 -- 172.21.15.19:0/1865390492 wait complete. 2024-08-17T02:29:50.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f670359e700 1 Processor -- start 2024-08-17T02:29:50.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f670359e700 1 -- start start 2024-08-17T02:29:50.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f670359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67040ae040 0x7f670406a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f670359e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704157070 0x7f6704146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f670359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704158000 0x7f67040a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f670359e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040a6920 con 0x7f6704158000 2024-08-17T02:29:50.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f670359e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040a6360 con 0x7f6704157070 2024-08-17T02:29:50.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f670359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040a6640 con 0x7f67040ae040 2024-08-17T02:29:50.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f6702d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704158000 0x7f67040a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f6702d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704158000 0x7f67040a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38500/0 (socket says 172.21.15.19:38500) 2024-08-17T02:29:50.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f6702d9d700 1 -- 172.21.15.19:0/2515043373 learned_addr learned my addr 172.21.15.19:0/2515043373 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f670259c700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67040ae040 0x7f670406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f66fbfff700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704157070 0x7f6704146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f6702d9d700 1 -- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67040ae040 msgr2=0x7f670406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f6702d9d700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67040ae040 0x7f670406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f6702d9d700 1 -- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704157070 msgr2=0x7f6704146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f6702d9d700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704157070 0x7f6704146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f6702d9d700 1 -- 172.21.15.19:0/2515043373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4009420 con 0x7f6704158000 2024-08-17T02:29:50.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f6702d9d700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704158000 0x7f67040a7270 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c8e0 tx=0x7f66fc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f66fa7fc700 1 -- 172.21.15.19:0/2515043373 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc012630 con 0x7f6704158000 2024-08-17T02:29:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.034+0000 7f66fa7fc700 1 -- 172.21.15.19:0/2515043373 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc012790 con 0x7f6704158000 2024-08-17T02:29:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.038+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040ca5e0 con 0x7f6704158000 2024-08-17T02:29:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.038+0000 7f66fa7fc700 1 -- 172.21.15.19:0/2515043373 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc012b50 con 0x7f6704158000 2024-08-17T02:29:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.038+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670406aa60 con 0x7f6704158000 2024-08-17T02:29:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.038+0000 7f66fa7fc700 1 -- 172.21.15.19:0/2515043373 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f66fc01a3a0 con 0x7f6704158000 2024-08-17T02:29:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.038+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67040ca440 con 0x7f6704158000 2024-08-17T02:29:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.038+0000 7f66fa7fc700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f66e4060860 0x7f66e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.038+0000 7f66fa7fc700 1 -- 172.21.15.19:0/2515043373 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f66fc07cb00 con 0x7f6704158000 2024-08-17T02:29:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.038+0000 7f670259c700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f66e4060860 0x7f66e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.038+0000 7f670259c700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f66e4060860 0x7f66e4062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66ec007fd0 tx=0x7f66ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.046+0000 7f66fa7fc700 1 -- 172.21.15.19:0/2515043373 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f67040ca440 con 0x7f6704158000 2024-08-17T02:29:50.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.206+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f67040ca440 con 0x7f66e4060860 2024-08-17T02:29:50.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.210+0000 7f66fa7fc700 1 -- 172.21.15.19:0/2515043373 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f67040ca440 con 0x7f66e4060860 2024-08-17T02:29:50.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.210+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f66e4060860 msgr2=0x7f66e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.210+0000 7f670359e700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f66e4060860 0x7f66e4062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66ec007fd0 tx=0x7f66ec009040 comp rx=0 tx=0).stop 2024-08-17T02:29:50.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.210+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704158000 msgr2=0x7f67040a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.210+0000 7f670359e700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704158000 0x7f67040a7270 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c8e0 tx=0x7f66fc001710 comp rx=0 tx=0).stop 2024-08-17T02:29:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.214+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 shutdown_connections 2024-08-17T02:29:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.214+0000 7f670359e700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f66e4060860 0x7f66e4062d10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.214+0000 7f670359e700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704158000 0x7f67040a7270 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.214+0000 7f670359e700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6704157070 0x7f6704146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.214+0000 7f670359e700 1 --2- 172.21.15.19:0/2515043373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67040ae040 0x7f670406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.214+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 >> 172.21.15.19:0/2515043373 conn(0x7f67040ccfc0 msgr2=0x7f6704068110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.214+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 shutdown_connections 2024-08-17T02:29:50.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.214+0000 7f670359e700 1 -- 172.21.15.19:0/2515043373 wait complete. 2024-08-17T02:29:50.220 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:29:50.233 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:29:50.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ffab53700 1 Processor -- start 2024-08-17T02:29:50.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ffab53700 1 -- start start 2024-08-17T02:29:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ffab53700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3ff4155760 0x7f3ff406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ffab53700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff40abd70 con 0x7f3ff40686a0 2024-08-17T02:29:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ffab53700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff40ac050 con 0x7f3ff4155390 2024-08-17T02:29:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ffab53700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff40af170 con 0x7f3ff4155760 2024-08-17T02:29:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ffa352700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3ff40686a0 0x7f3ff4068ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52348/0 (socket says 172.21.15.19:52348) 2024-08-17T02:29:50.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ffa352700 1 -- 172.21.15.19:0/1982022461 learned_addr learned my addr 172.21.15.19:0/1982022461 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:50.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ff9350700 1 --2- 172.21.15.19:0/1982022461 >> v2:172.21.15.119:3300/0 conn(0x7f3ff4155760 0x7f3ff406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ff8b4f700 1 -- 172.21.15.19:0/1982022461 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181715345 0 0) 0x7f3ff40abd70 con 0x7f3ff40686a0 2024-08-17T02:29:50.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ff8b4f700 1 -- 172.21.15.19:0/1982022461 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe0003570 con 0x7f3ff40686a0 2024-08-17T02:29:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ff9350700 1 -- 172.21.15.19:0/1982022461 >> v1:172.21.15.119:6789/0 conn(0x7f3ff4155390 legacy=0x7f3ff40ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ff8b4f700 1 -- 172.21.15.19:0/1982022461 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1039240009 0 0) 0x7f3fe0003570 con 0x7f3ff40686a0 2024-08-17T02:29:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ff9350700 1 -- 172.21.15.19:0/1982022461 >> v1:172.21.15.19:6789/0 conn(0x7f3ff40686a0 legacy=0x7f3ff4068ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.338+0000 7f3ff9350700 1 -- 172.21.15.19:0/1982022461 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff40ac330 con 0x7f3ff4155760 2024-08-17T02:29:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ff9350700 1 --2- 172.21.15.19:0/1982022461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ff4155760 0x7f3ff406e680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400aa90 tx=0x7f3fe400a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcb41fceb85aed97 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ff8b4f700 1 -- 172.21.15.19:0/1982022461 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0017f0 con 0x7f3ff4155760 2024-08-17T02:29:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ff8b4f700 1 -- 172.21.15.19:0/1982022461 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400c660 con 0x7f3ff4155760 2024-08-17T02:29:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ff8b4f700 1 -- 172.21.15.19:0/1982022461 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400c9e0 con 0x7f3ff4155760 2024-08-17T02:29:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ffab53700 1 -- 172.21.15.19:0/1982022461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ff4155760 msgr2=0x7f3ff406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ffab53700 1 --2- 172.21.15.19:0/1982022461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ff4155760 0x7f3ff406e680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400aa90 tx=0x7f3fe400a330 comp rx=0 tx=0).stop 2024-08-17T02:29:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ffab53700 1 -- 172.21.15.19:0/1982022461 shutdown_connections 2024-08-17T02:29:50.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ffab53700 1 --2- 172.21.15.19:0/1982022461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ff4155760 0x7f3ff406e680 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ffab53700 1 -- 172.21.15.19:0/1982022461 >> 172.21.15.19:0/1982022461 conn(0x7f3ff40ccfe0 msgr2=0x7f3ff406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ffab53700 1 -- 172.21.15.19:0/1982022461 shutdown_connections 2024-08-17T02:29:50.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ffab53700 1 -- 172.21.15.19:0/1982022461 wait complete. 2024-08-17T02:29:50.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ffab53700 1 Processor -- start 2024-08-17T02:29:50.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.342+0000 7f3ffab53700 1 -- start start 2024-08-17T02:29:50.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffab53700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ff40686a0 0x7f3ff414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffab53700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4155390 0x7f3ff414c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffab53700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ff4155760 0x7f3ff416b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffab53700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff414e170 con 0x7f3ff4155390 2024-08-17T02:29:50.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffab53700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff416abb0 con 0x7f3ff4155760 2024-08-17T02:29:50.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffab53700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff41477e0 con 0x7f3ff40686a0 2024-08-17T02:29:50.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9350700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4155390 0x7f3ff414c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9b51700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ff40686a0 0x7f3ff414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9350700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4155390 0x7f3ff414c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38504/0 (socket says 172.21.15.19:38504) 2024-08-17T02:29:50.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9350700 1 -- 172.21.15.19:0/3668043264 learned_addr learned my addr 172.21.15.19:0/3668043264 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:50.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffa352700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ff4155760 0x7f3ff416b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9350700 1 -- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ff40686a0 msgr2=0x7f3ff414f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9350700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ff40686a0 0x7f3ff414f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9350700 1 -- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ff4155760 msgr2=0x7f3ff416b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9350700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ff4155760 0x7f3ff416b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9350700 1 -- 172.21.15.19:0/3668043264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe400a5d0 con 0x7f3ff4155390 2024-08-17T02:29:50.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ff9350700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4155390 0x7f3ff414c4d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400a370 tx=0x7f3fe4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3fe9ffb700 1 -- 172.21.15.19:0/3668043264 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400cda0 con 0x7f3ff4155390 2024-08-17T02:29:50.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3fe9ffb700 1 -- 172.21.15.19:0/3668043264 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400c7d0 con 0x7f3ff4155390 2024-08-17T02:29:50.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff4147aa0 con 0x7f3ff4155390 2024-08-17T02:29:50.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3fe9ffb700 1 -- 172.21.15.19:0/3668043264 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4022650 con 0x7f3ff4155390 2024-08-17T02:29:50.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff4148220 con 0x7f3ff4155390 2024-08-17T02:29:50.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.346+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ff40644b0 con 0x7f3ff4155390 2024-08-17T02:29:50.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3fe9ffb700 1 -- 172.21.15.19:0/3668043264 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3fe4020070 con 0x7f3ff4155390 2024-08-17T02:29:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3fe9ffb700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3fd8060860 0x7f3fd8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3fe9ffb700 1 -- 172.21.15.19:0/3668043264 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3fe407d6b0 con 0x7f3ff4155390 2024-08-17T02:29:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3ff9b51700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3fd8060860 0x7f3fd8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3fe9ffb700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f3fd8066750 0x7f3fd8068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3fe9ffb700 1 -- 172.21.15.19:0/3668043264 --> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fd8069210 con 0x7f3fd8066750 2024-08-17T02:29:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3fe9ffb700 1 -- 172.21.15.19:0/3668043264 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fe407fcf0 con 0x7f3ff4155390 2024-08-17T02:29:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3ffa352700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f3fd8066750 0x7f3fd8068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3ff9b51700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3fd8060860 0x7f3fd8062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0003a80 tx=0x7f3ff0007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3ffa352700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f3fd8066750 0x7f3fd8068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.350+0000 7f3fe9ffb700 1 -- 172.21.15.19:0/3668043264 <== osd.1 v2:172.21.15.19:6816/24141 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3fd8069210 con 0x7f3fd8066750 2024-08-17T02:29:50.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 --> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3ff406e460 con 0x7f3fd8066750 2024-08-17T02:29:50.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3fe9ffb700 1 -- 172.21.15.19:0/3668043264 <== osd.1 v2:172.21.15.19:6816/24141 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3ff406e460 con 0x7f3fd8066750 2024-08-17T02:29:50.373 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:29:50.373 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:50.373 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:29:50.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f3fd8066750 msgr2=0x7f3fd8068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.19:6816/24141,v1:172.21.15.19:6817/24141] conn(0x7f3fd8066750 0x7f3fd8068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3fd8060860 msgr2=0x7f3fd8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f3fd8060860 0x7f3fd8062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0003a80 tx=0x7f3ff0007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4155390 msgr2=0x7f3ff414c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 --2- 172.21.15.19:0/3668043264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ff4155390 0x7f3ff414c4d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400a370 tx=0x7f3fe4019000 comp rx=0 tx=0).stop 2024-08-17T02:29:50.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffa352700 1 -- 172.21.15.19:0/3668043264 reap_dead start 2024-08-17T02:29:50.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 shutdown_connections 2024-08-17T02:29:50.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 >> 172.21.15.19:0/3668043264 conn(0x7f3ff40ccfe0 msgr2=0x7f3ff4157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.366+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 shutdown_connections 2024-08-17T02:29:50.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.370+0000 7f3ffab53700 1 -- 172.21.15.19:0/3668043264 wait complete. 2024-08-17T02:29:50.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:29:50.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.482+0000 7f6b6359e700 1 Processor -- start 2024-08-17T02:29:50.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.482+0000 7f6b6359e700 1 -- start start 2024-08-17T02:29:50.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b64159690 0x7f6b640afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b64153880 0x7f6b640b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b640b2990 con 0x7f6b641534b0 2024-08-17T02:29:50.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b640b3e80 con 0x7f6b64153880 2024-08-17T02:29:50.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b64159b50 con 0x7f6b64159690 2024-08-17T02:29:50.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b62d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b64153880 0x7f6b640b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b62d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6b64153880 0x7f6b640b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38512/0 (socket says 172.21.15.19:38512) 2024-08-17T02:29:50.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b62d9d700 1 -- 172.21.15.19:0/2021041433 learned_addr learned my addr 172.21.15.19:0/2021041433 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:50.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b61d9b700 1 --2- 172.21.15.19:0/2021041433 >> v2:172.21.15.119:3300/0 conn(0x7f6b64159690 0x7f6b640afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b62d9d700 1 -- 172.21.15.19:0/2021041433 >> v2:172.21.15.119:3300/0 conn(0x7f6b64159690 msgr2=0x7f6b640afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:50.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b62d9d700 1 --2- 172.21.15.19:0/2021041433 >> v2:172.21.15.119:3300/0 conn(0x7f6b64159690 0x7f6b640afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b62d9d700 1 -- 172.21.15.19:0/2021041433 >> v1:172.21.15.119:6789/0 conn(0x7f6b641534b0 legacy=0x7f6b640b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b62d9d700 1 -- 172.21.15.19:0/2021041433 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b64159e30 con 0x7f6b64153880 2024-08-17T02:29:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b62d9d700 1 --2- 172.21.15.19:0/2021041433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b64153880 0x7f6b640b02c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6b640703a0 tx=0x7f6b54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e427ca005241a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6159a700 1 -- 172.21.15.19:0/2021041433 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54009e70 con 0x7f6b64153880 2024-08-17T02:29:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6159a700 1 -- 172.21.15.19:0/2021041433 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400b860 con 0x7f6b64153880 2024-08-17T02:29:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6159a700 1 -- 172.21.15.19:0/2021041433 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400bc00 con 0x7f6b64153880 2024-08-17T02:29:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 -- 172.21.15.19:0/2021041433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b64153880 msgr2=0x7f6b640b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 --2- 172.21.15.19:0/2021041433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b64153880 0x7f6b640b02c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6b640703a0 tx=0x7f6b54009250 comp rx=0 tx=0).stop 2024-08-17T02:29:50.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 -- 172.21.15.19:0/2021041433 shutdown_connections 2024-08-17T02:29:50.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 --2- 172.21.15.19:0/2021041433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b64153880 0x7f6b640b02c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 --2- 172.21.15.19:0/2021041433 >> v2:172.21.15.119:3300/0 conn(0x7f6b64159690 0x7f6b640afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 -- 172.21.15.19:0/2021041433 >> 172.21.15.19:0/2021041433 conn(0x7f6b640ca930 msgr2=0x7f6b640cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 -- 172.21.15.19:0/2021041433 shutdown_connections 2024-08-17T02:29:50.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 -- 172.21.15.19:0/2021041433 wait complete. 2024-08-17T02:29:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.486+0000 7f6b6359e700 1 Processor -- start 2024-08-17T02:29:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6359e700 1 -- start start 2024-08-17T02:29:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b641534b0 0x7f6b641699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6359e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b64153880 0x7f6b641511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6359e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b64159690 0x7f6b6415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6359e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b640c66f0 con 0x7f6b641534b0 2024-08-17T02:29:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6359e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6416a2b0 con 0x7f6b64153880 2024-08-17T02:29:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6359e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6416a590 con 0x7f6b64159690 2024-08-17T02:29:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b641534b0 0x7f6b641699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b641534b0 0x7f6b641699f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38528/0 (socket says 172.21.15.19:38528) 2024-08-17T02:29:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6259c700 1 -- 172.21.15.19:0/3902829979 learned_addr learned my addr 172.21.15.19:0/3902829979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:50.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b61d9b700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b64153880 0x7f6b641511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b62d9d700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b64159690 0x7f6b6415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6259c700 1 -- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b64159690 msgr2=0x7f6b6415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6259c700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b64159690 0x7f6b6415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6259c700 1 -- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b64153880 msgr2=0x7f6b641511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6259c700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b64153880 0x7f6b641511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6259c700 1 -- 172.21.15.19:0/3902829979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540094f0 con 0x7f6b641534b0 2024-08-17T02:29:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b61d9b700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b64153880 0x7f6b641511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6259c700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b641534b0 0x7f6b641699f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00cb10 tx=0x7f6b5c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b527fc700 1 -- 172.21.15.19:0/3902829979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00a760 con 0x7f6b641534b0 2024-08-17T02:29:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b527fc700 1 -- 172.21.15.19:0/3902829979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c00a8e0 con 0x7f6b641534b0 2024-08-17T02:29:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6416a870 con 0x7f6b641534b0 2024-08-17T02:29:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b527fc700 1 -- 172.21.15.19:0/3902829979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00aca0 con 0x7f6b641534b0 2024-08-17T02:29:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b64169f30 con 0x7f6b641534b0 2024-08-17T02:29:50.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.490+0000 7f6b527fc700 1 -- 172.21.15.19:0/3902829979 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6b5c003030 con 0x7f6b641534b0 2024-08-17T02:29:50.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.494+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b640638f0 con 0x7f6b641534b0 2024-08-17T02:29:50.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.494+0000 7f6b527fc700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b44060860 0x7f6b44062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.494+0000 7f6b527fc700 1 -- 172.21.15.19:0/3902829979 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6b5c07ca30 con 0x7f6b641534b0 2024-08-17T02:29:50.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.494+0000 7f6b61d9b700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b44060860 0x7f6b44062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.494+0000 7f6b61d9b700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b44060860 0x7f6b44062d10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b64157160 tx=0x7f6b58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.498+0000 7f6b527fc700 1 -- 172.21.15.19:0/3902829979 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6b5c04d120 con 0x7f6b641534b0 2024-08-17T02:29:50.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.666+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b640c6830 con 0x7f6b44060860 2024-08-17T02:29:50.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.666+0000 7f6b527fc700 1 -- 172.21.15.19:0/3902829979 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6b58009df0 con 0x7f6b44060860 2024-08-17T02:29:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b44060860 msgr2=0x7f6b44062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b44060860 0x7f6b44062d10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b64157160 tx=0x7f6b58008040 comp rx=0 tx=0).stop 2024-08-17T02:29:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b641534b0 msgr2=0x7f6b641699f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b641534b0 0x7f6b641699f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00cb10 tx=0x7f6b5c0017b0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 shutdown_connections 2024-08-17T02:29:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f6b44060860 0x7f6b44062d10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b64159690 0x7f6b6415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b64153880 0x7f6b641511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 --2- 172.21.15.19:0/3902829979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b641534b0 0x7f6b641699f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 >> 172.21.15.19:0/3902829979 conn(0x7f6b640ca930 msgr2=0x7f6b640cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 shutdown_connections 2024-08-17T02:29:50.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.670+0000 7f6b6359e700 1 -- 172.21.15.19:0/3902829979 wait complete. 2024-08-17T02:29:50.678 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:29:50.687 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:29:50.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:50.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.794+0000 7fe33579b700 1 Processor -- start 2024-08-17T02:29:50.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.794+0000 7fe33579b700 1 -- start start 2024-08-17T02:29:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe33579b700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe330155cb0 0x7fe3300aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe33579b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe3300b2080 0x7fe3300b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe33579b700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3300aeb20 con 0x7fe330156080 2024-08-17T02:29:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe33579b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3300b2a00 con 0x7fe3300b2080 2024-08-17T02:29:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe33579b700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3300af4f0 con 0x7fe330155cb0 2024-08-17T02:29:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe334f9a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe3300b2080 0x7fe3300b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe334f9a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe3300b2080 0x7fe3300b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38532/0 (socket says 172.21.15.19:38532) 2024-08-17T02:29:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe334f9a700 1 -- 172.21.15.19:0/4026822524 learned_addr learned my addr 172.21.15.19:0/4026822524 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe32ffff700 1 --2- 172.21.15.19:0/4026822524 >> v2:172.21.15.119:3300/0 conn(0x7fe330155cb0 0x7fe3300aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe334f9a700 1 -- 172.21.15.19:0/4026822524 >> v2:172.21.15.119:3300/0 conn(0x7fe330155cb0 msgr2=0x7fe3300aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:50.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe334f9a700 1 --2- 172.21.15.19:0/4026822524 >> v2:172.21.15.119:3300/0 conn(0x7fe330155cb0 0x7fe3300aefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe334f9a700 1 -- 172.21.15.19:0/4026822524 >> v1:172.21.15.119:6789/0 conn(0x7fe330156080 legacy=0x7fe3300b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe334f9a700 1 -- 172.21.15.19:0/4026822524 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3300adf10 con 0x7fe3300b2080 2024-08-17T02:29:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe334f9a700 1 --2- 172.21.15.19:0/4026822524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3300b2080 0x7fe3300b24c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe3300656f0 tx=0x7fe328009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8eca135cb133c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe32effd700 1 -- 172.21.15.19:0/4026822524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800e070 con 0x7fe3300b2080 2024-08-17T02:29:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe32effd700 1 -- 172.21.15.19:0/4026822524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32800ba20 con 0x7fe3300b2080 2024-08-17T02:29:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.798+0000 7fe32effd700 1 -- 172.21.15.19:0/4026822524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3280092e0 con 0x7fe3300b2080 2024-08-17T02:29:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 -- 172.21.15.19:0/4026822524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3300b2080 msgr2=0x7fe3300b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 --2- 172.21.15.19:0/4026822524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3300b2080 0x7fe3300b24c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe3300656f0 tx=0x7fe328009840 comp rx=0 tx=0).stop 2024-08-17T02:29:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 -- 172.21.15.19:0/4026822524 shutdown_connections 2024-08-17T02:29:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 --2- 172.21.15.19:0/4026822524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3300b2080 0x7fe3300b24c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 --2- 172.21.15.19:0/4026822524 >> v2:172.21.15.119:3300/0 conn(0x7fe330155cb0 0x7fe3300aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 -- 172.21.15.19:0/4026822524 >> 172.21.15.19:0/4026822524 conn(0x7fe3300687a0 msgr2=0x7fe33006abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 -- 172.21.15.19:0/4026822524 shutdown_connections 2024-08-17T02:29:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 -- 172.21.15.19:0/4026822524 wait complete. 2024-08-17T02:29:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 Processor -- start 2024-08-17T02:29:50.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 -- start start 2024-08-17T02:29:50.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3300b2080 0x7fe330141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe330155cb0 0x7fe33015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe330156080 0x7fe33015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe330156e70 con 0x7fe330155cb0 2024-08-17T02:29:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300aa8f0 con 0x7fe3300b2080 2024-08-17T02:29:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.802+0000 7fe33579b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300aa310 con 0x7fe330156080 2024-08-17T02:29:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe330155cb0 0x7fe33015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3300b2080 0x7fe330141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32ffff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3300b2080 0x7fe330141120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:49804/0 (socket says 172.21.15.19:49804) 2024-08-17T02:29:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32ffff700 1 -- 172.21.15.19:0/767893728 learned_addr learned my addr 172.21.15.19:0/767893728 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe334f9a700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe330156080 0x7fe33015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32ffff700 1 -- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe330156080 msgr2=0x7fe33015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32ffff700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe330156080 0x7fe33015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32ffff700 1 -- 172.21.15.19:0/767893728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe330155cb0 msgr2=0x7fe33015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32ffff700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe330155cb0 0x7fe33015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32ffff700 1 -- 172.21.15.19:0/767893728 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328009ae0 con 0x7fe3300b2080 2024-08-17T02:29:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe32ffff700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3300b2080 0x7fe330141120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe32000ecb0 tx=0x7fe3200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe327fff700 1 -- 172.21.15.19:0/767893728 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000c850 con 0x7fe3300b2080 2024-08-17T02:29:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe327fff700 1 -- 172.21.15.19:0/767893728 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32000c9b0 con 0x7fe3300b2080 2024-08-17T02:29:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe330159060 con 0x7fe3300b2080 2024-08-17T02:29:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe327fff700 1 -- 172.21.15.19:0/767893728 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000cd50 con 0x7fe3300b2080 2024-08-17T02:29:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe330141660 con 0x7fe3300b2080 2024-08-17T02:29:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3300644b0 con 0x7fe3300b2080 2024-08-17T02:29:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.806+0000 7fe327fff700 1 -- 172.21.15.19:0/767893728 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe320013680 con 0x7fe3300b2080 2024-08-17T02:29:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe327fff700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe310060860 0x7fe310062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe327fff700 1 -- 172.21.15.19:0/767893728 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe32007cf30 con 0x7fe3300b2080 2024-08-17T02:29:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe327fff700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7fe310066750 0x7fe310068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe32f7fe700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe310060860 0x7fe310062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe327fff700 1 -- 172.21.15.19:0/767893728 --> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe310069210 con 0x7fe310066750 2024-08-17T02:29:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe327fff700 1 -- 172.21.15.19:0/767893728 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe32007d300 con 0x7fe3300b2080 2024-08-17T02:29:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe334f9a700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7fe310066750 0x7fe310068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe32f7fe700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe310060860 0x7fe310062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe3300aa220 tx=0x7fe318007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe334f9a700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7fe310066750 0x7fe310068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.810+0000 7fe327fff700 1 -- 172.21.15.19:0/767893728 <== osd.2 v2:172.21.15.19:6805/24142 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe310069210 con 0x7fe310066750 2024-08-17T02:29:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.826+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 --> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe33006d9e0 con 0x7fe310066750 2024-08-17T02:29:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe327fff700 1 -- 172.21.15.19:0/767893728 <== osd.2 v2:172.21.15.19:6805/24142 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe33006d9e0 con 0x7fe310066750 2024-08-17T02:29:50.835 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:29:50.835 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:50.835 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:29:50.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7fe310066750 msgr2=0x7fe310068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.19:6805/24142,v1:172.21.15.19:6807/24142] conn(0x7fe310066750 0x7fe310068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe310060860 msgr2=0x7fe310062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe310060860 0x7fe310062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe3300aa220 tx=0x7fe318007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3300b2080 msgr2=0x7fe330141120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 --2- 172.21.15.19:0/767893728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3300b2080 0x7fe330141120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe32000ecb0 tx=0x7fe3200091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe334f9a700 1 -- 172.21.15.19:0/767893728 reap_dead start 2024-08-17T02:29:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 shutdown_connections 2024-08-17T02:29:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 >> 172.21.15.19:0/767893728 conn(0x7fe3300687a0 msgr2=0x7fe33006ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 shutdown_connections 2024-08-17T02:29:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.830+0000 7fe33579b700 1 -- 172.21.15.19:0/767893728 wait complete. 2024-08-17T02:29:50.847 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:29:50.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.950+0000 7fb1a129f700 1 Processor -- start 2024-08-17T02:29:50.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.950+0000 7fb1a129f700 1 -- start start 2024-08-17T02:29:50.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb19c153320 0x7fb19c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 0x7fb19c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c15dbd0 con 0x7fb19c0ccaa0 2024-08-17T02:29:50.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c0ce430 con 0x7fb19c153320 2024-08-17T02:29:50.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c15d370 con 0x7fb19c15a190 2024-08-17T02:29:50.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb19c153320 0x7fb19c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb19c153320 0x7fb19c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38562/0 (socket says 172.21.15.19:38562) 2024-08-17T02:29:50.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19bfff700 1 -- 172.21.15.19:0/3216568307 learned_addr learned my addr 172.21.15.19:0/3216568307 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:50.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1937fe700 1 --2- 172.21.15.19:0/3216568307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 0x7fb19c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19bfff700 1 -- 172.21.15.19:0/3216568307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 msgr2=0x7fb19c15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19bfff700 1 --2- 172.21.15.19:0/3216568307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 0x7fb19c15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19bfff700 1 -- 172.21.15.19:0/3216568307 >> v1:172.21.15.119:6789/0 conn(0x7fb19c0ccaa0 legacy=0x7fb19c066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19bfff700 1 -- 172.21.15.19:0/3216568307 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c15d610 con 0x7fb19c153320 2024-08-17T02:29:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19bfff700 1 --2- 172.21.15.19:0/3216568307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 0x7fb19c1536f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0099b0 tx=0x7fb18c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c39bccad454943 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19b7fe700 1 -- 172.21.15.19:0/3216568307 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c009ea0 con 0x7fb19c153320 2024-08-17T02:29:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19b7fe700 1 -- 172.21.15.19:0/3216568307 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c00b860 con 0x7fb19c153320 2024-08-17T02:29:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb19b7fe700 1 -- 172.21.15.19:0/3216568307 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00bc00 con 0x7fb19c153320 2024-08-17T02:29:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 -- 172.21.15.19:0/3216568307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 msgr2=0x7fb19c1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 --2- 172.21.15.19:0/3216568307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 0x7fb19c1536f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0099b0 tx=0x7fb18c009250 comp rx=0 tx=0).stop 2024-08-17T02:29:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 -- 172.21.15.19:0/3216568307 shutdown_connections 2024-08-17T02:29:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 --2- 172.21.15.19:0/3216568307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 0x7fb19c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 --2- 172.21.15.19:0/3216568307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 0x7fb19c1536f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 -- 172.21.15.19:0/3216568307 >> 172.21.15.19:0/3216568307 conn(0x7fb19c0d00a0 msgr2=0x7fb19c0d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 -- 172.21.15.19:0/3216568307 shutdown_connections 2024-08-17T02:29:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.954+0000 7fb1a129f700 1 -- 172.21.15.19:0/3216568307 wait complete. 2024-08-17T02:29:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1a129f700 1 Processor -- start 2024-08-17T02:29:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1a129f700 1 -- start start 2024-08-17T02:29:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1a129f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb19c0ccaa0 0x7fb19c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1a129f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 0x7fb19c150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1a129f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 0x7fb19c149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1a129f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c150110 con 0x7fb19c153320 2024-08-17T02:29:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1a129f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0b0170 con 0x7fb19c0ccaa0 2024-08-17T02:29:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1a129f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c14fb50 con 0x7fb19c15a190 2024-08-17T02:29:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1937fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 0x7fb19c150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1937fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 0x7fb19c150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38574/0 (socket says 172.21.15.19:38574) 2024-08-17T02:29:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1937fe700 1 -- 172.21.15.19:0/3519699327 learned_addr learned my addr 172.21.15.19:0/3519699327 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:50.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb19bfff700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb19c0ccaa0 0x7fb19c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1a0a9e700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 0x7fb19c149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1937fe700 1 -- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 msgr2=0x7fb19c149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1937fe700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 0x7fb19c149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1937fe700 1 -- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb19c0ccaa0 msgr2=0x7fb19c14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1937fe700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb19c0ccaa0 0x7fb19c14f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1937fe700 1 -- 172.21.15.19:0/3519699327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c0094f0 con 0x7fb19c153320 2024-08-17T02:29:50.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.958+0000 7fb1937fe700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 0x7fb19c150730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb18400e930 tx=0x7fb1840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb198ff9700 1 -- 172.21.15.19:0/3519699327 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184013680 con 0x7fb19c153320 2024-08-17T02:29:50.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb198ff9700 1 -- 172.21.15.19:0/3519699327 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1840137e0 con 0x7fb19c153320 2024-08-17T02:29:50.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c14fe30 con 0x7fb19c153320 2024-08-17T02:29:50.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb198ff9700 1 -- 172.21.15.19:0/3519699327 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184013b80 con 0x7fb19c153320 2024-08-17T02:29:50.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c150c70 con 0x7fb19c153320 2024-08-17T02:29:50.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c0afc60 con 0x7fb19c153320 2024-08-17T02:29:50.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb198ff9700 1 -- 172.21.15.19:0/3519699327 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb18400c3e0 con 0x7fb19c153320 2024-08-17T02:29:50.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb198ff9700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb17c060860 0x7fb17c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb198ff9700 1 -- 172.21.15.19:0/3519699327 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb18407c950 con 0x7fb19c153320 2024-08-17T02:29:50.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.962+0000 7fb19bfff700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb17c060860 0x7fb17c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.966+0000 7fb19bfff700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb17c060860 0x7fb17c062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0099b0 tx=0x7fb18c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:50.970+0000 7fb198ff9700 1 -- 172.21.15.19:0/3519699327 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb19c0afc60 con 0x7fb19c153320 2024-08-17T02:29:51.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.134+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb19c0afc60 con 0x7fb17c060860 2024-08-17T02:29:51.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.134+0000 7fb198ff9700 1 -- 172.21.15.19:0/3519699327 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb19c0afc60 con 0x7fb17c060860 2024-08-17T02:29:51.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb17c060860 msgr2=0x7fb17c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb17c060860 0x7fb17c062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0099b0 tx=0x7fb18c017000 comp rx=0 tx=0).stop 2024-08-17T02:29:51.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 msgr2=0x7fb19c150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 0x7fb19c150730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb18400e930 tx=0x7fb1840091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 shutdown_connections 2024-08-17T02:29:51.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb17c060860 0x7fb17c062d10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb19c15a190 0x7fb19c149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19c153320 0x7fb19c150730 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 --2- 172.21.15.19:0/3519699327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb19c0ccaa0 0x7fb19c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 >> 172.21.15.19:0/3519699327 conn(0x7fb19c0d00a0 msgr2=0x7fb19c14ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 shutdown_connections 2024-08-17T02:29:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.138+0000 7fb1a129f700 1 -- 172.21.15.19:0/3519699327 wait complete. 2024-08-17T02:29:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:29:51.155 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:29:51.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:51.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.266+0000 7fe72f3ba700 1 Processor -- start 2024-08-17T02:29:51.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.266+0000 7fe72f3ba700 1 -- start start 2024-08-17T02:29:51.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280cd2b0 0x7fe7280cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7280cc480 con 0x7fe7280caeb0 2024-08-17T02:29:51.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe728159720 con 0x7fe7280ceb70 2024-08-17T02:29:51.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280cb870 con 0x7fe7280cd2b0 2024-08-17T02:29:51.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72c955700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe7280caeb0 0x7fe7280ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52364/0 (socket says 172.21.15.19:52364) 2024-08-17T02:29:51.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72c955700 1 -- 172.21.15.19:0/2595416635 learned_addr learned my addr 172.21.15.19:0/2595416635 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:51.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72d156700 1 --2- 172.21.15.19:0/2595416635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280cd2b0 0x7fe7280cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe71bfff700 1 -- 172.21.15.19:0/2595416635 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383799509 0 0) 0x7fe7280cc480 con 0x7fe7280caeb0 2024-08-17T02:29:51.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe71bfff700 1 -- 172.21.15.19:0/2595416635 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe714003570 con 0x7fe7280caeb0 2024-08-17T02:29:51.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe71bfff700 1 -- 172.21.15.19:0/2595416635 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506658937 0 0) 0x7fe728159720 con 0x7fe7280ceb70 2024-08-17T02:29:51.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe71bfff700 1 -- 172.21.15.19:0/2595416635 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7280cc480 con 0x7fe7280ceb70 2024-08-17T02:29:51.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72d156700 1 -- 172.21.15.19:0/2595416635 >> v1:172.21.15.119:6789/0 conn(0x7fe7280ceb70 legacy=0x7fe728162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72d156700 1 -- 172.21.15.19:0/2595416635 >> v1:172.21.15.19:6789/0 conn(0x7fe7280caeb0 legacy=0x7fe7280ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72d156700 1 -- 172.21.15.19:0/2595416635 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280cbb50 con 0x7fe7280cd2b0 2024-08-17T02:29:51.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72d156700 1 --2- 172.21.15.19:0/2595416635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280cd2b0 0x7fe7280cd680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe724009910 tx=0x7fe7240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc4a565217ac4bbe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe71bfff700 1 -- 172.21.15.19:0/2595416635 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724011630 con 0x7fe7280cd2b0 2024-08-17T02:29:51.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe71bfff700 1 -- 172.21.15.19:0/2595416635 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe724011790 con 0x7fe7280cd2b0 2024-08-17T02:29:51.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe71bfff700 1 -- 172.21.15.19:0/2595416635 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724011b30 con 0x7fe7280cd2b0 2024-08-17T02:29:51.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2595416635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280cd2b0 msgr2=0x7fe7280cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 --2- 172.21.15.19:0/2595416635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280cd2b0 0x7fe7280cd680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe724009910 tx=0x7fe7240091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2595416635 shutdown_connections 2024-08-17T02:29:51.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 --2- 172.21.15.19:0/2595416635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280cd2b0 0x7fe7280cd680 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2595416635 >> 172.21.15.19:0/2595416635 conn(0x7fe728099550 msgr2=0x7fe728067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2595416635 shutdown_connections 2024-08-17T02:29:51.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.270+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2595416635 wait complete. 2024-08-17T02:29:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72f3ba700 1 Processor -- start 2024-08-17T02:29:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72f3ba700 1 -- start start 2024-08-17T02:29:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72f3ba700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280caeb0 0x7fe728155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72f3ba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7280cd2b0 0x7fe728068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72f3ba700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7280ceb70 0x7fe728069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72f3ba700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b2600 con 0x7fe7280cd2b0 2024-08-17T02:29:51.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72f3ba700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b1560 con 0x7fe7280ceb70 2024-08-17T02:29:51.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72f3ba700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b1840 con 0x7fe7280caeb0 2024-08-17T02:29:51.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72c955700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7280cd2b0 0x7fe728068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72d156700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280caeb0 0x7fe728155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72d156700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280caeb0 0x7fe728155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:42708/0 (socket says 172.21.15.19:42708) 2024-08-17T02:29:51.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72d156700 1 -- 172.21.15.19:0/2975218593 learned_addr learned my addr 172.21.15.19:0/2975218593 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:51.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72d957700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7280ceb70 0x7fe728069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72c955700 1 -- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280caeb0 msgr2=0x7fe728155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72c955700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280caeb0 0x7fe728155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72c955700 1 -- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7280ceb70 msgr2=0x7fe728069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72c955700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7280ceb70 0x7fe728069450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72c955700 1 -- 172.21.15.19:0/2975218593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724009420 con 0x7fe7280cd2b0 2024-08-17T02:29:51.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.274+0000 7fe72d156700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7280caeb0 0x7fe728155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:51.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.278+0000 7fe72c955700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7280cd2b0 0x7fe728068f10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00c580 tx=0x7fe71c007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.278+0000 7fe7197fa700 1 -- 172.21.15.19:0/2975218593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c005b30 con 0x7fe7280cd2b0 2024-08-17T02:29:51.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.278+0000 7fe7197fa700 1 -- 172.21.15.19:0/2975218593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c005c90 con 0x7fe7280cd2b0 2024-08-17T02:29:51.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.278+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7280b1b20 con 0x7fe7280cd2b0 2024-08-17T02:29:51.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.278+0000 7fe7197fa700 1 -- 172.21.15.19:0/2975218593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c007320 con 0x7fe7280cd2b0 2024-08-17T02:29:51.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.278+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7280b20e0 con 0x7fe7280cd2b0 2024-08-17T02:29:51.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.278+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7280638f0 con 0x7fe7280cd2b0 2024-08-17T02:29:51.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.278+0000 7fe7197fa700 1 -- 172.21.15.19:0/2975218593 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe71c01b3b0 con 0x7fe7280cd2b0 2024-08-17T02:29:51.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.278+0000 7fe7197fa700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe70c060860 0x7fe70c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.282+0000 7fe7197fa700 1 -- 172.21.15.19:0/2975218593 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe71c07c480 con 0x7fe7280cd2b0 2024-08-17T02:29:51.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.282+0000 7fe7197fa700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7fe70c066750 0x7fe70c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.282+0000 7fe7197fa700 1 -- 172.21.15.19:0/2975218593 --> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe70c069210 con 0x7fe70c066750 2024-08-17T02:29:51.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.282+0000 7fe7197fa700 1 -- 172.21.15.19:0/2975218593 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe71c07c850 con 0x7fe7280cd2b0 2024-08-17T02:29:51.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.282+0000 7fe72d156700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe70c060860 0x7fe70c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.282+0000 7fe72d957700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7fe70c066750 0x7fe70c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.282+0000 7fe72d957700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7fe70c066750 0x7fe70c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.282+0000 7fe72d156700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe70c060860 0x7fe70c062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe724009fd0 tx=0x7fe724017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.282+0000 7fe7197fa700 1 -- 172.21.15.19:0/2975218593 <== osd.3 v2:172.21.15.19:6824/24152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe70c069210 con 0x7fe70c066750 2024-08-17T02:29:51.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 --> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe7280b2ba0 con 0x7fe70c066750 2024-08-17T02:29:51.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe7197fa700 1 -- 172.21.15.19:0/2975218593 <== osd.3 v2:172.21.15.19:6824/24152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe7280b2ba0 con 0x7fe70c066750 2024-08-17T02:29:51.307 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:29:51.307 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:51.307 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:29:51.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7fe70c066750 msgr2=0x7fe70c068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.19:6824/24152,v1:172.21.15.19:6825/24152] conn(0x7fe70c066750 0x7fe70c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe70c060860 msgr2=0x7fe70c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fe70c060860 0x7fe70c062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe724009fd0 tx=0x7fe724017000 comp rx=0 tx=0).stop 2024-08-17T02:29:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7280cd2b0 msgr2=0x7fe728068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 --2- 172.21.15.19:0/2975218593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7280cd2b0 0x7fe728068f10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00c580 tx=0x7fe71c007d70 comp rx=0 tx=0).stop 2024-08-17T02:29:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72d957700 1 -- 172.21.15.19:0/2975218593 reap_dead start 2024-08-17T02:29:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 shutdown_connections 2024-08-17T02:29:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 >> 172.21.15.19:0/2975218593 conn(0x7fe728099550 msgr2=0x7fe7280acdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 shutdown_connections 2024-08-17T02:29:51.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.302+0000 7fe72f3ba700 1 -- 172.21.15.19:0/2975218593 wait complete. 2024-08-17T02:29:51.319 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:29:51.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.426+0000 7fbc196d3700 1 Processor -- start 2024-08-17T02:29:51.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.426+0000 7fbc196d3700 1 -- start start 2024-08-17T02:29:51.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc1406e620 0x7fbc140b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbc140b1630 0x7fbc14141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc14141a00 con 0x7fbc140b0d20 2024-08-17T02:29:51.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc14140b10 con 0x7fbc140b1630 2024-08-17T02:29:51.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc14140df0 con 0x7fbc1406e620 2024-08-17T02:29:51.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc13fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbc140b0d20 0x7fbc1406df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52376/0 (socket says 172.21.15.19:52376) 2024-08-17T02:29:51.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc13fff700 1 -- 172.21.15.19:0/2522757669 learned_addr learned my addr 172.21.15.19:0/2522757669 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:51.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc137fe700 1 --2- 172.21.15.19:0/2522757669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc1406e620 0x7fbc140b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc18ed2700 1 --2- 172.21.15.19:0/2522757669 >> v2:172.21.15.119:3300/0 conn(0x7fbc140b1630 0x7fbc14141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc12ffd700 1 -- 172.21.15.19:0/2522757669 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650904779 0 0) 0x7fbc14141a00 con 0x7fbc140b0d20 2024-08-17T02:29:51.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc12ffd700 1 -- 172.21.15.19:0/2522757669 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc00003570 con 0x7fbc140b0d20 2024-08-17T02:29:51.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc137fe700 1 -- 172.21.15.19:0/2522757669 >> v2:172.21.15.119:3300/0 conn(0x7fbc140b1630 msgr2=0x7fbc14141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:51.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc137fe700 1 --2- 172.21.15.19:0/2522757669 >> v2:172.21.15.119:3300/0 conn(0x7fbc140b1630 0x7fbc14141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc137fe700 1 -- 172.21.15.19:0/2522757669 >> v1:172.21.15.19:6789/0 conn(0x7fbc140b0d20 legacy=0x7fbc1406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc137fe700 1 -- 172.21.15.19:0/2522757669 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc141410d0 con 0x7fbc1406e620 2024-08-17T02:29:51.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc137fe700 1 --2- 172.21.15.19:0/2522757669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc1406e620 0x7fbc140b10f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0098e0 tx=0x7fbbfc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4360609dcb7f4ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc12ffd700 1 -- 172.21.15.19:0/2522757669 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc011630 con 0x7fbc1406e620 2024-08-17T02:29:51.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc12ffd700 1 -- 172.21.15.19:0/2522757669 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc011790 con 0x7fbc1406e620 2024-08-17T02:29:51.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc12ffd700 1 -- 172.21.15.19:0/2522757669 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc011b10 con 0x7fbc1406e620 2024-08-17T02:29:51.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 -- 172.21.15.19:0/2522757669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc1406e620 msgr2=0x7fbc140b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 --2- 172.21.15.19:0/2522757669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc1406e620 0x7fbc140b10f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0098e0 tx=0x7fbbfc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 -- 172.21.15.19:0/2522757669 shutdown_connections 2024-08-17T02:29:51.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 --2- 172.21.15.19:0/2522757669 >> v2:172.21.15.119:3300/0 conn(0x7fbc140b1630 0x7fbc14141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 --2- 172.21.15.19:0/2522757669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc1406e620 0x7fbc140b10f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 -- 172.21.15.19:0/2522757669 >> 172.21.15.19:0/2522757669 conn(0x7fbc140678d0 msgr2=0x7fbc14067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.430+0000 7fbc196d3700 1 -- 172.21.15.19:0/2522757669 shutdown_connections 2024-08-17T02:29:51.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.434+0000 7fbc196d3700 1 -- 172.21.15.19:0/2522757669 wait complete. 2024-08-17T02:29:51.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.434+0000 7fbc196d3700 1 Processor -- start 2024-08-17T02:29:51.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.434+0000 7fbc196d3700 1 -- start start 2024-08-17T02:29:51.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc196d3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc1406e620 0x7fbc140adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc196d3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc140b0d20 0x7fbc14145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc196d3700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc140b1630 0x7fbc141462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc196d3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140a71c0 con 0x7fbc140b0d20 2024-08-17T02:29:51.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc196d3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140a7a60 con 0x7fbc1406e620 2024-08-17T02:29:51.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc196d3700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc140a6210 con 0x7fbc140b1630 2024-08-17T02:29:51.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc137fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc140b0d20 0x7fbc14145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc137fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc140b0d20 0x7fbc14145d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38588/0 (socket says 172.21.15.19:38588) 2024-08-17T02:29:51.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc137fe700 1 -- 172.21.15.19:0/3914359852 learned_addr learned my addr 172.21.15.19:0/3914359852 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:51.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc13fff700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc1406e620 0x7fbc140adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc18ed2700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc140b1630 0x7fbc141462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc137fe700 1 -- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc140b1630 msgr2=0x7fbc141462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc137fe700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc140b1630 0x7fbc141462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc137fe700 1 -- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc1406e620 msgr2=0x7fbc140adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc137fe700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc1406e620 0x7fbc140adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc137fe700 1 -- 172.21.15.19:0/3914359852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc009420 con 0x7fbc140b0d20 2024-08-17T02:29:51.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc13fff700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc1406e620 0x7fbc140adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:51.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc18ed2700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc140b1630 0x7fbc141462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:51.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc137fe700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc140b0d20 0x7fbc14145d70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009ed0 tx=0x7fbbfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc0bfff700 1 -- 172.21.15.19:0/3914359852 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc011b10 con 0x7fbc140b0d20 2024-08-17T02:29:51.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc0bfff700 1 -- 172.21.15.19:0/3914359852 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc000cc0 con 0x7fbc140b0d20 2024-08-17T02:29:51.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc0bfff700 1 -- 172.21.15.19:0/3914359852 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0276a0 con 0x7fbc140b0d20 2024-08-17T02:29:51.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc140a7410 con 0x7fbc140b0d20 2024-08-17T02:29:51.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.438+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc140ab240 con 0x7fbc140b0d20 2024-08-17T02:29:51.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.442+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc140643a0 con 0x7fbc140b0d20 2024-08-17T02:29:51.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.442+0000 7fbc0bfff700 1 -- 172.21.15.19:0/3914359852 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbbfc01a430 con 0x7fbc140b0d20 2024-08-17T02:29:51.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.442+0000 7fbc0bfff700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbbf4060890 0x7fbbf4062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.442+0000 7fbc0bfff700 1 -- 172.21.15.19:0/3914359852 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbbfc07e850 con 0x7fbc140b0d20 2024-08-17T02:29:51.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.442+0000 7fbc13fff700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbbf4060890 0x7fbbf4062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.442+0000 7fbc13fff700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbbf4060890 0x7fbbf4062d40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbc040058d0 tx=0x7fbc04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.450+0000 7fbc0bfff700 1 -- 172.21.15.19:0/3914359852 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbbfc04ef40 con 0x7fbc140b0d20 2024-08-17T02:29:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.618+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc1406f5f0 con 0x7fbbf4060890 2024-08-17T02:29:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.618+0000 7fbc0bfff700 1 -- 172.21.15.19:0/3914359852 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbc1406f5f0 con 0x7fbbf4060890 2024-08-17T02:29:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbbf4060890 msgr2=0x7fbbf4062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbbf4060890 0x7fbbf4062d40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbc040058d0 tx=0x7fbc04009040 comp rx=0 tx=0).stop 2024-08-17T02:29:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc140b0d20 msgr2=0x7fbc14145d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc140b0d20 0x7fbc14145d70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc009ed0 tx=0x7fbbfc017000 comp rx=0 tx=0).stop 2024-08-17T02:29:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 shutdown_connections 2024-08-17T02:29:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbbf4060890 0x7fbbf4062d40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc140b1630 0x7fbc141462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc140b0d20 0x7fbc14145d70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 --2- 172.21.15.19:0/3914359852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc1406e620 0x7fbc140adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 >> 172.21.15.19:0/3914359852 conn(0x7fbc140678d0 msgr2=0x7fbc14143280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 shutdown_connections 2024-08-17T02:29:51.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.622+0000 7fbc196d3700 1 -- 172.21.15.19:0/3914359852 wait complete. 2024-08-17T02:29:51.628 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:29:51.638 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:29:51.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c2364700 1 Processor -- start 2024-08-17T02:29:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c2364700 1 -- start start 2024-08-17T02:29:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c2364700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47bc0cd2b0 0x7f47bc0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c2364700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f47bc0ceb70 0x7f47bc162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c2364700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0cc480 con 0x7f47bc0caeb0 2024-08-17T02:29:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c2364700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc159720 con 0x7f47bc0ceb70 2024-08-17T02:29:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c2364700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0cb870 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47bb7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f47bc0caeb0 0x7f47bc0ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52386/0 (socket says 172.21.15.19:52386) 2024-08-17T02:29:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47bb7fe700 1 -- 172.21.15.19:0/2756970553 learned_addr learned my addr 172.21.15.19:0/2756970553 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c0901700 1 --2- 172.21.15.19:0/2756970553 >> v2:172.21.15.119:3300/0 conn(0x7f47bc0ceb70 0x7f47bc162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47bbfff700 1 --2- 172.21.15.19:0/2756970553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47bc0cd2b0 0x7f47bc0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47baffd700 1 -- 172.21.15.19:0/2756970553 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48872037 0 0) 0x7f47bc0cc480 con 0x7f47bc0caeb0 2024-08-17T02:29:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47baffd700 1 -- 172.21.15.19:0/2756970553 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a4003570 con 0x7f47bc0caeb0 2024-08-17T02:29:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c0901700 1 -- 172.21.15.19:0/2756970553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47bc0cd2b0 msgr2=0x7f47bc0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c0901700 1 --2- 172.21.15.19:0/2756970553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47bc0cd2b0 0x7f47bc0cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c0901700 1 -- 172.21.15.19:0/2756970553 >> v1:172.21.15.19:6789/0 conn(0x7f47bc0caeb0 legacy=0x7f47bc0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c0901700 1 -- 172.21.15.19:0/2756970553 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0cbb50 con 0x7f47bc0ceb70 2024-08-17T02:29:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47c0901700 1 --2- 172.21.15.19:0/2756970553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47bc0ceb70 0x7f47bc162ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f47b40098e0 tx=0x7f47b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd8a5c06971c95c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47baffd700 1 -- 172.21.15.19:0/2756970553 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4011630 con 0x7f47bc0ceb70 2024-08-17T02:29:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47baffd700 1 -- 172.21.15.19:0/2756970553 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b4011790 con 0x7f47bc0ceb70 2024-08-17T02:29:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.750+0000 7f47baffd700 1 -- 172.21.15.19:0/2756970553 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4011b10 con 0x7f47bc0ceb70 2024-08-17T02:29:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 -- 172.21.15.19:0/2756970553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47bc0ceb70 msgr2=0x7f47bc162ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 --2- 172.21.15.19:0/2756970553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47bc0ceb70 0x7f47bc162ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f47b40098e0 tx=0x7f47b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 -- 172.21.15.19:0/2756970553 shutdown_connections 2024-08-17T02:29:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 --2- 172.21.15.19:0/2756970553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47bc0ceb70 0x7f47bc162ea0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 --2- 172.21.15.19:0/2756970553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47bc0cd2b0 0x7f47bc0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 -- 172.21.15.19:0/2756970553 >> 172.21.15.19:0/2756970553 conn(0x7f47bc099550 msgr2=0x7f47bc067590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 -- 172.21.15.19:0/2756970553 shutdown_connections 2024-08-17T02:29:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 -- 172.21.15.19:0/2756970553 wait complete. 2024-08-17T02:29:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 Processor -- start 2024-08-17T02:29:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 -- start start 2024-08-17T02:29:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47bc0caeb0 0x7f47bc0c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47bc0cd2b0 0x7f47bc0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47bc0ceb70 0x7f47bc0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0b5ed0 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0b4160 con 0x7f47bc0caeb0 2024-08-17T02:29:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c2364700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0b4fa0 con 0x7f47bc0ceb70 2024-08-17T02:29:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47bc0cd2b0 0x7f47bc0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47bb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47bc0cd2b0 0x7f47bc0b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38596/0 (socket says 172.21.15.19:38596) 2024-08-17T02:29:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47bb7fe700 1 -- 172.21.15.19:0/3013584036 learned_addr learned my addr 172.21.15.19:0/3013584036 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47c0901700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47bc0ceb70 0x7f47bc0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47bbfff700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47bc0caeb0 0x7f47bc0c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47bb7fe700 1 -- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47bc0ceb70 msgr2=0x7f47bc0b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47bb7fe700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47bc0ceb70 0x7f47bc0b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47bb7fe700 1 -- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47bc0caeb0 msgr2=0x7f47bc0c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47bb7fe700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47bc0caeb0 0x7f47bc0c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.754+0000 7f47bb7fe700 1 -- 172.21.15.19:0/3013584036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4009420 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47bb7fe700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47bc0cd2b0 0x7f47bc0b5430 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f47b00011e0 tx=0x7f47b0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47a3fff700 1 -- 172.21.15.19:0/3013584036 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0005b30 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47a3fff700 1 -- 172.21.15.19:0/3013584036 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0005cb0 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc0b4390 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47a3fff700 1 -- 172.21.15.19:0/3013584036 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0007320 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0b4950 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47bc0638f0 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47a3fff700 1 -- 172.21.15.19:0/3013584036 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f47b0007690 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47a3fff700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47a8060890 0x7f47a8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.758+0000 7f47a3fff700 1 -- 172.21.15.19:0/3013584036 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f47b007c4e0 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.762+0000 7f47a3fff700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7f47a8066780 0x7f47a8068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.762+0000 7f47a3fff700 1 -- 172.21.15.19:0/3013584036 --> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47a8069240 con 0x7f47a8066780 2024-08-17T02:29:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.762+0000 7f47a3fff700 1 -- 172.21.15.19:0/3013584036 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47b007c8b0 con 0x7f47bc0cd2b0 2024-08-17T02:29:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.762+0000 7f47bbfff700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47a8060890 0x7f47a8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.762+0000 7f47c0901700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7f47a8066780 0x7f47a8068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.762+0000 7f47bbfff700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47a8060890 0x7f47a8062d40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f47ac007600 tx=0x7f47ac00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.762+0000 7f47c0901700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7f47a8066780 0x7f47a8068b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.762+0000 7f47a3fff700 1 -- 172.21.15.19:0/3013584036 <== osd.4 v2:172.21.15.119:6824/24494 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f47a8069240 con 0x7f47a8066780 2024-08-17T02:29:51.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 --> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f47bc0b6080 con 0x7f47a8066780 2024-08-17T02:29:51.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47a3fff700 1 -- 172.21.15.19:0/3013584036 <== osd.4 v2:172.21.15.119:6824/24494 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f47bc0b6080 con 0x7f47a8066780 2024-08-17T02:29:51.785 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:29:51.785 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:51.785 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:29:51.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7f47a8066780 msgr2=0x7f47a8068b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6824/24494,v1:172.21.15.119:6825/24494] conn(0x7f47a8066780 0x7f47a8068b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47a8060890 msgr2=0x7f47a8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f47a8060890 0x7f47a8062d40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f47ac007600 tx=0x7f47ac00b040 comp rx=0 tx=0).stop 2024-08-17T02:29:51.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47bc0cd2b0 msgr2=0x7f47bc0b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 --2- 172.21.15.19:0/3013584036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47bc0cd2b0 0x7f47bc0b5430 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f47b00011e0 tx=0x7f47b0007df0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c0901700 1 -- 172.21.15.19:0/3013584036 reap_dead start 2024-08-17T02:29:51.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 shutdown_connections 2024-08-17T02:29:51.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 >> 172.21.15.19:0/3013584036 conn(0x7f47bc099550 msgr2=0x7f47bc068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.778+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 shutdown_connections 2024-08-17T02:29:51.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.782+0000 7f47c2364700 1 -- 172.21.15.19:0/3013584036 wait complete. 2024-08-17T02:29:51.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:29:51.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ef59e700 1 Processor -- start 2024-08-17T02:29:51.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ef59e700 1 -- start start 2024-08-17T02:29:51.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ef59e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f38f0142ea0 0x7f38f00b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ef59e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f0141a00 con 0x7f38f00b0d20 2024-08-17T02:29:51.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ef59e700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f0140b10 con 0x7f38f006e620 2024-08-17T02:29:51.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ef59e700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f0140df0 con 0x7f38f0142ea0 2024-08-17T02:29:51.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ee59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f38f00b0d20 0x7f38f006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52388/0 (socket says 172.21.15.19:52388) 2024-08-17T02:29:51.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ee59c700 1 -- 172.21.15.19:0/4178322375 learned_addr learned my addr 172.21.15.19:0/4178322375 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:51.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 --2- 172.21.15.19:0/4178322375 >> v2:172.21.15.119:3300/0 conn(0x7f38f0142ea0 0x7f38f00b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258093594 0 0) 0x7f38f0141a00 con 0x7f38f00b0d20 2024-08-17T02:29:51.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d8003570 con 0x7f38f00b0d20 2024-08-17T02:29:51.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034494357 0 0) 0x7f38f0140b10 con 0x7f38f006e620 2024-08-17T02:29:51.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f0141a00 con 0x7f38f006e620 2024-08-17T02:29:51.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1375601046 0 0) 0x7f38d8003570 con 0x7f38f00b0d20 2024-08-17T02:29:51.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 >> v2:172.21.15.119:3300/0 conn(0x7f38f0142ea0 msgr2=0x7f38f00b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:51.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 --2- 172.21.15.19:0/4178322375 >> v2:172.21.15.119:3300/0 conn(0x7f38f0142ea0 0x7f38f00b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 >> v1:172.21.15.119:6789/0 conn(0x7f38f006e620 legacy=0x7f38f00b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f01410d0 con 0x7f38f00b0d20 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 --2- 172.21.15.19:0/4178322375 >> v2:172.21.15.119:3300/0 conn(0x7f38f0142ea0 0x7f38f00b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1887195502 0 0) 0x7f38e4001470 con 0x7f38f00b0d20 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 >> v1:172.21.15.19:6789/0 conn(0x7f38f00b0d20 legacy=0x7f38f006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38d8003bf0 0x7f38d8003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d8004810 0x7f38d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38d80051c0 0x7f38d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0140df0 con 0x7f38d80051c0 2024-08-17T02:29:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d800c050 con 0x7f38d8004810 2024-08-17T02:29:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38d80051c0 0x7f38d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d800c210 con 0x7f38d8003bf0 2024-08-17T02:29:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38ee59c700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38d8003bf0 0x7f38d8003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38edd9b700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d8004810 0x7f38d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 -- 172.21.15.19:0/4178322375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38d8003bf0 msgr2=0x7f38d8003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38d8003bf0 0x7f38d8003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 -- 172.21.15.19:0/4178322375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d8004810 msgr2=0x7f38d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d8004810 0x7f38d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 -- 172.21.15.19:0/4178322375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d8003570 con 0x7f38d80051c0 2024-08-17T02:29:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 -- 172.21.15.19:0/4178322375 reap_dead start 2024-08-17T02:29:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.910+0000 7f38eed9d700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38d80051c0 0x7f38d800ba60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f38e800e3c0 tx=0x7f38e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2ca0c1c72cdc4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8009c50 con 0x7f38d80051c0 2024-08-17T02:29:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e800f040 con 0x7f38d80051c0 2024-08-17T02:29:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ed59a700 1 -- 172.21.15.19:0/4178322375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800eea0 con 0x7f38d80051c0 2024-08-17T02:29:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ef59e700 1 -- 172.21.15.19:0/4178322375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38d80051c0 msgr2=0x7f38d800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ef59e700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38d80051c0 0x7f38d800ba60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f38e800e3c0 tx=0x7f38e800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ef59e700 1 -- 172.21.15.19:0/4178322375 shutdown_connections 2024-08-17T02:29:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ef59e700 1 --2- 172.21.15.19:0/4178322375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38d80051c0 0x7f38d800ba60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ef59e700 1 -- 172.21.15.19:0/4178322375 >> 172.21.15.19:0/4178322375 conn(0x7f38f00678d0 msgr2=0x7f38f0067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ef59e700 1 -- 172.21.15.19:0/4178322375 shutdown_connections 2024-08-17T02:29:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ef59e700 1 -- 172.21.15.19:0/4178322375 wait complete. 2024-08-17T02:29:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.914+0000 7f38ef59e700 1 Processor -- start 2024-08-17T02:29:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ef59e700 1 -- start start 2024-08-17T02:29:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ef59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d80051c0 0x7f38f013ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ef59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38f00a6cf0 0x7f38f00a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ef59e700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38f00a7350 0x7f38f0145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ef59e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00a87b0 con 0x7f38f00a6cf0 2024-08-17T02:29:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ef59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f01404a0 con 0x7f38d80051c0 2024-08-17T02:29:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ef59e700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00a7ba0 con 0x7f38f00a7350 2024-08-17T02:29:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38edd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38f00a6cf0 0x7f38f00a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38edd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38f00a6cf0 0x7f38f00a8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38620/0 (socket says 172.21.15.19:38620) 2024-08-17T02:29:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38edd9b700 1 -- 172.21.15.19:0/659076249 learned_addr learned my addr 172.21.15.19:0/659076249 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ee59c700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d80051c0 0x7f38f013ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38eed9d700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38f00a7350 0x7f38f0145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38edd9b700 1 -- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38f00a7350 msgr2=0x7f38f0145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38edd9b700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38f00a7350 0x7f38f0145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38edd9b700 1 -- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d80051c0 msgr2=0x7f38f013ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38edd9b700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d80051c0 0x7f38f013ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38edd9b700 1 -- 172.21.15.19:0/659076249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f00a7e80 con 0x7f38f00a6cf0 2024-08-17T02:29:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38edd9b700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38f00a6cf0 0x7f38f00a8c40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f38e000e780 tx=0x7f38e0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38de7fc700 1 -- 172.21.15.19:0/659076249 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e0001570 con 0x7f38f00a6cf0 2024-08-17T02:29:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38de7fc700 1 -- 172.21.15.19:0/659076249 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e0010040 con 0x7f38f00a6cf0 2024-08-17T02:29:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f00a8160 con 0x7f38f00a6cf0 2024-08-17T02:29:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38de7fc700 1 -- 172.21.15.19:0/659076249 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e0001940 con 0x7f38f00a6cf0 2024-08-17T02:29:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.918+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f00a9180 con 0x7f38f00a6cf0 2024-08-17T02:29:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.922+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f00a8960 con 0x7f38f00a6cf0 2024-08-17T02:29:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.922+0000 7f38de7fc700 1 -- 172.21.15.19:0/659076249 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f38e0001cb0 con 0x7f38f00a6cf0 2024-08-17T02:29:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.922+0000 7f38de7fc700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f38d0060860 0x7f38d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.922+0000 7f38de7fc700 1 -- 172.21.15.19:0/659076249 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f38e007c690 con 0x7f38f00a6cf0 2024-08-17T02:29:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.922+0000 7f38ee59c700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f38d0060860 0x7f38d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.922+0000 7f38ee59c700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f38d0060860 0x7f38d0062d10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f38e4001c80 tx=0x7f38e400d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:51.926+0000 7f38de7fc700 1 -- 172.21.15.19:0/659076249 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f38f00a8960 con 0x7f38f00a6cf0 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.090+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f38f00643a0 con 0x7f38d0060860 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38de7fc700 1 -- 172.21.15.19:0/659076249 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38f00643a0 con 0x7f38d0060860 2024-08-17T02:29:52.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f38d0060860 msgr2=0x7f38d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f38d0060860 0x7f38d0062d10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f38e4001c80 tx=0x7f38e400d040 comp rx=0 tx=0).stop 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38f00a6cf0 msgr2=0x7f38f00a8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38f00a6cf0 0x7f38f00a8c40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f38e000e780 tx=0x7f38e0009040 comp rx=0 tx=0).stop 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 shutdown_connections 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f38d0060860 0x7f38d0062d10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38f00a7350 0x7f38f0145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38f00a6cf0 0x7f38f00a8c40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 --2- 172.21.15.19:0/659076249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38d80051c0 0x7f38f013ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 >> 172.21.15.19:0/659076249 conn(0x7f38f00678d0 msgr2=0x7f38f00b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 shutdown_connections 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.094+0000 7f38ef59e700 1 -- 172.21.15.19:0/659076249 wait complete. 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:29:52.116 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:29:52.117 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.226+0000 7fb53e807700 1 Processor -- start 2024-08-17T02:29:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.226+0000 7fb53e807700 1 -- start start 2024-08-17T02:29:52.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb538156940 0x7fb538156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5380ca6d0 0x7fb5380cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5380cef10 con 0x7fb53815a0b0 2024-08-17T02:29:52.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380cd0a0 con 0x7fb538156940 2024-08-17T02:29:52.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380cab90 con 0x7fb5380ca6d0 2024-08-17T02:29:52.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e006700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb53815a0b0 0x7fb5380ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52402/0 (socket says 172.21.15.19:52402) 2024-08-17T02:29:52.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e006700 1 -- 172.21.15.19:0/2031124503 learned_addr learned my addr 172.21.15.19:0/2031124503 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:52.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53d805700 1 --2- 172.21.15.19:0/2031124503 >> v2:172.21.15.19:3300/0 conn(0x7fb538156940 0x7fb538156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53d004700 1 --2- 172.21.15.19:0/2031124503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5380ca6d0 0x7fb5380cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53c803700 1 -- 172.21.15.19:0/2031124503 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874284745 0 0) 0x7fb5380cef10 con 0x7fb53815a0b0 2024-08-17T02:29:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53c803700 1 -- 172.21.15.19:0/2031124503 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb524003570 con 0x7fb53815a0b0 2024-08-17T02:29:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53d805700 1 -- 172.21.15.19:0/2031124503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5380ca6d0 msgr2=0x7fb5380cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53d805700 1 --2- 172.21.15.19:0/2031124503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5380ca6d0 0x7fb5380cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53d805700 1 -- 172.21.15.19:0/2031124503 >> v1:172.21.15.19:6789/0 conn(0x7fb53815a0b0 legacy=0x7fb5380ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53d805700 1 -- 172.21.15.19:0/2031124503 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380cca50 con 0x7fb538156940 2024-08-17T02:29:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53d805700 1 --2- 172.21.15.19:0/2031124503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 0x7fb538156d10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb5280098e0 tx=0x7fb5280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8b17ee8376511f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53c803700 1 -- 172.21.15.19:0/2031124503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528011630 con 0x7fb538156940 2024-08-17T02:29:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53c803700 1 -- 172.21.15.19:0/2031124503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb528011790 con 0x7fb538156940 2024-08-17T02:29:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53c803700 1 -- 172.21.15.19:0/2031124503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528011b30 con 0x7fb538156940 2024-08-17T02:29:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 -- 172.21.15.19:0/2031124503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 msgr2=0x7fb538156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 --2- 172.21.15.19:0/2031124503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 0x7fb538156d10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb5280098e0 tx=0x7fb5280091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 -- 172.21.15.19:0/2031124503 shutdown_connections 2024-08-17T02:29:52.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 --2- 172.21.15.19:0/2031124503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5380ca6d0 0x7fb5380cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 --2- 172.21.15.19:0/2031124503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 0x7fb538156d10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 -- 172.21.15.19:0/2031124503 >> 172.21.15.19:0/2031124503 conn(0x7fb538066e00 msgr2=0x7fb538067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 -- 172.21.15.19:0/2031124503 shutdown_connections 2024-08-17T02:29:52.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.230+0000 7fb53e807700 1 -- 172.21.15.19:0/2031124503 wait complete. 2024-08-17T02:29:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e807700 1 Processor -- start 2024-08-17T02:29:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e807700 1 -- start start 2024-08-17T02:29:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e807700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5380ca6d0 0x7fb53813f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e807700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 0x7fb5380c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e807700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb53815a0b0 0x7fb5380c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e807700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380c9450 con 0x7fb538156940 2024-08-17T02:29:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e807700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380c9730 con 0x7fb5380ca6d0 2024-08-17T02:29:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e807700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380c9a10 con 0x7fb53815a0b0 2024-08-17T02:29:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d004700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 0x7fb5380c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d004700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 0x7fb5380c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38630/0 (socket says 172.21.15.19:38630) 2024-08-17T02:29:52.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d004700 1 -- 172.21.15.19:0/2664438308 learned_addr learned my addr 172.21.15.19:0/2664438308 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:52.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d805700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5380ca6d0 0x7fb53813f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e006700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb53815a0b0 0x7fb5380c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d004700 1 -- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb53815a0b0 msgr2=0x7fb5380c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d004700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb53815a0b0 0x7fb5380c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d004700 1 -- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5380ca6d0 msgr2=0x7fb53813f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d004700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5380ca6d0 0x7fb53813f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d004700 1 -- 172.21.15.19:0/2664438308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb528009420 con 0x7fb538156940 2024-08-17T02:29:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53e006700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb53815a0b0 0x7fb5380c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d805700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5380ca6d0 0x7fb53813f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:52.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.234+0000 7fb53d004700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 0x7fb5380c8a40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb53400ea30 tx=0x7fb5340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb52dffb700 1 -- 172.21.15.19:0/2664438308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53400c850 con 0x7fb538156940 2024-08-17T02:29:52.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5380c9cf0 con 0x7fb538156940 2024-08-17T02:29:52.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb52dffb700 1 -- 172.21.15.19:0/2664438308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53400c9b0 con 0x7fb538156940 2024-08-17T02:29:52.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb538152940 con 0x7fb538156940 2024-08-17T02:29:52.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb52dffb700 1 -- 172.21.15.19:0/2664438308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53400cd50 con 0x7fb538156940 2024-08-17T02:29:52.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5380afcc0 con 0x7fb538156940 2024-08-17T02:29:52.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb52dffb700 1 -- 172.21.15.19:0/2664438308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb534013680 con 0x7fb538156940 2024-08-17T02:29:52.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb52dffb700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb51c060860 0x7fb51c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb52dffb700 1 -- 172.21.15.19:0/2664438308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb53407d490 con 0x7fb538156940 2024-08-17T02:29:52.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb52dffb700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fb51c066750 0x7fb51c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb52dffb700 1 -- 172.21.15.19:0/2664438308 --> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb51c069210 con 0x7fb51c066750 2024-08-17T02:29:52.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb52dffb700 1 -- 172.21.15.19:0/2664438308 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb53407d860 con 0x7fb538156940 2024-08-17T02:29:52.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb53d805700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb51c060860 0x7fb51c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.238+0000 7fb53e006700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fb51c066750 0x7fb51c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.242+0000 7fb53d805700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb51c060860 0x7fb51c062d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb5280091e0 tx=0x7fb528017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.242+0000 7fb53e006700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fb51c066750 0x7fb51c068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.242+0000 7fb52dffb700 1 -- 172.21.15.19:0/2664438308 <== osd.5 v2:172.21.15.119:6800/24492 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb51c069210 con 0x7fb51c066750 2024-08-17T02:29:52.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.258+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 --> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb5380c9e80 con 0x7fb51c066750 2024-08-17T02:29:52.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.258+0000 7fb52dffb700 1 -- 172.21.15.19:0/2664438308 <== osd.5 v2:172.21.15.119:6800/24492 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb5380c9e80 con 0x7fb51c066750 2024-08-17T02:29:52.265 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:29:52.266 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:52.266 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:29:52.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.258+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fb51c066750 msgr2=0x7fb51c068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.258+0000 7fb53e807700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6800/24492,v1:172.21.15.119:6801/24492] conn(0x7fb51c066750 0x7fb51c068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.262+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb51c060860 msgr2=0x7fb51c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.262+0000 7fb53e807700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fb51c060860 0x7fb51c062d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb5280091e0 tx=0x7fb528017000 comp rx=0 tx=0).stop 2024-08-17T02:29:52.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.262+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 msgr2=0x7fb5380c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.262+0000 7fb53e807700 1 --2- 172.21.15.19:0/2664438308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb538156940 0x7fb5380c8a40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb53400ea30 tx=0x7fb5340091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.262+0000 7fb53e006700 1 -- 172.21.15.19:0/2664438308 reap_dead start 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.262+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 shutdown_connections 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.262+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 >> 172.21.15.19:0/2664438308 conn(0x7fb538066e00 msgr2=0x7fb53815bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.262+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 shutdown_connections 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.262+0000 7fb53e807700 1 -- 172.21.15.19:0/2664438308 wait complete. 2024-08-17T02:29:52.279 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:29:52.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dff03a700 1 Processor -- start 2024-08-17T02:29:52.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dff03a700 1 -- start start 2024-08-17T02:29:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dff03a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b0d20 0x7f0df806df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dff03a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0df806e450 0x7f0df80b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dff03a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df8141a00 con 0x7f0df80b1630 2024-08-17T02:29:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dff03a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df806e8a0 con 0x7f0df806e450 2024-08-17T02:29:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dff03a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df8140b10 con 0x7f0df80b0d20 2024-08-17T02:29:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfd837700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0df806e450 0x7f0df80b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfe839700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0df80b1630 0x7f0df81610f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52406/0 (socket says 172.21.15.19:52406) 2024-08-17T02:29:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfe839700 1 -- 172.21.15.19:0/2534619624 learned_addr learned my addr 172.21.15.19:0/2534619624 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfe038700 1 --2- 172.21.15.19:0/2534619624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b0d20 0x7f0df806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfd036700 1 -- 172.21.15.19:0/2534619624 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049435140 0 0) 0x7f0df8141a00 con 0x7f0df80b1630 2024-08-17T02:29:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfd036700 1 -- 172.21.15.19:0/2534619624 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de4003570 con 0x7f0df80b1630 2024-08-17T02:29:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfd036700 1 -- 172.21.15.19:0/2534619624 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3290960147 0 0) 0x7f0de4003570 con 0x7f0df80b1630 2024-08-17T02:29:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfd837700 1 -- 172.21.15.19:0/2534619624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b0d20 msgr2=0x7f0df806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfd837700 1 --2- 172.21.15.19:0/2534619624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b0d20 0x7f0df806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfd837700 1 -- 172.21.15.19:0/2534619624 >> v1:172.21.15.19:6789/0 conn(0x7f0df80b1630 legacy=0x7f0df81610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.390+0000 7f0dfd837700 1 -- 172.21.15.19:0/2534619624 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8140df0 con 0x7f0df806e450 2024-08-17T02:29:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dfd837700 1 --2- 172.21.15.19:0/2534619624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df806e450 0x7f0df80b10f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0de80098e0 tx=0x7f0de80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f795a2e3239f505c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dfd036700 1 -- 172.21.15.19:0/2534619624 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4001470 con 0x7f0df806e450 2024-08-17T02:29:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dfd036700 1 -- 172.21.15.19:0/2534619624 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de8011420 con 0x7f0df806e450 2024-08-17T02:29:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dfd036700 1 -- 172.21.15.19:0/2534619624 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de80117c0 con 0x7f0df806e450 2024-08-17T02:29:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 -- 172.21.15.19:0/2534619624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df806e450 msgr2=0x7f0df80b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 --2- 172.21.15.19:0/2534619624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df806e450 0x7f0df80b10f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0de80098e0 tx=0x7f0de80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 -- 172.21.15.19:0/2534619624 shutdown_connections 2024-08-17T02:29:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 --2- 172.21.15.19:0/2534619624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df806e450 0x7f0df80b10f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 --2- 172.21.15.19:0/2534619624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b0d20 0x7f0df806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 -- 172.21.15.19:0/2534619624 >> 172.21.15.19:0/2534619624 conn(0x7f0df80678d0 msgr2=0x7f0df8067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 -- 172.21.15.19:0/2534619624 shutdown_connections 2024-08-17T02:29:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 -- 172.21.15.19:0/2534619624 wait complete. 2024-08-17T02:29:52.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 Processor -- start 2024-08-17T02:29:52.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.394+0000 7f0dff03a700 1 -- start start 2024-08-17T02:29:52.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dff03a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0df806e450 0x7f0df80a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dff03a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df80b0d20 0x7f0df816d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dff03a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b1630 0x7f0df80acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dff03a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80a5450 con 0x7f0df80b0d20 2024-08-17T02:29:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dff03a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80a5fd0 con 0x7f0df806e450 2024-08-17T02:29:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dff03a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80a56a0 con 0x7f0df80b1630 2024-08-17T02:29:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfd837700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df80b0d20 0x7f0df816d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfd837700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df80b0d20 0x7f0df816d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38646/0 (socket says 172.21.15.19:38646) 2024-08-17T02:29:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfd837700 1 -- 172.21.15.19:0/2888659114 learned_addr learned my addr 172.21.15.19:0/2888659114 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfe038700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0df806e450 0x7f0df80a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfe839700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b1630 0x7f0df80acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfd837700 1 -- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b1630 msgr2=0x7f0df80acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfd837700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b1630 0x7f0df80acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfd837700 1 -- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0df806e450 msgr2=0x7f0df80a7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfd837700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0df806e450 0x7f0df80a7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfd837700 1 -- 172.21.15.19:0/2888659114 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8009420 con 0x7f0df80b0d20 2024-08-17T02:29:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfe038700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0df806e450 0x7f0df80a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:52.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfe839700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b1630 0x7f0df80acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dfd837700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df80b0d20 0x7f0df816d3c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0de80030c0 tx=0x7f0de8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dee7fc700 1 -- 172.21.15.19:0/2888659114 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de801cc00 con 0x7f0df80b0d20 2024-08-17T02:29:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dee7fc700 1 -- 172.21.15.19:0/2888659114 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de801cd80 con 0x7f0df80b0d20 2024-08-17T02:29:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df80a5980 con 0x7f0df80b0d20 2024-08-17T02:29:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dee7fc700 1 -- 172.21.15.19:0/2888659114 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de801a6a0 con 0x7f0df80b0d20 2024-08-17T02:29:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df80a83f0 con 0x7f0df80b0d20 2024-08-17T02:29:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.398+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df80a6140 con 0x7f0df80b0d20 2024-08-17T02:29:52.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.402+0000 7f0dee7fc700 1 -- 172.21.15.19:0/2888659114 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0de801aad0 con 0x7f0df80b0d20 2024-08-17T02:29:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.402+0000 7f0dee7fc700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0ddc0608e0 0x7f0ddc062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.402+0000 7f0dee7fc700 1 -- 172.21.15.19:0/2888659114 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0de807e1c0 con 0x7f0df80b0d20 2024-08-17T02:29:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.402+0000 7f0dfe038700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0ddc0608e0 0x7f0ddc062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.402+0000 7f0dfe038700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0ddc0608e0 0x7f0ddc062d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0df000e950 tx=0x7f0df000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.410+0000 7f0dee7fc700 1 -- 172.21.15.19:0/2888659114 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0de804e810 con 0x7f0df80b0d20 2024-08-17T02:29:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.574+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0df80643a0 con 0x7f0ddc0608e0 2024-08-17T02:29:52.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.574+0000 7f0dee7fc700 1 -- 172.21.15.19:0/2888659114 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0df80643a0 con 0x7f0ddc0608e0 2024-08-17T02:29:52.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0ddc0608e0 msgr2=0x7f0ddc062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0ddc0608e0 0x7f0ddc062d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0df000e950 tx=0x7f0df000b040 comp rx=0 tx=0).stop 2024-08-17T02:29:52.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df80b0d20 msgr2=0x7f0df816d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df80b0d20 0x7f0df816d3c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0de80030c0 tx=0x7f0de8016000 comp rx=0 tx=0).stop 2024-08-17T02:29:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 shutdown_connections 2024-08-17T02:29:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f0ddc0608e0 0x7f0ddc062d90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0df80b1630 0x7f0df80acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0df80b0d20 0x7f0df816d3c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 --2- 172.21.15.19:0/2888659114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0df806e450 0x7f0df80a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 >> 172.21.15.19:0/2888659114 conn(0x7f0df80678d0 msgr2=0x7f0df815eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 shutdown_connections 2024-08-17T02:29:52.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.578+0000 7f0dff03a700 1 -- 172.21.15.19:0/2888659114 wait complete. 2024-08-17T02:29:52.584 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:29:52.594 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:29:52.594 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:52.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.698+0000 7f1389f0f700 1 Processor -- start 2024-08-17T02:29:52.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.698+0000 7f1389f0f700 1 -- start start 2024-08-17T02:29:52.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384159140 0x7f13840b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1384069d10 0x7f1384067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1384067b10 con 0x7f13840b12c0 2024-08-17T02:29:52.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840b1b30 con 0x7f1384069d10 2024-08-17T02:29:52.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1384159510 con 0x7f1384159140 2024-08-17T02:29:52.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1388f0d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384159140 0x7f13840b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1388f0d700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384159140 0x7f13840b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:42812/0 (socket says 172.21.15.19:42812) 2024-08-17T02:29:52.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1388f0d700 1 -- 172.21.15.19:0/778550543 learned_addr learned my addr 172.21.15.19:0/778550543 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:52.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1383fff700 1 --1- 172.21.15.19:0/778550543 >> v1:172.21.15.119:6789/0 conn(0x7f13840b12c0 0x7f1384069600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:37262/0 (socket says 172.21.15.19:37262) 2024-08-17T02:29:52.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f138970e700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1384069d10 0x7f1384067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f13837fe700 1 -- 172.21.15.19:0/778550543 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149136907 0 0) 0x7f1384067b10 con 0x7f13840b12c0 2024-08-17T02:29:52.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1388f0d700 1 -- 172.21.15.19:0/778550543 >> v2:172.21.15.119:3300/0 conn(0x7f1384069d10 msgr2=0x7f1384067fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:52.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1388f0d700 1 --2- 172.21.15.19:0/778550543 >> v2:172.21.15.119:3300/0 conn(0x7f1384069d10 0x7f1384067fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1388f0d700 1 -- 172.21.15.19:0/778550543 >> v1:172.21.15.119:6789/0 conn(0x7f13840b12c0 legacy=0x7f1384069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1388f0d700 1 -- 172.21.15.19:0/778550543 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840b1850 con 0x7f1384159140 2024-08-17T02:29:52.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1388f0d700 1 --2- 172.21.15.19:0/778550543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384159140 0x7f13840b0d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13780099b0 tx=0x7f1378009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=780613b1cdd78ad0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f13837fe700 1 -- 172.21.15.19:0/778550543 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378009ea0 con 0x7f1384159140 2024-08-17T02:29:52.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f13837fe700 1 -- 172.21.15.19:0/778550543 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137800b860 con 0x7f1384159140 2024-08-17T02:29:52.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f13837fe700 1 -- 172.21.15.19:0/778550543 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137800bc00 con 0x7f1384159140 2024-08-17T02:29:52.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 -- 172.21.15.19:0/778550543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384159140 msgr2=0x7f13840b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 --2- 172.21.15.19:0/778550543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384159140 0x7f13840b0d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13780099b0 tx=0x7f1378009250 comp rx=0 tx=0).stop 2024-08-17T02:29:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 -- 172.21.15.19:0/778550543 shutdown_connections 2024-08-17T02:29:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 --2- 172.21.15.19:0/778550543 >> v2:172.21.15.119:3300/0 conn(0x7f1384069d10 0x7f1384067fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 --2- 172.21.15.19:0/778550543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384159140 0x7f13840b0d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.702+0000 7f1389f0f700 1 -- 172.21.15.19:0/778550543 >> 172.21.15.19:0/778550543 conn(0x7f138406a700 msgr2=0x7f13840aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 -- 172.21.15.19:0/778550543 shutdown_connections 2024-08-17T02:29:52.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 -- 172.21.15.19:0/778550543 wait complete. 2024-08-17T02:29:52.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 Processor -- start 2024-08-17T02:29:52.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 -- start start 2024-08-17T02:29:52.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384069d10 0x7f1384154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13840b12c0 0x7f13840ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1384159140 0x7f1384169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13840aaf30 con 0x7f1384159140 2024-08-17T02:29:52.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138415dc20 con 0x7f13840b12c0 2024-08-17T02:29:52.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1389f0f700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1384154ed0 con 0x7f1384069d10 2024-08-17T02:29:52.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f138970e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1384159140 0x7f1384169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f138970e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1384159140 0x7f1384169280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38660/0 (socket says 172.21.15.19:38660) 2024-08-17T02:29:52.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f138970e700 1 -- 172.21.15.19:0/285674921 learned_addr learned my addr 172.21.15.19:0/285674921 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:52.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1383fff700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13840b12c0 0x7f13840ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.706+0000 7f1388f0d700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384069d10 0x7f1384154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1383fff700 1 -- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384069d10 msgr2=0x7f1384154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1383fff700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1384069d10 0x7f1384154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1383fff700 1 -- 172.21.15.19:0/285674921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1384159140 msgr2=0x7f1384169280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1383fff700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1384159140 0x7f1384169280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1383fff700 1 -- 172.21.15.19:0/285674921 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780094f0 con 0x7f13840b12c0 2024-08-17T02:29:52.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1383fff700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13840b12c0 0x7f13840ab130 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f137000c5b0 tx=0x7f1370007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1380ff9700 1 -- 172.21.15.19:0/285674921 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370005b40 con 0x7f13840b12c0 2024-08-17T02:29:52.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1380ff9700 1 -- 172.21.15.19:0/285674921 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370005ca0 con 0x7f13840b12c0 2024-08-17T02:29:52.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138415d010 con 0x7f13840b12c0 2024-08-17T02:29:52.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1380ff9700 1 -- 172.21.15.19:0/285674921 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370007320 con 0x7f13840b12c0 2024-08-17T02:29:52.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138415d5d0 con 0x7f13840b12c0 2024-08-17T02:29:52.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13840644b0 con 0x7f13840b12c0 2024-08-17T02:29:52.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1380ff9700 1 -- 172.21.15.19:0/285674921 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1370033ad0 con 0x7f13840b12c0 2024-08-17T02:29:52.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.710+0000 7f1380ff9700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1368060860 0x7f1368062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.714+0000 7f1380ff9700 1 -- 172.21.15.19:0/285674921 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f137007bf30 con 0x7f13840b12c0 2024-08-17T02:29:52.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.714+0000 7f1388f0d700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1368060860 0x7f1368062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.714+0000 7f1380ff9700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f1368066750 0x7f1368068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.714+0000 7f1380ff9700 1 -- 172.21.15.19:0/285674921 --> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1368069210 con 0x7f1368066750 2024-08-17T02:29:52.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.714+0000 7f1380ff9700 1 -- 172.21.15.19:0/285674921 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f137007c220 con 0x7f13840b12c0 2024-08-17T02:29:52.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.714+0000 7f138970e700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f1368066750 0x7f1368068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.714+0000 7f1388f0d700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1368060860 0x7f1368062d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1378009290 tx=0x7f1378017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.714+0000 7f138970e700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f1368066750 0x7f1368068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.714+0000 7f1380ff9700 1 -- 172.21.15.19:0/285674921 <== osd.6 v2:172.21.15.119:6816/24496 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1368069210 con 0x7f1368066750 2024-08-17T02:29:52.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.734+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 --> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f13840afeb0 con 0x7f1368066750 2024-08-17T02:29:52.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1380ff9700 1 -- 172.21.15.19:0/285674921 <== osd.6 v2:172.21.15.119:6816/24496 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f13840afeb0 con 0x7f1368066750 2024-08-17T02:29:52.741 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:29:52.742 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:52.742 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:29:52.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f1368066750 msgr2=0x7f1368068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6816/24496,v1:172.21.15.119:6817/24496] conn(0x7f1368066750 0x7f1368068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1368060860 msgr2=0x7f1368062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f1368060860 0x7f1368062d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1378009290 tx=0x7f1378017000 comp rx=0 tx=0).stop 2024-08-17T02:29:52.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13840b12c0 msgr2=0x7f13840ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 --2- 172.21.15.19:0/285674921 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13840b12c0 0x7f13840ab130 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f137000c5b0 tx=0x7f1370007d50 comp rx=0 tx=0).stop 2024-08-17T02:29:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f138970e700 1 -- 172.21.15.19:0/285674921 reap_dead start 2024-08-17T02:29:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 shutdown_connections 2024-08-17T02:29:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 >> 172.21.15.19:0/285674921 conn(0x7f138406a700 msgr2=0x7f1384155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 shutdown_connections 2024-08-17T02:29:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.738+0000 7f1389f0f700 1 -- 172.21.15.19:0/285674921 wait complete. 2024-08-17T02:29:52.758 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:29:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2703fff700 1 Processor -- start 2024-08-17T02:29:52.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2703fff700 1 -- start start 2024-08-17T02:29:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2703fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2704154900 0x7f27040b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2703fff700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f27040cb560 0x7f2704160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2703fff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27040b1730 con 0x7f27040b12d0 2024-08-17T02:29:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2703fff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2704068790 con 0x7f2704154900 2024-08-17T02:29:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2703fff700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27041583f0 con 0x7f27040cb560 2024-08-17T02:29:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2702ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2704154900 0x7f27040b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2702ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2704154900 0x7f27040b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38672/0 (socket says 172.21.15.19:38672) 2024-08-17T02:29:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2702ffd700 1 -- 172.21.15.19:0/1234104151 learned_addr learned my addr 172.21.15.19:0/1234104151 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f27037fe700 1 --2- 172.21.15.19:0/1234104151 >> v2:172.21.15.119:3300/0 conn(0x7f27040cb560 0x7f2704160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2701ffb700 1 -- 172.21.15.19:0/1234104151 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430046948 0 0) 0x7f26f4001490 con 0x7f27040b12d0 2024-08-17T02:29:52.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2701ffb700 1 -- 172.21.15.19:0/1234104151 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f0003570 con 0x7f27040b12d0 2024-08-17T02:29:52.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2702ffd700 1 -- 172.21.15.19:0/1234104151 >> v2:172.21.15.119:3300/0 conn(0x7f27040cb560 msgr2=0x7f2704160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:52.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2702ffd700 1 --2- 172.21.15.19:0/1234104151 >> v2:172.21.15.119:3300/0 conn(0x7f27040cb560 0x7f2704160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2702ffd700 1 -- 172.21.15.19:0/1234104151 >> v1:172.21.15.119:6789/0 conn(0x7f27040b12d0 legacy=0x7f27040cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f2702ffd700 1 -- 172.21.15.19:0/1234104151 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040cbaa0 con 0x7f2704154900 2024-08-17T02:29:52.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.866+0000 7f27037fe700 1 --2- 172.21.15.19:0/1234104151 >> v2:172.21.15.119:3300/0 conn(0x7f27040cb560 0x7f2704160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:52.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2702ffd700 1 --2- 172.21.15.19:0/1234104151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2704154900 0x7f27040b0d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f270406c980 tx=0x7f26ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7cfee268920002 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2701ffb700 1 -- 172.21.15.19:0/1234104151 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00b640 con 0x7f2704154900 2024-08-17T02:29:52.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2701ffb700 1 -- 172.21.15.19:0/1234104151 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec00b7a0 con 0x7f2704154900 2024-08-17T02:29:52.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2701ffb700 1 -- 172.21.15.19:0/1234104151 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00bb20 con 0x7f2704154900 2024-08-17T02:29:52.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 -- 172.21.15.19:0/1234104151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2704154900 msgr2=0x7f27040b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 --2- 172.21.15.19:0/1234104151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2704154900 0x7f27040b0d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f270406c980 tx=0x7f26ec009250 comp rx=0 tx=0).stop 2024-08-17T02:29:52.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 -- 172.21.15.19:0/1234104151 shutdown_connections 2024-08-17T02:29:52.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 --2- 172.21.15.19:0/1234104151 >> v2:172.21.15.119:3300/0 conn(0x7f27040cb560 0x7f2704160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 --2- 172.21.15.19:0/1234104151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2704154900 0x7f27040b0d90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 -- 172.21.15.19:0/1234104151 >> 172.21.15.19:0/1234104151 conn(0x7f27040678d0 msgr2=0x7f2704067cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 -- 172.21.15.19:0/1234104151 shutdown_connections 2024-08-17T02:29:52.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 -- 172.21.15.19:0/1234104151 wait complete. 2024-08-17T02:29:52.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 Processor -- start 2024-08-17T02:29:52.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 -- start start 2024-08-17T02:29:52.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27040b12d0 0x7f270414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27040cb560 0x7f270416a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2704154900 0x7f27040b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27040a9860 con 0x7f27040cb560 2024-08-17T02:29:52.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27040a9b40 con 0x7f2704154900 2024-08-17T02:29:52.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2703fff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27040a9e20 con 0x7f27040b12d0 2024-08-17T02:29:52.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f27027fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27040cb560 0x7f270416a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f27027fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27040cb560 0x7f270416a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38686/0 (socket says 172.21.15.19:38686) 2024-08-17T02:29:52.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f27027fc700 1 -- 172.21.15.19:0/1307514363 learned_addr learned my addr 172.21.15.19:0/1307514363 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:52.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f2702ffd700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27040b12d0 0x7f270414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f27037fe700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2704154900 0x7f27040b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.870+0000 7f27027fc700 1 -- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27040b12d0 msgr2=0x7f270414ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f27027fc700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27040b12d0 0x7f270414ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f27027fc700 1 -- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2704154900 msgr2=0x7f27040b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f27027fc700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2704154900 0x7f27040b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f27027fc700 1 -- 172.21.15.19:0/1307514363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc009420 con 0x7f27040cb560 2024-08-17T02:29:52.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f27037fe700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2704154900 0x7f27040b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:52.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f27027fc700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27040cb560 0x7f270416a460 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f26f400cb10 tx=0x7f26f40027f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f26faffd700 1 -- 172.21.15.19:0/1307514363 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400a760 con 0x7f27040cb560 2024-08-17T02:29:52.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f26faffd700 1 -- 172.21.15.19:0/1307514363 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f400a8c0 con 0x7f27040cb560 2024-08-17T02:29:52.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec0094f0 con 0x7f27040cb560 2024-08-17T02:29:52.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f26faffd700 1 -- 172.21.15.19:0/1307514363 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400ac80 con 0x7f27040cb560 2024-08-17T02:29:52.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27040aa3e0 con 0x7f27040cb560 2024-08-17T02:29:52.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27040aa600 con 0x7f27040cb560 2024-08-17T02:29:52.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f26faffd700 1 -- 172.21.15.19:0/1307514363 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f26f4012420 con 0x7f27040cb560 2024-08-17T02:29:52.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f26faffd700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e4060860 0x7f26e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f26faffd700 1 -- 172.21.15.19:0/1307514363 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f26f407cb60 con 0x7f27040cb560 2024-08-17T02:29:52.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.874+0000 7f2702ffd700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e4060860 0x7f26e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.878+0000 7f2702ffd700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e4060860 0x7f26e4062d10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f270406c980 tx=0x7f26ec017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:52.882+0000 7f26faffd700 1 -- 172.21.15.19:0/1307514363 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f26f404d250 con 0x7f27040cb560 2024-08-17T02:29:53.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.042+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f27040b1730 con 0x7f26e4060860 2024-08-17T02:29:53.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f26faffd700 1 -- 172.21.15.19:0/1307514363 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f27040b1730 con 0x7f26e4060860 2024-08-17T02:29:53.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e4060860 msgr2=0x7f26e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e4060860 0x7f26e4062d10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f270406c980 tx=0x7f26ec017000 comp rx=0 tx=0).stop 2024-08-17T02:29:53.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27040cb560 msgr2=0x7f270416a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27040cb560 0x7f270416a460 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f26f400cb10 tx=0x7f26f40027f0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 shutdown_connections 2024-08-17T02:29:53.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f26e4060860 0x7f26e4062d10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2704154900 0x7f27040b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27040cb560 0x7f270416a460 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 --2- 172.21.15.19:0/1307514363 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27040b12d0 0x7f270414ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 >> 172.21.15.19:0/1307514363 conn(0x7f27040678d0 msgr2=0x7f270406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 shutdown_connections 2024-08-17T02:29:53.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.046+0000 7f2703fff700 1 -- 172.21.15.19:0/1307514363 wait complete. 2024-08-17T02:29:53.054 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:29:53.064 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:29:53.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:53.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.178+0000 7fdc0ab88700 1 Processor -- start 2024-08-17T02:29:53.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.178+0000 7fdc0ab88700 1 -- start start 2024-08-17T02:29:53.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc0ab88700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040b2e70 0x7fdc040cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc0ab88700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdc040cc230 0x7fdc040c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc0ab88700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040c5bb0 con 0x7fdc040ce640 2024-08-17T02:29:53.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc0ab88700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc040cc670 con 0x7fdc040cc230 2024-08-17T02:29:53.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc0ab88700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040b32c0 con 0x7fdc040b2e70 2024-08-17T02:29:53.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc0a387700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdc040cc230 0x7fdc040c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc09385700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040b2e70 0x7fdc040cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc0a387700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdc040cc230 0x7fdc040c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.19:49934/0 (socket says 172.21.15.19:49934) 2024-08-17T02:29:53.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc0a387700 1 -- 172.21.15.19:0/2973711282 learned_addr learned my addr 172.21.15.19:0/2973711282 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:53.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc09385700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040b2e70 0x7fdc040cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:42824/0 (socket says 172.21.15.19:42824) 2024-08-17T02:29:53.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc09b86700 1 --1- 172.21.15.19:0/2973711282 >> v1:172.21.15.119:6789/0 conn(0x7fdc040ce640 0x7fdc040cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:37284/0 (socket says 172.21.15.19:37284) 2024-08-17T02:29:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc09385700 1 -- 172.21.15.19:0/2973711282 >> v2:172.21.15.119:3300/0 conn(0x7fdc040cc230 msgr2=0x7fdc040c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc09385700 1 --2- 172.21.15.19:0/2973711282 >> v2:172.21.15.119:3300/0 conn(0x7fdc040cc230 0x7fdc040c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc09385700 1 -- 172.21.15.19:0/2973711282 >> v1:172.21.15.119:6789/0 conn(0x7fdc040ce640 legacy=0x7fdc040cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc09385700 1 -- 172.21.15.19:0/2973711282 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040c4fa0 con 0x7fdc040b2e70 2024-08-17T02:29:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc0a387700 1 --2- 172.21.15.19:0/2973711282 >> v2:172.21.15.119:3300/0 conn(0x7fdc040cc230 0x7fdc040c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc09385700 1 --2- 172.21.15.19:0/2973711282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040b2e70 0x7fdc040cbcf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc000098e0 tx=0x7fdc000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3105284bcf1d3f8d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc08b84700 1 -- 172.21.15.19:0/2973711282 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000b640 con 0x7fdc040b2e70 2024-08-17T02:29:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc08b84700 1 -- 172.21.15.19:0/2973711282 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0000b7a0 con 0x7fdc040b2e70 2024-08-17T02:29:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.182+0000 7fdc08b84700 1 -- 172.21.15.19:0/2973711282 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000bb40 con 0x7fdc040b2e70 2024-08-17T02:29:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 -- 172.21.15.19:0/2973711282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040b2e70 msgr2=0x7fdc040cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 --2- 172.21.15.19:0/2973711282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040b2e70 0x7fdc040cbcf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdc000098e0 tx=0x7fdc000091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 -- 172.21.15.19:0/2973711282 shutdown_connections 2024-08-17T02:29:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 --2- 172.21.15.19:0/2973711282 >> v2:172.21.15.119:3300/0 conn(0x7fdc040cc230 0x7fdc040c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 --2- 172.21.15.19:0/2973711282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040b2e70 0x7fdc040cbcf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 -- 172.21.15.19:0/2973711282 >> 172.21.15.19:0/2973711282 conn(0x7fdc04099410 msgr2=0x7fdc040675e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 -- 172.21.15.19:0/2973711282 shutdown_connections 2024-08-17T02:29:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 -- 172.21.15.19:0/2973711282 wait complete. 2024-08-17T02:29:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 Processor -- start 2024-08-17T02:29:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.186+0000 7fdc0ab88700 1 -- start start 2024-08-17T02:29:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0ab88700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc040b2e70 0x7fdc0415bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0ab88700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040cc230 0x7fdc040c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0ab88700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc040ce640 0x7fdc04151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0ab88700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040c8810 con 0x7fdc040b2e70 2024-08-17T02:29:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0ab88700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040c8ca0 con 0x7fdc040ce640 2024-08-17T02:29:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0ab88700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040c7c00 con 0x7fdc040cc230 2024-08-17T02:29:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09b86700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc040b2e70 0x7fdc0415bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09b86700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc040b2e70 0x7fdc0415bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38696/0 (socket says 172.21.15.19:38696) 2024-08-17T02:29:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09385700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040cc230 0x7fdc040c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0a387700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc040ce640 0x7fdc04151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09b86700 1 -- 172.21.15.19:0/35509684 learned_addr learned my addr 172.21.15.19:0/35509684 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09b86700 1 -- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040cc230 msgr2=0x7fdc040c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09b86700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdc040cc230 0x7fdc040c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09b86700 1 -- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc040ce640 msgr2=0x7fdc04151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09b86700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc040ce640 0x7fdc04151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09b86700 1 -- 172.21.15.19:0/35509684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc009ae0 con 0x7fdc040b2e70 2024-08-17T02:29:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc09b86700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc040b2e70 0x7fdc0415bdc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c7c0 tx=0x7fdbf8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdbf5ffb700 1 -- 172.21.15.19:0/35509684 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8005a70 con 0x7fdc040b2e70 2024-08-17T02:29:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdbf5ffb700 1 -- 172.21.15.19:0/35509684 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf8005bd0 con 0x7fdc040b2e70 2024-08-17T02:29:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc00009420 con 0x7fdc040b2e70 2024-08-17T02:29:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdbf5ffb700 1 -- 172.21.15.19:0/35509684 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80070d0 con 0x7fdc040b2e70 2024-08-17T02:29:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc040c7f90 con 0x7fdc040b2e70 2024-08-17T02:29:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.190+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc040c85c0 con 0x7fdc040b2e70 2024-08-17T02:29:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdbf5ffb700 1 -- 172.21.15.19:0/35509684 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fdbf8007480 con 0x7fdc040b2e70 2024-08-17T02:29:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdbf5ffb700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbe8060860 0x7fdbe8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdbf5ffb700 1 -- 172.21.15.19:0/35509684 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fdbf807bdd0 con 0x7fdc040b2e70 2024-08-17T02:29:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdbf5ffb700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7fdbe8066750 0x7fdbe8068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdbf5ffb700 1 -- 172.21.15.19:0/35509684 --> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbe8069210 con 0x7fdbe8066750 2024-08-17T02:29:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdbf5ffb700 1 -- 172.21.15.19:0/35509684 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbf807f020 con 0x7fdc040b2e70 2024-08-17T02:29:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdc09385700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbe8060860 0x7fdbe8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdc0a387700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7fdbe8066750 0x7fdbe8068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdc0a387700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7fdbe8066750 0x7fdbe8068b60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.194+0000 7fdc09385700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbe8060860 0x7fdbe8062d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdc000093f0 tx=0x7fdc00017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.198+0000 7fdbf5ffb700 1 -- 172.21.15.19:0/35509684 <== osd.7 v2:172.21.15.119:6808/24493 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fdbe8069210 con 0x7fdbe8066750 2024-08-17T02:29:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 --> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdc040644b0 con 0x7fdbe8066750 2024-08-17T02:29:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdbf5ffb700 1 -- 172.21.15.19:0/35509684 <== osd.7 v2:172.21.15.119:6808/24493 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdc040644b0 con 0x7fdbe8066750 2024-08-17T02:29:53.223 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-08-17T02:29:53.223 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:53.224 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-08-17T02:29:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7fdbe8066750 msgr2=0x7fdbe8068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6808/24493,v1:172.21.15.119:6809/24493] conn(0x7fdbe8066750 0x7fdbe8068b60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbe8060860 msgr2=0x7fdbe8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fdbe8060860 0x7fdbe8062d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdc000093f0 tx=0x7fdc00017000 comp rx=0 tx=0).stop 2024-08-17T02:29:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc040b2e70 msgr2=0x7fdc0415bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 --2- 172.21.15.19:0/35509684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc040b2e70 0x7fdc0415bdc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c7c0 tx=0x7fdbf8007f70 comp rx=0 tx=0).stop 2024-08-17T02:29:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0a387700 1 -- 172.21.15.19:0/35509684 reap_dead start 2024-08-17T02:29:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 shutdown_connections 2024-08-17T02:29:53.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 >> 172.21.15.19:0/35509684 conn(0x7fdc04099410 msgr2=0x7fdc040690c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 shutdown_connections 2024-08-17T02:29:53.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.218+0000 7fdc0ab88700 1 -- 172.21.15.19:0/35509684 wait complete. 2024-08-17T02:29:53.236 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:29:53.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.346+0000 7f7fba73a700 1 Processor -- start 2024-08-17T02:29:53.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.346+0000 7f7fba73a700 1 -- start start 2024-08-17T02:29:53.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fba73a700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7fb4153a70 0x7f7fb4159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fba73a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb4157810 con 0x7f7fb406e9c0 2024-08-17T02:29:53.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fba73a700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb4157dd0 con 0x7f7fb4153e40 2024-08-17T02:29:53.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fba73a700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb415a700 con 0x7f7fb4153a70 2024-08-17T02:29:53.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb8cd7700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7fb406e9c0 0x7f7fb4158260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52410/0 (socket says 172.21.15.19:52410) 2024-08-17T02:29:53.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb8cd7700 1 -- 172.21.15.19:0/1186983396 learned_addr learned my addr 172.21.15.19:0/1186983396 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:53.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb3fff700 1 --2- 172.21.15.19:0/1186983396 >> v2:172.21.15.119:3300/0 conn(0x7f7fb4153a70 0x7f7fb4159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb2ffd700 1 -- 172.21.15.19:0/1186983396 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850428047 0 0) 0x7f7fb4157810 con 0x7f7fb406e9c0 2024-08-17T02:29:53.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb2ffd700 1 -- 172.21.15.19:0/1186983396 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f9c003570 con 0x7f7fb406e9c0 2024-08-17T02:29:53.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb3fff700 1 -- 172.21.15.19:0/1186983396 >> v1:172.21.15.119:6789/0 conn(0x7f7fb4153e40 legacy=0x7f7fb406e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb3fff700 1 -- 172.21.15.19:0/1186983396 >> v1:172.21.15.19:6789/0 conn(0x7f7fb406e9c0 legacy=0x7f7fb4158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb3fff700 1 -- 172.21.15.19:0/1186983396 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb415a9e0 con 0x7f7fb4153a70 2024-08-17T02:29:53.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb3fff700 1 --2- 172.21.15.19:0/1186983396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fb4153a70 0x7f7fb4159c40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80098e0 tx=0x7f7fa80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fe475e70060a252 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb2ffd700 1 -- 172.21.15.19:0/1186983396 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800f6b0 con 0x7f7fb4153a70 2024-08-17T02:29:53.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb2ffd700 1 -- 172.21.15.19:0/1186983396 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa800f810 con 0x7f7fb4153a70 2024-08-17T02:29:53.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fb2ffd700 1 -- 172.21.15.19:0/1186983396 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800fb90 con 0x7f7fb4153a70 2024-08-17T02:29:53.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fba73a700 1 -- 172.21.15.19:0/1186983396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fb4153a70 msgr2=0x7f7fb4159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.350+0000 7f7fba73a700 1 --2- 172.21.15.19:0/1186983396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fb4153a70 0x7f7fb4159c40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80098e0 tx=0x7f7fa80091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 -- 172.21.15.19:0/1186983396 shutdown_connections 2024-08-17T02:29:53.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 --2- 172.21.15.19:0/1186983396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fb4153a70 0x7f7fb4159c40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 -- 172.21.15.19:0/1186983396 >> 172.21.15.19:0/1186983396 conn(0x7f7fb4067810 msgr2=0x7f7fb4067c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 -- 172.21.15.19:0/1186983396 shutdown_connections 2024-08-17T02:29:53.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 -- 172.21.15.19:0/1186983396 wait complete. 2024-08-17T02:29:53.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 Processor -- start 2024-08-17T02:29:53.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 -- start start 2024-08-17T02:29:53.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fb406e9c0 0x7f7fb40b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fb4153a70 0x7f7fb4152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fb4153e40 0x7f7fb4152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4152bd0 con 0x7f7fb4153a70 2024-08-17T02:29:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4097480 con 0x7f7fb4153e40 2024-08-17T02:29:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fba73a700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4096b70 con 0x7f7fb406e9c0 2024-08-17T02:29:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fb37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fb4153a70 0x7f7fb4152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fb37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fb4153a70 0x7f7fb4152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38712/0 (socket says 172.21.15.19:38712) 2024-08-17T02:29:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fb37fe700 1 -- 172.21.15.19:0/1185122195 learned_addr learned my addr 172.21.15.19:0/1185122195 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fb3fff700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fb406e9c0 0x7f7fb40b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.354+0000 7f7fb8cd7700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fb4153e40 0x7f7fb4152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fb37fe700 1 -- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fb406e9c0 msgr2=0x7f7fb40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fb37fe700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fb406e9c0 0x7f7fb40b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fb37fe700 1 -- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fb4153e40 msgr2=0x7f7fb4152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fb37fe700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fb4153e40 0x7f7fb4152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fb37fe700 1 -- 172.21.15.19:0/1185122195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8009420 con 0x7f7fb4153a70 2024-08-17T02:29:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fb37fe700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fb4153a70 0x7f7fb4152150 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c910 tx=0x7f7fa4001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7f9bfff700 1 -- 172.21.15.19:0/1185122195 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4012630 con 0x7f7fb4153a70 2024-08-17T02:29:53.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7f9bfff700 1 -- 172.21.15.19:0/1185122195 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40127b0 con 0x7f7fb4153a70 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb4096e30 con 0x7f7fb4153a70 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7f9bfff700 1 -- 172.21.15.19:0/1185122195 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4012b70 con 0x7f7fb4153a70 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb4097910 con 0x7f7fb4153a70 2024-08-17T02:29:53.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4068560 con 0x7f7fb4153a70 2024-08-17T02:29:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7f9bfff700 1 -- 172.21.15.19:0/1185122195 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7fa4003030 con 0x7f7fb4153a70 2024-08-17T02:29:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7f9bfff700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7fa0060860 0x7f7fa0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7f9bfff700 1 -- 172.21.15.19:0/1185122195 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7fa407c810 con 0x7f7fb4153a70 2024-08-17T02:29:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.358+0000 7f7fb3fff700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7fa0060860 0x7f7fa0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.362+0000 7f7fb3fff700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7fa0060860 0x7f7fa0062d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800ffd0 tx=0x7f7fa8019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.370+0000 7f7f9bfff700 1 -- 172.21.15.19:0/1185122195 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7fb4068560 con 0x7f7fb4153a70 2024-08-17T02:29:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fb4068560 con 0x7f7fa0060860 2024-08-17T02:29:53.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7f9bfff700 1 -- 172.21.15.19:0/1185122195 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7fb4068560 con 0x7f7fa0060860 2024-08-17T02:29:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7fa0060860 msgr2=0x7f7fa0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7fa0060860 0x7f7fa0062d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800ffd0 tx=0x7f7fa8019000 comp rx=0 tx=0).stop 2024-08-17T02:29:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fb4153a70 msgr2=0x7f7fb4152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fb4153a70 0x7f7fb4152150 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c910 tx=0x7f7fa4001730 comp rx=0 tx=0).stop 2024-08-17T02:29:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 shutdown_connections 2024-08-17T02:29:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f7fa0060860 0x7f7fa0062d10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fb4153e40 0x7f7fb4152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fb4153a70 0x7f7fb4152150 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 --2- 172.21.15.19:0/1185122195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fb406e9c0 0x7f7fb40b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 >> 172.21.15.19:0/1185122195 conn(0x7f7fb4067810 msgr2=0x7f7fb4155530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 shutdown_connections 2024-08-17T02:29:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.542+0000 7f7fba73a700 1 -- 172.21.15.19:0/1185122195 wait complete. 2024-08-17T02:29:53.551 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:29:53.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:53.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2302f45700 1 Processor -- start 2024-08-17T02:29:53.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2302f45700 1 -- start start 2024-08-17T02:29:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2302f45700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc15d540 0x7f22fc0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2302f45700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22fc06e830 0x7f22fc0a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2302f45700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc0b0270 con 0x7f22fc0a9260 2024-08-17T02:29:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2302f45700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc0af660 con 0x7f22fc06e830 2024-08-17T02:29:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2302f45700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0af940 con 0x7f22fc15d540 2024-08-17T02:29:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f23014e2700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22fc0a9260 0x7f22fc0b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52414/0 (socket says 172.21.15.19:52414) 2024-08-17T02:29:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f23014e2700 1 -- 172.21.15.19:0/3452074639 learned_addr learned my addr 172.21.15.19:0/3452074639 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:29:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f22fbfff700 1 --2- 172.21.15.19:0/3452074639 >> v2:172.21.15.119:3300/0 conn(0x7f22fc06e830 0x7f22fc0a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2300ce1700 1 --2- 172.21.15.19:0/3452074639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc15d540 0x7f22fc0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2300ce1700 1 -- 172.21.15.19:0/3452074639 >> v2:172.21.15.119:3300/0 conn(0x7f22fc06e830 msgr2=0x7f22fc0a8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2300ce1700 1 --2- 172.21.15.19:0/3452074639 >> v2:172.21.15.119:3300/0 conn(0x7f22fc06e830 0x7f22fc0a8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2300ce1700 1 -- 172.21.15.19:0/3452074639 >> v1:172.21.15.19:6789/0 conn(0x7f22fc0a9260 legacy=0x7f22fc0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f22fb7fe700 1 -- 172.21.15.19:0/3452074639 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335923547 0 0) 0x7f22fc0b0270 con 0x7f22fc0a9260 2024-08-17T02:29:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2300ce1700 1 -- 172.21.15.19:0/3452074639 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0afc20 con 0x7f22fc15d540 2024-08-17T02:29:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f22fbfff700 1 --2- 172.21.15.19:0/3452074639 >> v2:172.21.15.119:3300/0 conn(0x7f22fc06e830 0x7f22fc0a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f2300ce1700 1 --2- 172.21.15.19:0/3452074639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc15d540 0x7f22fc0af030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22e40098e0 tx=0x7f22e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c54ecdf5dc2f8457 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f22fb7fe700 1 -- 172.21.15.19:0/3452074639 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e400b640 con 0x7f22fc15d540 2024-08-17T02:29:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f22fb7fe700 1 -- 172.21.15.19:0/3452074639 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e400b7a0 con 0x7f22fc15d540 2024-08-17T02:29:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.662+0000 7f22fb7fe700 1 -- 172.21.15.19:0/3452074639 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e400bb40 con 0x7f22fc15d540 2024-08-17T02:29:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 -- 172.21.15.19:0/3452074639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc15d540 msgr2=0x7f22fc0af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 --2- 172.21.15.19:0/3452074639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc15d540 0x7f22fc0af030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22e40098e0 tx=0x7f22e40091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 -- 172.21.15.19:0/3452074639 shutdown_connections 2024-08-17T02:29:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 --2- 172.21.15.19:0/3452074639 >> v2:172.21.15.119:3300/0 conn(0x7f22fc06e830 0x7f22fc0a8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 --2- 172.21.15.19:0/3452074639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc15d540 0x7f22fc0af030 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 -- 172.21.15.19:0/3452074639 >> 172.21.15.19:0/3452074639 conn(0x7f22fc066e00 msgr2=0x7f22fc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 -- 172.21.15.19:0/3452074639 shutdown_connections 2024-08-17T02:29:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 -- 172.21.15.19:0/3452074639 wait complete. 2024-08-17T02:29:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 Processor -- start 2024-08-17T02:29:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 -- start start 2024-08-17T02:29:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc06e830 0x7f22fc0c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22fc0a9260 0x7f22fc06db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22fc15d540 0x7f22fc14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc098b90 con 0x7f22fc15d540 2024-08-17T02:29:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc098700 con 0x7f22fc0a9260 2024-08-17T02:29:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.666+0000 7f2302f45700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc097af0 con 0x7f22fc06e830 2024-08-17T02:29:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f23014e2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22fc15d540 0x7f22fc14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f2300ce1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc06e830 0x7f22fc0c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f22fbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22fc0a9260 0x7f22fc06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f2300ce1700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc06e830 0x7f22fc0c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.19:42872/0 (socket says 172.21.15.19:42872) 2024-08-17T02:29:53.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f2300ce1700 1 -- 172.21.15.19:0/1617512307 learned_addr learned my addr 172.21.15.19:0/1617512307 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:29:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f23014e2700 1 -- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc06e830 msgr2=0x7f22fc0c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f23014e2700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc06e830 0x7f22fc0c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f23014e2700 1 -- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22fc0a9260 msgr2=0x7f22fc06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f23014e2700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22fc0a9260 0x7f22fc06db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f23014e2700 1 -- 172.21.15.19:0/1617512307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4009a20 con 0x7f22fc15d540 2024-08-17T02:29:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f2300ce1700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc06e830 0x7f22fc0c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f23014e2700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22fc15d540 0x7f22fc14dd30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c560 tx=0x7f22ec007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f22f8ff9700 1 -- 172.21.15.19:0/1617512307 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec005b30 con 0x7f22fc15d540 2024-08-17T02:29:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f22f8ff9700 1 -- 172.21.15.19:0/1617512307 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec005c90 con 0x7f22fc15d540 2024-08-17T02:29:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e4009420 con 0x7f22fc15d540 2024-08-17T02:29:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f22f8ff9700 1 -- 172.21.15.19:0/1617512307 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec007300 con 0x7f22fc15d540 2024-08-17T02:29:53.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc0980b0 con 0x7f22fc15d540 2024-08-17T02:29:53.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.670+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc098890 con 0x7f22fc15d540 2024-08-17T02:29:53.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.674+0000 7f22f8ff9700 1 -- 172.21.15.19:0/1617512307 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f22ec0076b0 con 0x7f22fc15d540 2024-08-17T02:29:53.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.674+0000 7f22f8ff9700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22dc060890 0x7f22dc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.674+0000 7f22f8ff9700 1 -- 172.21.15.19:0/1617512307 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f22ec07bd30 con 0x7f22fc15d540 2024-08-17T02:29:53.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.674+0000 7f2300ce1700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22dc060890 0x7f22dc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.674+0000 7f2300ce1700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22dc060890 0x7f22dc062d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c010 tx=0x7f22e4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.686+0000 7f22f8ff9700 1 -- 172.21.15.19:0/1617512307 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f22ec04c380 con 0x7f22fc15d540 2024-08-17T02:29:53.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.846+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22fc0645c0 con 0x7f22dc060890 2024-08-17T02:29:53.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.854+0000 7f22f8ff9700 1 -- 172.21.15.19:0/1617512307 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48591 (secure 0 0 0) 0x7f22fc0645c0 con 0x7f22dc060890 2024-08-17T02:29:53.859 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:29:53.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22dc060890 msgr2=0x7f22dc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22dc060890 0x7f22dc062d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c010 tx=0x7f22e4017000 comp rx=0 tx=0).stop 2024-08-17T02:29:53.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22fc15d540 msgr2=0x7f22fc14dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22fc15d540 0x7f22fc14dd30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c560 tx=0x7f22ec007c90 comp rx=0 tx=0).stop 2024-08-17T02:29:53.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 shutdown_connections 2024-08-17T02:29:53.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f22dc060890 0x7f22dc062d40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22fc15d540 0x7f22fc14dd30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22fc0a9260 0x7f22fc06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 --2- 172.21.15.19:0/1617512307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22fc06e830 0x7f22fc0c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 >> 172.21.15.19:0/1617512307 conn(0x7f22fc066e00 msgr2=0x7f22fc0b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 shutdown_connections 2024-08-17T02:29:53.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:29:53.858+0000 7f2302f45700 1 -- 172.21.15.19:0/1617512307 wait complete. 2024-08-17T02:29:53.864 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:29:53.878 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-08-17T02:29:52.842048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388208,"kb_used_data":5192,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586512,"statfs":{"total":773094113280,"available":770648588288,"internally_reserved":0,"allocated":5316608,"data_stored":2898848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.431735"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:29:44.808400+0000","last_change":"2024-08-17T02:26:18.661175+0000","last_active":"2024-08-17T02:29:44.808400+0000","last_peered":"2024-08-17T02:29:44.808400+0000","last_clean":"2024-08-17T02:29:44.808400+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:29:44.808400+0000","last_undegraded":"2024-08-17T02:29:44.808400+0000","last_fullsized":"2024-08-17T02:29:44.808400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:17.530681+0000","last_clean_scrub_stamp":"2024-08-17T02:26:17.530681+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:11.624722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68999999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":1.107,"15min":1.107},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76400000000000001,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0649999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.81000000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.073,"5min":1.121,"15min":1.121},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92600000000000005},"min":{"1min":0.64400000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3089999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.327,"5min":1.425,"15min":1.425},"last":0.498},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.60599999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0109999999999999,"15min":1.0309999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.121},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.069,"15min":1.0940000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.179,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.069}]},{"osd":5,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1259999999999999,"15min":1.155},"min":{"1min":0.85499999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.1930000000000001,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1930000000000001,"15min":1.2190000000000001},"min":{"1min":0.85299999999999998,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.3819999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.83899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.369,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2210000000000001,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.0009999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.244,"15min":1.262},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.4370000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.25,"15min":1.2729999999999999},"min":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.4410000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":1.2070000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.54800000000000004,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.032,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.51500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0569999999999999,"5min":4.0860000000000003,"15min":4.0860000000000003},"last":0.69099999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.74099999999999999},"min":{"1min":0.61899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1519999999999999,"5min":1.704,"15min":1.704},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.60599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1040000000000001,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.91000000000000003,"15min":0.89000000000000001},"min":{"1min":0.85499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.286,"5min":1.486,"15min":1.486},"last":0.71899999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.034,"15min":1.006},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3720000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.097},"min":{"1min":0.81200000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3009999999999999,"5min":3.484,"15min":3.484},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1499999999999999,"15min":1.1220000000000001},"min":{"1min":0.96899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4950000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.097}]},{"osd":6,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1519999999999999,"15min":1.151},"min":{"1min":0.86299999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.486,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.137,"5min":1.181,"15min":1.2070000000000001},"min":{"1min":0.88900000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4390000000000001,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":0.96199999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2290000000000001,"15min":1.2210000000000001},"min":{"1min":1.03,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5740000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.081},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.24,"15min":1.264},"min":{"1min":0.89500000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.3779999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.91200000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95099999999999996,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.54300000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.80200000000000005},"min":{"1min":0.67100000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.153,"15min":1.153},"last":0.51700000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.83699999999999997,"15min":0.82299999999999995},"min":{"1min":0.69599999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.149,"5min":1.381,"15min":1.381},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.87,"5min":0.80500000000000005,"15min":0.77500000000000002},"min":{"1min":0.624,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1950000000000001,"5min":1.468,"15min":1.468},"last":0.78500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.97799999999999998,"15min":0.95199999999999996},"min":{"1min":0.79500000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.98999999999999999,"15min":0.97199999999999998},"min":{"1min":0.79800000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.0940000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":0.995,"15min":0.98599999999999999},"min":{"1min":0.77800000000000002,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.169},{"interface":"front","average":{"1min":1.145,"5min":1.137,"15min":1.121},"min":{"1min":0.80100000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.24}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0700000000000001,"15min":1.04},"min":{"1min":0.85899999999999999,"5min":0.62,"15min":0.62},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.333},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.089,"15min":1.071},"min":{"1min":0.84599999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.4399999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.218}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1839999999999999,"15min":1.169},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5780000000000001,"5min":1.825,"15min":1.825},"last":1.367},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.177,"15min":1.1599999999999999},"min":{"1min":0.97599999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4830000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.125}]}]},{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1110016,"data_stored":805132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98899999999999999,"15min":1.036},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3380000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.121},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.4890000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.998,"15min":1.048},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.3660000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.27,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.1830000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.88200000000000001,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.083,"5min":1.452,"15min":1.452},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.022,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.117,"5min":2.056,"15min":2.056},"last":1.669}]},{"osd":3,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.226,"5min":1.409,"15min":1.409},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1739999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.2509999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.008,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.238,"5min":1.431,"15min":1.431},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0329999999999999,"15min":1.0529999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2170000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.423}]},{"osd":5,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.129,"15min":1.1879999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2889999999999999,"5min":2,"15min":2},"last":2.032},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1519999999999999,"15min":1.1759999999999999},"min":{"1min":0.79500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.282,"5min":1.53,"15min":1.53},"last":1.7330000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0820000000000001,"15min":1.1080000000000001},"min":{"1min":0.79900000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.27,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.319,"15min":1.391},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5109999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.339}]}]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.3069999999999999,"5min":1.335,"15min":1.335},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1200000000000001,"5min":1.216,"15min":1.216},"last":0.83999999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.69399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.3340000000000001,"5min":1.359,"15min":1.359},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.90200000000000002,"15min":0.91800000000000004},"min":{"1min":0.65800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.224,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0029999999999999,"15min":1.014},"min":{"1min":0.66700000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.107,"15min":1.1060000000000001},"min":{"1min":0.81699999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.248,"5min":1.373,"15min":1.373},"last":1.133}]},{"osd":3,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91300000000000003,"15min":0.90700000000000003},"min":{"1min":0.66600000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.165,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.79200000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.995}]},{"osd":4,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.0029999999999999,"15min":1.0429999999999999},"min":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1819999999999999,"5min":1.548,"15min":1.548},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.351,"5min":1.681,"15min":1.681},"last":1.0269999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.78100000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2010000000000001,"5min":1.341,"15min":1.341},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.135},"min":{"1min":0.80600000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.3260000000000001,"5min":1.397,"15min":1.397},"last":1.3109999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.143,"15min":1.133},"min":{"1min":0.90700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3819999999999999,"5min":1.744,"15min":1.744},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1299999999999999,"15min":1.129},"min":{"1min":0.91400000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.47,"5min":1.52,"15min":1.52},"last":1.1619999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.85999999999999999},"min":{"1min":0.67500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.1579999999999999,"5min":1.2,"15min":1.2},"last":1.403},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":1.6160000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90000000000000002,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2529999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.798},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.139,"15min":1.2370000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1579999999999999,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.80900000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.94999999999999996,"15min":0.93799999999999994},"min":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95699999999999996},"min":{"1min":0.71499999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.2849999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.02,"15min":1.028},"min":{"1min":0.78200000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.228,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.579},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.82399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.327,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.879}]},{"osd":4,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.753,"5min":0.63,"15min":0.63},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":1.54},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1060000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.387,"15min":1.387},"last":1.681}]},{"osd":6,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4019999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.9850000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.755,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3140000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.357}]},{"osd":7,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.204,"15min":1.218},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.367,"5min":1.738,"15min":1.738},"last":1.772},{"interface":"front","average":{"1min":1.161,"5min":1.181,"15min":1.1919999999999999},"min":{"1min":0.64000000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.458,"5min":1.536,"15min":1.536},"last":1.9370000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.66100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.169,"5min":1.194,"15min":1.194},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91800000000000004,"15min":0.92400000000000004},"min":{"1min":0.69699999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1910000000000001,"5min":1.381,"15min":1.381},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.98399999999999999,"15min":0.97399999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3120000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.998,"15min":1.04},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.085,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.86299999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.98199999999999998,"15min":1.0049999999999999},"min":{"1min":0.70999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2829999999999999,"5min":1.96,"15min":1.96},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0549999999999999},"min":{"1min":0.71099999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3360000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.90300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.216,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.105},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0009999999999999,"15min":1.032},"min":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2270000000000001,"5min":1.601,"15min":1.601},"last":0.63}]},{"osd":5,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.95799999999999996,"15min":0.96999999999999997},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.228,"5min":1.288,"15min":1.288},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0289999999999999},"min":{"1min":0.67100000000000004,"5min":0.628,"15min":0.628},"max":{"1min":1.385,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.0029999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.751,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2569999999999999,"5min":1.518,"15min":1.518},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.103,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.292,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":1.028}]},{"osd":7,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.1439999999999999,"15min":1.1870000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.2949999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.226,"15min":1.2509999999999999},"min":{"1min":0.76000000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.409,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.135}]}]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1110016,"data_stored":805132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.52400000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.58099999999999996,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0389999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97199999999999998,"5min":1.018,"15min":1.018},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.59699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1779999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.78900000000000003},"min":{"1min":0.61199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1559999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.88,"15min":0.84199999999999997},"min":{"1min":0.83999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.1879999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.85599999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.018,"15min":0.98799999999999999},"min":{"1min":0.80700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4059999999999999,"5min":1.901,"15min":1.901},"last":1.02},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.109,"15min":1.109},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.587,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.98799999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1040000000000001,"15min":1.0840000000000001},"min":{"1min":0.85799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.472,"5min":1.984,"15min":1.984},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.173,"5min":1.1439999999999999,"15min":1.1180000000000001},"min":{"1min":0.90700000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.454,"5min":2.012,"15min":2.012},"last":1.099}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.117,"15min":1.109},"min":{"1min":0.80400000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.347,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.05},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.179,"15min":1.151},"min":{"1min":1.0049999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5409999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.196}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2090000000000001,"15min":1.1779999999999999},"min":{"1min":0.93999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.544,"5min":2.081,"15min":2.081},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2,"15min":1.177},"min":{"1min":0.95799999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.4359999999999999,"5min":1.667,"15min":1.667},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:53.882 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:26:17.530681+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=26, tm_sec=17, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=29, tm_sec=48, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:29:53.882 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:29:56.816 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:56.818 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:13.884 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:14.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.994+0000 7f94bbfff700 1 Processor -- start 2024-08-17T02:30:14.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.994+0000 7f94bbfff700 1 -- start start 2024-08-17T02:30:14.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94bc159040 0x7f94bc0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94bc0cf190 con 0x7f94bc0d0010 2024-08-17T02:30:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94bc0d09a0 con 0x7f94bc159040 2024-08-17T02:30:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0ce5e0 con 0x7f94bc15d5b0 2024-08-17T02:30:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94baffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f94bc159040 0x7f94bc0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94ba7fc700 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f94bc0d0010 0x7f94bc15cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.19:51606/0 (socket says 172.21.15.19:51606) 2024-08-17T02:30:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94ba7fc700 1 -- 172.21.15.19:0/1852888527 learned_addr learned my addr 172.21.15.19:0/1852888527 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:30:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bb7fe700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94b9ffb700 1 -- 172.21.15.19:0/1852888527 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504536726 0 0) 0x7f94bc0cf190 con 0x7f94bc0d0010 2024-08-17T02:30:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94baffd700 1 -- 172.21.15.19:0/1852888527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 msgr2=0x7f94bc0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94baffd700 1 --2- 172.21.15.19:0/1852888527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94baffd700 1 -- 172.21.15.19:0/1852888527 >> v1:172.21.15.119:6789/0 conn(0x7f94bc0d0010 legacy=0x7f94bc15cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94baffd700 1 -- 172.21.15.19:0/1852888527 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc0ce860 con 0x7f94bc159040 2024-08-17T02:30:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bb7fe700 1 --2- 172.21.15.19:0/1852888527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94baffd700 1 --2- 172.21.15.19:0/1852888527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc159040 0x7f94bc0cf620 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0098e0 tx=0x7f94ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f02aef876550e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94b9ffb700 1 -- 172.21.15.19:0/1852888527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00b640 con 0x7f94bc159040 2024-08-17T02:30:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94b9ffb700 1 -- 172.21.15.19:0/1852888527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac00b7a0 con 0x7f94bc159040 2024-08-17T02:30:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94b9ffb700 1 -- 172.21.15.19:0/1852888527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00bb40 con 0x7f94bc159040 2024-08-17T02:30:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 -- 172.21.15.19:0/1852888527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc159040 msgr2=0x7f94bc0cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 --2- 172.21.15.19:0/1852888527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc159040 0x7f94bc0cf620 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0098e0 tx=0x7f94ac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 -- 172.21.15.19:0/1852888527 shutdown_connections 2024-08-17T02:30:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 --2- 172.21.15.19:0/1852888527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 --2- 172.21.15.19:0/1852888527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc159040 0x7f94bc0cf620 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 -- 172.21.15.19:0/1852888527 >> 172.21.15.19:0/1852888527 conn(0x7f94bc068250 msgr2=0x7f94bc068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:14.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 -- 172.21.15.19:0/1852888527 shutdown_connections 2024-08-17T02:30:14.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:13.998+0000 7f94bbfff700 1 -- 172.21.15.19:0/1852888527 wait complete. 2024-08-17T02:30:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 Processor -- start 2024-08-17T02:30:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 -- start start 2024-08-17T02:30:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc0d0010 0x7f94bc14c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94bc159040 0x7f94bc14c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc14cb80 con 0x7f94bc0d0010 2024-08-17T02:30:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc14ce60 con 0x7f94bc159040 2024-08-17T02:30:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc14d140 con 0x7f94bc15d5b0 2024-08-17T02:30:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94baffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc0d0010 0x7f94bc14c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94baffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc0d0010 0x7f94bc14c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47806/0 (socket says 172.21.15.19:47806) 2024-08-17T02:30:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94baffd700 1 -- 172.21.15.19:0/1984500125 learned_addr learned my addr 172.21.15.19:0/1984500125 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:30:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bb7fe700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94ba7fc700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94bc159040 0x7f94bc14c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94baffd700 1 -- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 msgr2=0x7f94bc153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94baffd700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94baffd700 1 -- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94bc159040 msgr2=0x7f94bc14c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94baffd700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94bc159040 0x7f94bc14c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94baffd700 1 -- 172.21.15.19:0/1984500125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4009420 con 0x7f94bc0d0010 2024-08-17T02:30:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94ba7fc700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94bc159040 0x7f94bc14c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bb7fe700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94baffd700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc0d0010 0x7f94bc14c000 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009f80 tx=0x7f94ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94b2ffd700 1 -- 172.21.15.19:0/1984500125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac00bb20 con 0x7f94bc0d0010 2024-08-17T02:30:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94b2ffd700 1 -- 172.21.15.19:0/1984500125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac011420 con 0x7f94bc0d0010 2024-08-17T02:30:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac009420 con 0x7f94bc0d0010 2024-08-17T02:30:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94b2ffd700 1 -- 172.21.15.19:0/1984500125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac011800 con 0x7f94bc0d0010 2024-08-17T02:30:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.002+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94bc14d700 con 0x7f94bc0d0010 2024-08-17T02:30:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.006+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94bc0643a0 con 0x7f94bc0d0010 2024-08-17T02:30:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.006+0000 7f94b2ffd700 1 -- 172.21.15.19:0/1984500125 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f94ac011c30 con 0x7f94bc0d0010 2024-08-17T02:30:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.006+0000 7f94b2ffd700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f949c060860 0x7f949c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.006+0000 7f94b2ffd700 1 -- 172.21.15.19:0/1984500125 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f94ac07e3f0 con 0x7f94bc0d0010 2024-08-17T02:30:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.006+0000 7f94ba7fc700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f949c060860 0x7f949c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.010+0000 7f94ba7fc700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f949c060860 0x7f949c062d10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f94bc14db90 tx=0x7f94a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:14.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.018+0000 7f94b2ffd700 1 -- 172.21.15.19:0/1984500125 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f94ac04eae0 con 0x7f94bc0d0010 2024-08-17T02:30:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.178+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 --> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94bc0af310 con 0x7f949c060860 2024-08-17T02:30:14.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.182+0000 7f94b2ffd700 1 -- 172.21.15.19:0/1984500125 <== mgr.4102 v2:172.21.15.119:6832/24148 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48689 (secure 0 0 0) 0x7f94bc0af310 con 0x7f949c060860 2024-08-17T02:30:14.189 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:30:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f949c060860 msgr2=0x7f949c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f949c060860 0x7f949c062d10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f94bc14db90 tx=0x7f94a4009040 comp rx=0 tx=0).stop 2024-08-17T02:30:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc0d0010 msgr2=0x7f94bc14c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc0d0010 0x7f94bc14c000 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009f80 tx=0x7f94ac017000 comp rx=0 tx=0).stop 2024-08-17T02:30:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 shutdown_connections 2024-08-17T02:30:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7f949c060860 0x7f949c062d10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94bc15d5b0 0x7f94bc153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94bc159040 0x7f94bc14c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 --2- 172.21.15.19:0/1984500125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94bc0d0010 0x7f94bc14c000 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 >> 172.21.15.19:0/1984500125 conn(0x7f94bc068250 msgr2=0x7f94bc0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 shutdown_connections 2024-08-17T02:30:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.186+0000 7f94bbfff700 1 -- 172.21.15.19:0/1984500125 wait complete. 2024-08-17T02:30:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-08-17T02:30:14.204 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-08-17T02:30:12.847417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388200,"kb_used_data":5192,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586520,"statfs":{"total":773094113280,"available":770648596480,"internally_reserved":0,"allocated":5316608,"data_stored":2898848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003211"},"pg_stats":[{"pgid":"1.0","version":"44'119","reported_seq":194,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:29:54.503592+0000","last_change":"2024-08-17T02:29:54.503509+0000","last_active":"2024-08-17T02:29:54.503592+0000","last_peered":"2024-08-17T02:29:54.503592+0000","last_clean":"2024-08-17T02:29:54.503592+0000","last_became_active":"2024-08-17T02:26:18.658695+0000","last_became_peered":"2024-08-17T02:26:18.658695+0000","last_unstale":"2024-08-17T02:29:54.503592+0000","last_undegraded":"2024-08-17T02:29:54.503592+0000","last_fullsized":"2024-08-17T02:29:54.503592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2024-08-17T02:29:54.503289+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2024-08-17T02:29:54.503289+0000","last_clean_scrub_stamp":"2024-08-17T02:29:54.503289+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:45.666664+0000","scrub_duration":0.010715369000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67300000000000004,"15min":0.68999999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":1.107,"15min":1.107},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.76400000000000001,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0649999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.81299999999999994}]},{"osd":1,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.073,"5min":1.121,"15min":1.121},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.93200000000000005,"15min":0.92600000000000005},"min":{"1min":0.64400000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3089999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.93500000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.327,"5min":1.425,"15min":1.425},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.60599999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.67600000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.0109999999999999,"15min":1.0309999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.069,"15min":1.0940000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.179,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.73299999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1259999999999999,"15min":1.155},"min":{"1min":0.85499999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.1930000000000001,"5min":2.8889999999999998,"15min":2.8889999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1930000000000001,"15min":1.2190000000000001},"min":{"1min":0.85299999999999998,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.3819999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":1.0389999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.155,"15min":1.181},"min":{"1min":0.83899999999999997,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.369,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.26},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2210000000000001,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.4370000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:29:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.244,"15min":1.262},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.4370000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.107},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.25,"15min":1.2729999999999999},"min":{"1min":0.97999999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.4410000000000001,"5min":2.4550000000000001,"15min":2.4550000000000001},"last":1.325}]}]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.54800000000000004,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.032,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.51500000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0569999999999999,"5min":4.0860000000000003,"15min":4.0860000000000003},"last":0.95899999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.77700000000000002,"15min":0.74099999999999999},"min":{"1min":0.61899999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1519999999999999,"5min":1.704,"15min":1.704},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.79800000000000004,"15min":0.77400000000000002},"min":{"1min":0.60599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1040000000000001,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.997,"5min":0.91000000000000003,"15min":0.89000000000000001},"min":{"1min":0.85499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.286,"5min":1.486,"15min":1.486},"last":0.93999999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.034,"15min":1.006},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3720000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.82799999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.0740000000000001,"15min":1.097},"min":{"1min":0.81200000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.3009999999999999,"5min":3.484,"15min":3.484},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1499999999999999,"15min":1.1220000000000001},"min":{"1min":0.96899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4950000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.88800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1519999999999999,"15min":1.151},"min":{"1min":0.86299999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.486,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.181,"15min":1.2070000000000001},"min":{"1min":0.88900000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4390000000000001,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":1.341}]},{"osd":7,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2290000000000001,"15min":1.2210000000000001},"min":{"1min":1.03,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5740000000000001,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.079},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.24,"15min":1.264},"min":{"1min":0.89500000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.3779999999999999,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":1.4099999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95099999999999996,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.498},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.63}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.54300000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.746},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.80200000000000005},"min":{"1min":0.67100000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0660000000000001,"5min":1.153,"15min":1.153},"last":0.69899999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.83699999999999997,"15min":0.82299999999999995},"min":{"1min":0.69599999999999995,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.149,"5min":1.381,"15min":1.381},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.80500000000000005,"15min":0.77500000000000002},"min":{"1min":0.624,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1950000000000001,"5min":1.468,"15min":1.468},"last":0.79600000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.97799999999999998,"15min":0.95199999999999996},"min":{"1min":0.79500000000000004,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.099},{"interface":"front","average":{"1min":1.0600000000000001,"5min":0.98999999999999999,"15min":0.97199999999999998},"min":{"1min":0.79800000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.91300000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":0.995,"15min":0.98599999999999999},"min":{"1min":0.77800000000000002,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.05},{"interface":"front","average":{"1min":1.145,"5min":1.137,"15min":1.121},"min":{"1min":0.80100000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.0009999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0700000000000001,"15min":1.04},"min":{"1min":0.85899999999999999,"5min":0.62,"15min":0.62},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.089,"15min":1.071},"min":{"1min":0.84599999999999997,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.4399999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.5009999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1839999999999999,"15min":1.169},"min":{"1min":0.93500000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.5780000000000001,"5min":1.825,"15min":1.825},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.177,"15min":1.1599999999999999},"min":{"1min":0.97599999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.4830000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1890000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542193,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298436,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073404,"statfs":{"total":96636764160,"available":96331165696,"internally_reserved":0,"allocated":1110016,"data_stored":805132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.98899999999999999,"15min":1.036},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.3380000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.1020000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.998,"15min":1.048},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.3660000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.94099999999999995},"min":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.27,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.333}]},{"osd":2,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.88200000000000001,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.083,"5min":1.452,"15min":1.452},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":1.022,"15min":1.0529999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.117,"5min":2.056,"15min":2.056},"last":0.70699999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.996,"15min":1.0029999999999999},"min":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.226,"5min":1.409,"15min":1.409},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.1739999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.76200000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.008,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.238,"5min":1.431,"15min":1.431},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0329999999999999,"15min":1.0529999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.2170000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0589999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.129,"15min":1.1879999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2889999999999999,"5min":2,"15min":2},"last":1.083},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1519999999999999,"15min":1.1759999999999999},"min":{"1min":0.79500000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.282,"5min":1.53,"15min":1.53},"last":1.399}]},{"osd":6,"last update":"Sat Aug 17 02:29:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0820000000000001,"15min":1.1080000000000001},"min":{"1min":0.79900000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.27,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.319,"15min":1.391},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5109999999999999,"5min":3.1459999999999999,"15min":3.1459999999999999},"last":1.1499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88100000000000001,"15min":0.85899999999999999},"min":{"1min":0.55900000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.3069999999999999,"5min":1.335,"15min":1.335},"last":1.069},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1200000000000001,"5min":1.216,"15min":1.216},"last":0.94299999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93600000000000005,"15min":0.93000000000000005},"min":{"1min":0.69399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.3340000000000001,"5min":1.359,"15min":1.359},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.90200000000000002,"15min":0.91800000000000004},"min":{"1min":0.65800000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.224,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.89900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0029999999999999,"15min":1.014},"min":{"1min":0.66700000000000004,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.258,"5min":1.321,"15min":1.321},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.107,"15min":1.1060000000000001},"min":{"1min":0.81699999999999995,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.248,"5min":1.373,"15min":1.373},"last":1.008}]},{"osd":3,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91300000000000003,"15min":0.90700000000000003},"min":{"1min":0.66600000000000004,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.165,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.79200000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.0029999999999999,"15min":1.0429999999999999},"min":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1819999999999999,"5min":1.548,"15min":1.548},"last":0.745},{"interface":"front","average":{"1min":1.018,"5min":1.1160000000000001,"15min":1.1339999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.351,"5min":1.681,"15min":1.681},"last":1.1060000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98899999999999999,"15min":0.998},"min":{"1min":0.78100000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2010000000000001,"5min":1.341,"15min":1.341},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.129,"15min":1.135},"min":{"1min":0.80600000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.3260000000000001,"5min":1.397,"15min":1.397},"last":0.84499999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:29:22 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.143,"15min":1.133},"min":{"1min":0.90700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3819999999999999,"5min":1.744,"15min":1.744},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1299999999999999,"15min":1.129},"min":{"1min":0.91400000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.47,"5min":1.52,"15min":1.52},"last":1.1519999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.878,"15min":0.85999999999999999},"min":{"1min":0.67500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.1579999999999999,"5min":1.2,"15min":1.2},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":1.0389999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90000000000000002,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2529999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.151},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.139,"15min":1.2370000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1579999999999999,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":1.0069999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.94999999999999996,"15min":0.93799999999999994},"min":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95499999999999996,"15min":0.95699999999999996},"min":{"1min":0.71499999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.78900000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:29:23 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.02,"15min":1.028},"min":{"1min":0.78200000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.228,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.038,"15min":1.0469999999999999},"min":{"1min":0.82399999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.327,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.2110000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.93400000000000005,"15min":0.94399999999999995},"min":{"1min":0.753,"5min":0.63,"15min":0.63},"max":{"1min":1.1970000000000001,"5min":1.27,"15min":1.27},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1060000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.377,"5min":1.387,"15min":1.387},"last":0.96899999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4019999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.107,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.755,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.3140000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1839999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.204,"15min":1.218},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.367,"5min":1.738,"15min":1.738},"last":1.091},{"interface":"front","average":{"1min":1.161,"5min":1.181,"15min":1.1919999999999999},"min":{"1min":0.64000000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.458,"5min":1.536,"15min":1.536},"last":1.262}]}]},{"osd":4,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":516096,"data_stored":214764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.66100000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.169,"5min":1.194,"15min":1.194},"last":1.046},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91800000000000004,"15min":0.92400000000000004},"min":{"1min":0.69699999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1910000000000001,"5min":1.381,"15min":1.381},"last":1.0129999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.98399999999999999,"15min":0.97399999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.3120000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.325},{"interface":"front","average":{"1min":0.88,"5min":0.998,"15min":1.04},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.085,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.95299999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.98199999999999998,"15min":1.0049999999999999},"min":{"1min":0.70999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2829999999999999,"5min":1.96,"15min":1.96},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.054,"15min":1.0549999999999999},"min":{"1min":0.71099999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3360000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.28}]},{"osd":3,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97699999999999998,"15min":0.97199999999999998},"min":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.216,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0009999999999999,"15min":1.032},"min":{"1min":0.73099999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2270000000000001,"5min":1.601,"15min":1.601},"last":0.89400000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.95799999999999996,"15min":0.96999999999999997},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.228,"5min":1.288,"15min":1.288},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.997,"15min":1.0289999999999999},"min":{"1min":0.67100000000000004,"5min":0.628,"15min":0.628},"max":{"1min":1.385,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.752}]},{"osd":6,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0740000000000001,"15min":1.0960000000000001},"min":{"1min":0.751,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2569999999999999,"5min":1.518,"15min":1.518},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.103,"15min":1.1180000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.292,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.80900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:29:19 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.1439999999999999,"15min":1.1870000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.2949999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.226,"15min":1.2509999999999999},"min":{"1min":0.76000000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.409,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.23}]}]},{"osd":0,"up_from":14,"seq":60129542193,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1110016,"data_stored":805132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66100000000000003,"15min":0.63700000000000001},"min":{"1min":0.52400000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.58099999999999996,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0389999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81699999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97199999999999998,"5min":1.018,"15min":1.018},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.59699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.1779999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.74399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.78900000000000003},"min":{"1min":0.61199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1559999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.88,"15min":0.84199999999999997},"min":{"1min":0.83999999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.1879999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.0029999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.018,"15min":0.98799999999999999},"min":{"1min":0.80700000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.4059999999999999,"5min":1.901,"15min":1.901},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.109,"15min":1.109},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.587,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.4099999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1040000000000001,"15min":1.0840000000000001},"min":{"1min":0.85799999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.472,"5min":1.984,"15min":1.984},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.1439999999999999,"15min":1.1180000000000001},"min":{"1min":0.90700000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.454,"5min":2.012,"15min":2.012},"last":1.504}]},{"osd":6,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.117,"15min":1.109},"min":{"1min":0.80400000000000005,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.347,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.216},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.179,"15min":1.151},"min":{"1min":1.0049999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5409999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.2669999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2090000000000001,"15min":1.1779999999999999},"min":{"1min":0.93999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.544,"5min":2.081,"15min":2.081},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2,"15min":1.177},"min":{"1min":0.95799999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.4359999999999999,"5min":1.667,"15min":1.667},"last":1.3340000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:14.206 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:30:14.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.310+0000 7faaf901b700 1 Processor -- start 2024-08-17T02:30:14.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.310+0000 7faaf901b700 1 -- start start 2024-08-17T02:30:14.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf901b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faaf413f680 0x7faaf40aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf901b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413fa50 0x7faaf40ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf901b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf40afc70 con 0x7faaf40b0100 2024-08-17T02:30:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf901b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf40adc00 con 0x7faaf413f680 2024-08-17T02:30:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf901b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40af060 con 0x7faaf413fa50 2024-08-17T02:30:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf3fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faaf413f680 0x7faaf40aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf881a700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7faaf40b0100 0x7faaf406e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60116/0 (socket says 172.21.15.19:60116) 2024-08-17T02:30:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf881a700 1 -- 172.21.15.19:0/1523750650 learned_addr learned my addr 172.21.15.19:0/1523750650 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:30:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaebfff700 1 --2- 172.21.15.19:0/1523750650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413fa50 0x7faaf40ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf3fff700 1 -- 172.21.15.19:0/1523750650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413fa50 msgr2=0x7faaf40ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf3fff700 1 --2- 172.21.15.19:0/1523750650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413fa50 0x7faaf40ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf3fff700 1 -- 172.21.15.19:0/1523750650 >> v1:172.21.15.19:6789/0 conn(0x7faaf40b0100 legacy=0x7faaf406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf3fff700 1 -- 172.21.15.19:0/1523750650 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40af340 con 0x7faaf413f680 2024-08-17T02:30:14.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf3fff700 1 --2- 172.21.15.19:0/1523750650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413f680 0x7faaf40aea80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7faae40098e0 tx=0x7faae40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d3385766e51fe2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:14.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf37fe700 1 -- 172.21.15.19:0/1523750650 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae400b640 con 0x7faaf413f680 2024-08-17T02:30:14.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf37fe700 1 -- 172.21.15.19:0/1523750650 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae400b7a0 con 0x7faaf413f680 2024-08-17T02:30:14.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf37fe700 1 -- 172.21.15.19:0/1523750650 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae400bb40 con 0x7faaf413f680 2024-08-17T02:30:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf901b700 1 -- 172.21.15.19:0/1523750650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413f680 msgr2=0x7faaf40aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.314+0000 7faaf901b700 1 --2- 172.21.15.19:0/1523750650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413f680 0x7faaf40aea80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7faae40098e0 tx=0x7faae40091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 -- 172.21.15.19:0/1523750650 shutdown_connections 2024-08-17T02:30:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 --2- 172.21.15.19:0/1523750650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413fa50 0x7faaf40ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 --2- 172.21.15.19:0/1523750650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413f680 0x7faaf40aea80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 -- 172.21.15.19:0/1523750650 >> 172.21.15.19:0/1523750650 conn(0x7faaf40678a0 msgr2=0x7faaf4067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 -- 172.21.15.19:0/1523750650 shutdown_connections 2024-08-17T02:30:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 -- 172.21.15.19:0/1523750650 wait complete. 2024-08-17T02:30:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 Processor -- start 2024-08-17T02:30:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 -- start start 2024-08-17T02:30:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaf40b0100 0x7faaf41399e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413f680 0x7faaf41376c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413fa50 0x7faaf4137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf41317d0 con 0x7faaf413fa50 2024-08-17T02:30:14.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4130920 con 0x7faaf40b0100 2024-08-17T02:30:14.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf901b700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4130bc0 con 0x7faaf413f680 2024-08-17T02:30:14.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf881a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413fa50 0x7faaf4137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf881a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413fa50 0x7faaf4137c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47834/0 (socket says 172.21.15.19:47834) 2024-08-17T02:30:14.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf881a700 1 -- 172.21.15.19:0/3525440125 learned_addr learned my addr 172.21.15.19:0/3525440125 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:30:14.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaebfff700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413f680 0x7faaf41376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.318+0000 7faaf3fff700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaf40b0100 0x7faaf41399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf881a700 1 -- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413f680 msgr2=0x7faaf41376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf881a700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413f680 0x7faaf41376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf881a700 1 -- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaf40b0100 msgr2=0x7faaf41399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf881a700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaf40b0100 0x7faaf41399e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf881a700 1 -- 172.21.15.19:0/3525440125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae4009420 con 0x7faaf413fa50 2024-08-17T02:30:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf881a700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413fa50 0x7faaf4137c00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faaec00cc40 tx=0x7faaec001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf0ff9700 1 -- 172.21.15.19:0/3525440125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00a8b0 con 0x7faaf413fa50 2024-08-17T02:30:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf0ff9700 1 -- 172.21.15.19:0/3525440125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec00aa10 con 0x7faaf413fa50 2024-08-17T02:30:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf4130ea0 con 0x7faaf413fa50 2024-08-17T02:30:14.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf0ff9700 1 -- 172.21.15.19:0/3525440125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00add0 con 0x7faaf413fa50 2024-08-17T02:30:14.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf4131460 con 0x7faaf413fa50 2024-08-17T02:30:14.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf4131980 con 0x7faaf413fa50 2024-08-17T02:30:14.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf0ff9700 1 -- 172.21.15.19:0/3525440125 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7faaec007300 con 0x7faaf413fa50 2024-08-17T02:30:14.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.322+0000 7faaf0ff9700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faad4060860 0x7faad4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.326+0000 7faaf0ff9700 1 -- 172.21.15.19:0/3525440125 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7faaec07cc00 con 0x7faaf413fa50 2024-08-17T02:30:14.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.326+0000 7faaf3fff700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faad4060860 0x7faad4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.326+0000 7faaf3fff700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faad4060860 0x7faad4062d10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faae40091e0 tx=0x7faae4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:14.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.330+0000 7faaf0ff9700 1 -- 172.21.15.19:0/3525440125 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7faaf4131980 con 0x7faaf413fa50 2024-08-17T02:30:14.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.498+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7faaf4064330 con 0x7faaf413fa50 2024-08-17T02:30:14.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.502+0000 7faaf0ff9700 1 -- 172.21.15.19:0/3525440125 <== mon.0 v2:172.21.15.19:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faaec04d370 con 0x7faaf413fa50 2024-08-17T02:30:14.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.506+0000 7faaf0ff9700 1 -- 172.21.15.19:0/3525440125 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7faaec083080 con 0x7faaf413fa50 2024-08-17T02:30:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.506+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faad4060860 msgr2=0x7faad4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.506+0000 7faaf901b700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faad4060860 0x7faad4062d10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faae40091e0 tx=0x7faae4017000 comp rx=0 tx=0).stop 2024-08-17T02:30:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.506+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413fa50 msgr2=0x7faaf4137c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.506+0000 7faaf901b700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413fa50 0x7faaf4137c00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faaec00cc40 tx=0x7faaec001a50 comp rx=0 tx=0).stop 2024-08-17T02:30:14.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.510+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 shutdown_connections 2024-08-17T02:30:14.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.510+0000 7faaf901b700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7faad4060860 0x7faad4062d10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.510+0000 7faaf901b700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faaf413fa50 0x7faaf4137c00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.510+0000 7faaf901b700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaf413f680 0x7faaf41376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.510+0000 7faaf901b700 1 --2- 172.21.15.19:0/3525440125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaf40b0100 0x7faaf41399e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.510+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 >> 172.21.15.19:0/3525440125 conn(0x7faaf40678a0 msgr2=0x7faaf413e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:14.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.510+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 shutdown_connections 2024-08-17T02:30:14.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.510+0000 7faaf901b700 1 -- 172.21.15.19:0/3525440125 wait complete. 2024-08-17T02:30:14.526 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:30:14.527 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:14.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf90f13700 1 Processor -- start 2024-08-17T02:30:14.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf90f13700 1 -- start start 2024-08-17T02:30:14.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf90f13700 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbf8c155fb0 0x7fbf8c156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf90f13700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c06a3e0 con 0x7fbf8c0c96c0 2024-08-17T02:30:14.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf90f13700 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0697d0 con 0x7fbf8c0b0050 2024-08-17T02:30:14.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf90f13700 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c069ab0 con 0x7fbf8c155fb0 2024-08-17T02:30:14.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf8bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbf8c0c96c0 0x7fbf8c06a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:60126/0 (socket says 172.21.15.19:60126) 2024-08-17T02:30:14.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf8bfff700 1 -- 172.21.15.19:0/1266859016 learned_addr learned my addr 172.21.15.19:0/1266859016 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-08-17T02:30:14.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf8b7fe700 1 --2- 172.21.15.19:0/1266859016 >> v2:172.21.15.119:3300/0 conn(0x7fbf8c155fb0 0x7fbf8c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf8affd700 1 -- 172.21.15.19:0/1266859016 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179549400 0 0) 0x7fbf8c06a3e0 con 0x7fbf8c0c96c0 2024-08-17T02:30:14.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf8affd700 1 -- 172.21.15.19:0/1266859016 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf78003570 con 0x7fbf8c0c96c0 2024-08-17T02:30:14.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf8affd700 1 -- 172.21.15.19:0/1266859016 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3781129423 0 0) 0x7fbf78003570 con 0x7fbf8c0c96c0 2024-08-17T02:30:14.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf8b7fe700 1 -- 172.21.15.19:0/1266859016 >> v1:172.21.15.119:6789/0 conn(0x7fbf8c0b0050 legacy=0x7fbf8c0687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf8b7fe700 1 -- 172.21.15.19:0/1266859016 >> v1:172.21.15.19:6789/0 conn(0x7fbf8c0c96c0 legacy=0x7fbf8c06a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.626+0000 7fbf8b7fe700 1 -- 172.21.15.19:0/1266859016 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c069d90 con 0x7fbf8c155fb0 2024-08-17T02:30:14.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf8b7fe700 1 --2- 172.21.15.19:0/1266859016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf8c155fb0 0x7fbf8c156380 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0098e0 tx=0x7fbf7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9eb744f9a9708f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:14.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf8affd700 1 -- 172.21.15.19:0/1266859016 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840017f0 con 0x7fbf8c155fb0 2024-08-17T02:30:14.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf8affd700 1 -- 172.21.15.19:0/1266859016 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf7c011420 con 0x7fbf8c155fb0 2024-08-17T02:30:14.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf8affd700 1 -- 172.21.15.19:0/1266859016 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0117e0 con 0x7fbf8c155fb0 2024-08-17T02:30:14.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf90f13700 1 -- 172.21.15.19:0/1266859016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf8c155fb0 msgr2=0x7fbf8c156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf90f13700 1 --2- 172.21.15.19:0/1266859016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf8c155fb0 0x7fbf8c156380 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0098e0 tx=0x7fbf7c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf90f13700 1 -- 172.21.15.19:0/1266859016 shutdown_connections 2024-08-17T02:30:14.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf90f13700 1 --2- 172.21.15.19:0/1266859016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf8c155fb0 0x7fbf8c156380 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf90f13700 1 -- 172.21.15.19:0/1266859016 >> 172.21.15.19:0/1266859016 conn(0x7fbf8c0ccfc0 msgr2=0x7fbf8c0c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:14.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf90f13700 1 -- 172.21.15.19:0/1266859016 shutdown_connections 2024-08-17T02:30:14.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.630+0000 7fbf90f13700 1 -- 172.21.15.19:0/1266859016 wait complete. 2024-08-17T02:30:14.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf90f13700 1 Processor -- start 2024-08-17T02:30:14.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf90f13700 1 -- start start 2024-08-17T02:30:14.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf90f13700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8c0b0050 0x7fbf8c0c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf90f13700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf8c0c96c0 0x7fbf8c154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf90f13700 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf8c155fb0 0x7fbf8c0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf90f13700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0c8590 con 0x7fbf8c0b0050 2024-08-17T02:30:14.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf90f13700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c150540 con 0x7fbf8c0c96c0 2024-08-17T02:30:14.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf90f13700 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0c7a10 con 0x7fbf8c155fb0 2024-08-17T02:30:14.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8c0b0050 0x7fbf8c0c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8c0b0050 0x7fbf8c0c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47842/0 (socket says 172.21.15.19:47842) 2024-08-17T02:30:14.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf8b7fe700 1 -- 172.21.15.19:0/1489380395 learned_addr learned my addr 172.21.15.19:0/1489380395 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-08-17T02:30:14.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf82ffd700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf8c0c96c0 0x7fbf8c154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf8bfff700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf8c155fb0 0x7fbf8c0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf8b7fe700 1 -- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf8c155fb0 msgr2=0x7fbf8c0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf8b7fe700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf8c155fb0 0x7fbf8c0c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf8b7fe700 1 -- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf8c0c96c0 msgr2=0x7fbf8c154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf8b7fe700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf8c0c96c0 0x7fbf8c154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.634+0000 7fbf8b7fe700 1 -- 172.21.15.19:0/1489380395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c009420 con 0x7fbf8c0b0050 2024-08-17T02:30:14.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf8b7fe700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8c0b0050 0x7fbf8c0c3ac0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c069330 tx=0x7fbf7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:14.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf83fff700 1 -- 172.21.15.19:0/1489380395 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c000cc0 con 0x7fbf8c0b0050 2024-08-17T02:30:14.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c0c7cf0 con 0x7fbf8c0b0050 2024-08-17T02:30:14.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf83fff700 1 -- 172.21.15.19:0/1489380395 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf7c01cb30 con 0x7fbf8c0b0050 2024-08-17T02:30:14.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c0c82b0 con 0x7fbf8c0b0050 2024-08-17T02:30:14.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf83fff700 1 -- 172.21.15.19:0/1489380395 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c01a450 con 0x7fbf8c0b0050 2024-08-17T02:30:14.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c0638f0 con 0x7fbf8c0b0050 2024-08-17T02:30:14.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf83fff700 1 -- 172.21.15.19:0/1489380395 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 6) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbf7c01a800 con 0x7fbf8c0b0050 2024-08-17T02:30:14.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf83fff700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbf6c060860 0x7fbf6c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:14.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf83fff700 1 -- 172.21.15.19:0/1489380395 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbf7c07e140 con 0x7fbf8c0b0050 2024-08-17T02:30:14.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.638+0000 7fbf82ffd700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbf6c060860 0x7fbf6c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:14.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.642+0000 7fbf82ffd700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbf6c060860 0x7fbf6c062d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0cab00 tx=0x7fbf74007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:14.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.646+0000 7fbf83fff700 1 -- 172.21.15.19:0/1489380395 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbf7c04e8e0 con 0x7fbf8c0b0050 2024-08-17T02:30:14.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.846+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf8c1676e0 con 0x7fbf8c0b0050 2024-08-17T02:30:14.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.846+0000 7fbf83fff700 1 -- 172.21.15.19:0/1489380395 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3534 (secure 0 0 0) 0x7fbf7c029de0 con 0x7fbf8c0b0050 2024-08-17T02:30:14.853 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-08-17T02:30:14.853 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5004,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6833/3226224241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3226224241},{"type":"v1","addr":"172.21.15.19:6833","nonce":3226224241}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1578749046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1578749046},{"type":"v1","addr":"172.21.15.19:6835","nonce":1578749046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":34640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3987054022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3987054022},{"type":"v1","addr":"172.21.15.119:6835","nonce":3987054022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":35003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/856906349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":856906349},{"type":"v1","addr":"172.21.15.119:6837","nonce":856906349}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2024-08-17T02:30:14.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbf6c060860 msgr2=0x7fbf6c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbf6c060860 0x7fbf6c062d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0cab00 tx=0x7fbf74007ec0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8c0b0050 msgr2=0x7fbf8c0c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8c0b0050 0x7fbf8c0c3ac0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c069330 tx=0x7fbf7c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 shutdown_connections 2024-08-17T02:30:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:6832/24148,v1:172.21.15.119:6833/24148] conn(0x7fbf6c060860 0x7fbf6c062d10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf8c155fb0 0x7fbf8c0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf8c0c96c0 0x7fbf8c154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 --2- 172.21.15.19:0/1489380395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8c0b0050 0x7fbf8c0c3ac0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 >> 172.21.15.19:0/1489380395 conn(0x7fbf8c0ccfc0 msgr2=0x7fbf8c150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 shutdown_connections 2024-08-17T02:30:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-08-17T02:30:14.850+0000 7fbf90f13700 1 -- 172.21.15.19:0/1489380395 wait complete. 2024-08-17T02:30:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 21 2024-08-17T02:30:14.867 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:30:14.868 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:30:14.868 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:30:14.868 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:14.884 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:30:14.884 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:30:14.885 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:14.901 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:30:14.901 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:30:14.901 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:14.918 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:30:14.918 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:30:14.918 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:14.977 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:30:14.977 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:30:14.978 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:30:14.978 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.047 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:30:15.047 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:30:15.048 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.121 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:30:15.122 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:30:15.122 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.189 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:30:15.189 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:30:15.189 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.289 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:30:15.289 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:30:15.289 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.341 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:30:15.342 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:30:15.342 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.418 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:30:15.419 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:30:15.419 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.510 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:30:15.510 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:30:15.511 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.577 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:30:15.578 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:30:15.578 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:30:15.578 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.607 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:30:15.607 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:30:15.607 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.639 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:30:15.639 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:30:15.640 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:30:15.640 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-08-17T02:30:15.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-08-17T02:30:15.661 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:30:15.661 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:30:15.661 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.681 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:30:15.681 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:30:15.681 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:15.743 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:30:15.743 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:30:15.744 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:30:15.769 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:30:15.769 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:30:16.026 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:30:16.027 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:30:16.222 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:30:16.223 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:30:16.498 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:30:16.498 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:30:16.659 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:30:16.660 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:30:16.916 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:30:16.917 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:30:17.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:30:17.060 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:30:17.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:30:17.226 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:30:17.360 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:30:17.381 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250/data/mon.a.tgz 2024-08-17T02:30:17.381 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-08-17T02:30:17.388 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.aVobiEeSVe 2024-08-17T02:30:17.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.aVobiEeSVe 2024-08-17T02:30:17.517 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.aVobiEeSVe 2024-08-17T02:30:17.541 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.aVobiEeSVe is 327KB 2024-08-17T02:30:17.604 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.aVobiEeSVe 2024-08-17T02:30:17.610 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250/data/mon.b.tgz 2024-08-17T02:30:17.610 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-08-17T02:30:17.620 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.7onttw1JI1 2024-08-17T02:30:17.620 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7onttw1JI1 2024-08-17T02:30:17.769 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.7onttw1JI1 2024-08-17T02:30:17.795 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.7onttw1JI1 is 436KB 2024-08-17T02:30:17.855 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.7onttw1JI1 2024-08-17T02:30:17.861 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250/data/mon.c.tgz 2024-08-17T02:30:17.862 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-08-17T02:30:17.868 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.g5gKY4AsR2 2024-08-17T02:30:17.868 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.g5gKY4AsR2 2024-08-17T02:30:18.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.g5gKY4AsR2 2024-08-17T02:30:18.039 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.g5gKY4AsR2 is 435KB 2024-08-17T02:30:18.103 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.g5gKY4AsR2 2024-08-17T02:30:18.109 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:30:18.109 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:30:18.112 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:30:18.126 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:30:18.126 DEBUG:teuthology.orchestra.run.smithi019:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:30:18.128 DEBUG:teuthology.orchestra.run.smithi119:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:30:18.157 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:30:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:30:18.196 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:30:18.197 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250/remote/smithi019/crash 2024-08-17T02:30:18.198 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:30:18.214 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250/remote/smithi119/crash 2024-08-17T02:30:18.215 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:30:18.232 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:30:18.232 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:18.259 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:18.329 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:18.345 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:18.360 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:30:18.361 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:30:18.363 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:30:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31388.log 2024-08-17T02:30:18.385 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34824.log 2024-08-17T02:30:18.386 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33608.log 2024-08-17T02:30:18.386 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31388.log.gz 2024-08-17T02:30:18.387 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32982.log 2024-08-17T02:30:18.387 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34456.log 2024-08-17T02:30:18.387 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33608.log: /var/log/ceph/ceph-client.admin.32982.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34824.log.gz 2024-08-17T02:30:18.388 INFO:teuthology.orchestra.run.smithi019.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.33608.log.gz 2024-08-17T02:30:18.388 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32982.log.gz 2024-08-17T02:30:18.388 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29975.log 2024-08-17T02:30:18.391 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24293.log 2024-08-17T02:30:18.391 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:30:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24346.log 2024-08-17T02:30:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.24293.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.30601.log 2024-08-17T02:30:18.392 INFO:teuthology.orchestra.run.smithi119.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24293.log.gz 2024-08-17T02:30:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.24346.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:30:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24265.log 2024-08-17T02:30:18.392 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24346.log.gz 2024-08-17T02:30:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.1.30601.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24321.log 2024-08-17T02:30:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:30:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.24265.log: gzip -5 --verbose /var/log/ceph/ceph-client.admin.24321.log: -- /var/log/ceph/ceph-client.admin.24426.log 2024-08-17T02:30:18.397 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.24265.log.gz 2024-08-17T02:30:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:30:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.5.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.24321.log.gz 2024-08-17T02:30:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24454.log 2024-08-17T02:30:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.24426.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:30:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.x.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.24426.log.gz 2024-08-17T02:30:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.24454.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:30:18.398 INFO:teuthology.orchestra.run.smithi119.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24454.log.gz 2024-08-17T02:30:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.c.log: 95.3% -- replaced with /var/log/ceph/ceph-client.1.30601.log.gz 2024-08-17T02:30:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24374.log 2024-08-17T02:30:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:30:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:30:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24400.log 2024-08-17T02:30:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.24374.log: /var/log/ceph/ceph-osd.6.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.24374.log.gz 2024-08-17T02:30:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:30:18.404 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33924.log 2024-08-17T02:30:18.404 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34456.log: /var/log/ceph/ceph-client.admin.29975.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34456.log.gz 2024-08-17T02:30:18.405 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29898.log 2024-08-17T02:30:18.405 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29975.log.gz 2024-08-17T02:30:18.405 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29458.log 2024-08-17T02:30:18.405 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33924.log: /var/log/ceph/ceph-client.admin.29898.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:30:18.405 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29898.log.gz 2024-08-17T02:30:18.405 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33924.log.gz 2024-08-17T02:30:18.405 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30412.log 2024-08-17T02:30:18.405 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29458.log.gz 2024-08-17T02:30:18.406 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29429.log 2024-08-17T02:30:18.406 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32112.log 2024-08-17T02:30:18.406 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34743.log 2024-08-17T02:30:18.406 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30412.log.gz 2024-08-17T02:30:18.406 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29429.log: /var/log/ceph/ceph-client.admin.32112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34105.log 2024-08-17T02:30:18.406 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34743.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29429.log.gz 2024-08-17T02:30:18.406 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32112.log.gz 2024-08-17T02:30:18.406 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29925.log 2024-08-17T02:30:18.407 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34743.log.gz 2024-08-17T02:30:18.407 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33581.log 2024-08-17T02:30:18.407 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30627.log 2024-08-17T02:30:18.407 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32563.log 2024-08-17T02:30:18.407 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29925.log: /var/log/ceph/ceph-client.admin.33581.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34105.log.gz 2024-08-17T02:30:18.407 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31529.log 2024-08-17T02:30:18.407 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33581.log.gz 2024-08-17T02:30:18.407 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30627.log.gz 2024-08-17T02:30:18.407 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29925.log.gz 2024-08-17T02:30:18.408 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32563.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32563.log.gz 2024-08-17T02:30:18.408 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32328.log 2024-08-17T02:30:18.408 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29871.log 2024-08-17T02:30:18.408 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29628.log 2024-08-17T02:30:18.408 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31529.log.gz 2024-08-17T02:30:18.408 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29871.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:30:18.408 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32328.log.gz 2024-08-17T02:30:18.408 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29871.log.gz 2024-08-17T02:30:18.408 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29978.log 2024-08-17T02:30:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29628.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32781.log 2024-08-17T02:30:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29978.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29628.log.gz 2024-08-17T02:30:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33496.log 2024-08-17T02:30:18.409 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29978.log.gz 2024-08-17T02:30:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32781.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:30:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33442.log 2024-08-17T02:30:18.409 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32781.log.gz 2024-08-17T02:30:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32085.log 2024-08-17T02:30:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30411.log 2024-08-17T02:30:18.410 INFO:teuthology.orchestra.run.smithi019.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33496.log.gz 2024-08-17T02:30:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33442.log: /var/log/ceph/ceph-client.admin.32085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24140.log 2024-08-17T02:30:18.410 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0%/var/log/ceph/ceph-client.admin.30411.log: -- replaced with /var/log/ceph/ceph-client.admin.32085.log.gz 2024-08-17T02:30:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 88.8%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.33442.log.gz-- 2024-08-17T02:30:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30194.log 2024-08-17T02:30:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32382.log 2024-08-17T02:30:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.24140.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30411.log.gz 2024-08-17T02:30:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30194.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.24140.log.gz 2024-08-17T02:30:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30189.log 2024-08-17T02:30:18.411 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30194.log.gz 2024-08-17T02:30:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32899.log 2024-08-17T02:30:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32382.log: /var/log/ceph/ceph-client.admin.30189.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32382.log.gz 2024-08-17T02:30:18.411 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30189.log.gz 2024-08-17T02:30:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:30:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32899.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32899.log.gz 2024-08-17T02:30:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.24400.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.24400.log.gz 2024-08-17T02:30:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:30:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:30:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.log: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:30:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.30431.log 2024-08-17T02:30:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.30320.log 2024-08-17T02:30:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.3.30431.log: 89.0% -- replaced with /var/log/ceph/ceph-client.3.30431.log.gz 2024-08-17T02:30:18.418 INFO:teuthology.orchestra.run.smithi119.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:30:18.419 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:30:18.419 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.1.30320.log: 89.4% -- replaced with /var/log/ceph/ceph-client.1.30320.log.gz 2024-08-17T02:30:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30762.log 2024-08-17T02:30:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31475.log 2024-08-17T02:30:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31637.log 2024-08-17T02:30:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30762.log: /var/log/ceph/ceph-client.admin.31475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34770.log 2024-08-17T02:30:18.423 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30762.log.gz 2024-08-17T02:30:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32955.log 2024-08-17T02:30:18.423 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31475.log.gz 2024-08-17T02:30:18.423 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31637.log.gz 2024-08-17T02:30:18.423 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34770.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34770.log.gz 2024-08-17T02:30:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32671.log 2024-08-17T02:30:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34321.log 2024-08-17T02:30:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32671.log: /var/log/ceph/ceph-client.admin.29960.log 2024-08-17T02:30:18.424 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32955.log.gz 2024-08-17T02:30:18.424 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33036.log 2024-08-17T02:30:18.424 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32671.log.gz 2024-08-17T02:30:18.424 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34321.log.gz 2024-08-17T02:30:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34797.log 2024-08-17T02:30:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29960.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.29960.log.gz 2024-08-17T02:30:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.32193.log 2024-08-17T02:30:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33226.log 2024-08-17T02:30:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35175.log 2024-08-17T02:30:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32193.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33036.log.gz 2024-08-17T02:30:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29682.log 2024-08-17T02:30:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33226.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34797.log.gz 2024-08-17T02:30:18.425 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35175.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32193.log.gz 2024-08-17T02:30:18.426 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gz 2024-08-17T02:30:18.426 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31990.log 2024-08-17T02:30:18.426 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31799.log 2024-08-17T02:30:18.426 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29682.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.33226.log.gz 2024-08-17T02:30:18.426 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35040.log 2024-08-17T02:30:18.426 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31990.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29682.log.gz 2024-08-17T02:30:18.426 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34986.log 2024-08-17T02:30:18.426 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31799.log.gz 2024-08-17T02:30:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:30:18.427 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31990.log.gz 2024-08-17T02:30:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30187.log 2024-08-17T02:30:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33554.log 2024-08-17T02:30:18.427 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35040.log.gz 2024-08-17T02:30:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33009.log 2024-08-17T02:30:18.427 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0%/var/log/ceph/ceph-client.admin.30187.log: -- replaced with /var/log/ceph/ceph-client.admin.34986.log.gz 2024-08-17T02:30:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33897.log 2024-08-17T02:30:18.428 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33554.log.gz 2024-08-17T02:30:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34078.log 2024-08-17T02:30:18.428 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30187.log.gz 2024-08-17T02:30:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30708.log 2024-08-17T02:30:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33897.log: /var/log/ceph/ceph-client.admin.34078.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33386.log 2024-08-17T02:30:18.428 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33009.log.gz 2024-08-17T02:30:18.428 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34078.log.gz 2024-08-17T02:30:18.428 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33897.log.gz 2024-08-17T02:30:18.429 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35123.log 2024-08-17T02:30:18.430 INFO:teuthology.orchestra.run.smithi119.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:30:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30816.log 2024-08-17T02:30:18.447 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30708.log.gz 2024-08-17T02:30:18.447 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33386.log.gz 2024-08-17T02:30:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32220.log 2024-08-17T02:30:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30816.log: gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.35123.log.gz--verbose 2024-08-17T02:30:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:-- /var/log/ceph/ceph-client.admin.30735.log 2024-08-17T02:30:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32220.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30816.log.gz 2024-08-17T02:30:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33063.log 2024-08-17T02:30:18.448 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32220.log.gz 2024-08-17T02:30:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32810.log 2024-08-17T02:30:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35148.log 2024-08-17T02:30:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33063.log: /var/log/ceph/ceph-client.admin.32810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32031.log 2024-08-17T02:30:18.448 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30735.log.gz 2024-08-17T02:30:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32534.log 2024-08-17T02:30:18.449 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33063.log.gz 2024-08-17T02:30:18.449 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32810.log.gz 2024-08-17T02:30:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35148.log: /var/log/ceph/ceph-client.admin.32031.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35148.log.gz 2024-08-17T02:30:18.449 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32031.log.gz 2024-08-17T02:30:18.449 INFO:teuthology.orchestra.run.smithi019.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:30:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32355.log 2024-08-17T02:30:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24279.log 2024-08-17T02:30:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30870.log 2024-08-17T02:30:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32355.log: /var/log/ceph/ceph-client.admin.24279.log: gzip -5 --verbose -- 89.5%/var/log/ceph/ceph-client.admin.29402.log 2024-08-17T02:30:18.450 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32534.log.gz 2024-08-17T02:30:18.450 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32355.log.gz 2024-08-17T02:30:18.450 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.24279.log.gz 2024-08-17T02:30:18.450 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33870.log 2024-08-17T02:30:18.450 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34402.log 2024-08-17T02:30:18.450 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29402.log: /var/log/ceph/ceph-client.admin.33870.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:30:18.450 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30870.log.gz 2024-08-17T02:30:18.450 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33870.log.gz 2024-08-17T02:30:18.451 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34689.log 2024-08-17T02:30:18.451 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.29402.log.gz 2024-08-17T02:30:18.451 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34402.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32698.log 2024-08-17T02:30:18.451 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34402.log.gz 2024-08-17T02:30:18.451 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32247.log 2024-08-17T02:30:18.451 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-08-17T02:30:18.451 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32698.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34689.log.gz 2024-08-17T02:30:18.451 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31556.log 2024-08-17T02:30:18.451 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32247.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32698.log.gz 2024-08-17T02:30:18.452 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33469.log 2024-08-17T02:30:18.452 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:30:18.452 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34429.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32247.log.gz 2024-08-17T02:30:18.452 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24016.log 2024-08-17T02:30:18.452 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-08-17T02:30:18.452 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33469.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31556.log.gz 2024-08-17T02:30:18.452 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32166.log 2024-08-17T02:30:18.452 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30391.log 2024-08-17T02:30:18.453 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33469.log.gz 2024-08-17T02:30:18.453 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.24016.log: /var/log/ceph/ceph-client.admin.32166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31502.log 2024-08-17T02:30:18.453 INFO:teuthology.orchestra.run.smithi019.stderr: 92.4% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24016.log.gz 2024-08-17T02:30:18.453 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32166.log.gz 2024-08-17T02:30:18.453 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32058.log 2024-08-17T02:30:18.453 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30391.log: /var/log/ceph/ceph-client.admin.31502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31448.log 2024-08-17T02:30:18.453 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30391.log.gz 2024-08-17T02:30:18.453 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31502.log.gz 2024-08-17T02:30:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32301.log 2024-08-17T02:30:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30193.log 2024-08-17T02:30:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31448.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32058.log.gz 2024-08-17T02:30:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34240.log 2024-08-17T02:30:18.454 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31448.log.gz 2024-08-17T02:30:18.454 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32301.log.gz 2024-08-17T02:30:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32617.log 2024-08-17T02:30:18.454 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34375.log 2024-08-17T02:30:18.455 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34240.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30193.log.gz 2024-08-17T02:30:18.455 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30399.log 2024-08-17T02:30:18.455 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32617.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34240.log.gz 2024-08-17T02:30:18.455 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29790.log 2024-08-17T02:30:18.455 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34375.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32617.log.gz 2024-08-17T02:30:18.455 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34662.log 2024-08-17T02:30:18.455 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34375.log.gz 2024-08-17T02:30:18.455 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30399.log.gz 2024-08-17T02:30:18.455 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31005.log 2024-08-17T02:30:18.456 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29736.log 2024-08-17T02:30:18.456 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29790.log.gz 2024-08-17T02:30:18.456 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32507.log 2024-08-17T02:30:18.456 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34662.log.gz 2024-08-17T02:30:18.456 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30978.log 2024-08-17T02:30:18.456 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:30:18.456 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29736.log: /var/log/ceph/ceph-client.admin.32507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29516.log 2024-08-17T02:30:18.456 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29736.log.gz 2024-08-17T02:30:18.457 INFO:teuthology.orchestra.run.smithi019.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.31005.log.gz 2024-08-17T02:30:18.457 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29709.log 2024-08-17T02:30:18.457 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30978.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32507.log.gz 2024-08-17T02:30:18.457 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log 2024-08-17T02:30:18.457 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29516.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30978.log.gz 2024-08-17T02:30:18.457 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34213.log 2024-08-17T02:30:18.457 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29709.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.29516.log.gz 2024-08-17T02:30:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31963.log 2024-08-17T02:30:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33172.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29709.log.gz 2024-08-17T02:30:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33735.log 2024-08-17T02:30:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34213.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33172.log.gz 2024-08-17T02:30:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32845.log 2024-08-17T02:30:18.458 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34213.log.gz 2024-08-17T02:30:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30924.log 2024-08-17T02:30:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33735.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31963.log.gz 2024-08-17T02:30:18.459 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30789.log 2024-08-17T02:30:18.459 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32845.log.gz 2024-08-17T02:30:18.459 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33735.log.gz 2024-08-17T02:30:18.459 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33145.log 2024-08-17T02:30:18.459 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30924.log: /var/log/ceph/ceph-client.admin.30789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32480.log 2024-08-17T02:30:18.459 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30924.log.gz 2024-08-17T02:30:18.459 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33145.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:30:18.459 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30789.log.gz 2024-08-17T02:30:18.460 INFO:teuthology.orchestra.run.smithi019.stderr:gzip /var/log/ceph/ceph-client.admin.32480.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31691.log 2024-08-17T02:30:18.460 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33145.log.gz 2024-08-17T02:30:18.460 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30196.log 2024-08-17T02:30:18.460 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.1.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32480.log.gz 2024-08-17T02:30:18.460 INFO:teuthology.orchestra.run.smithi019.stderr:gzip /var/log/ceph/ceph-client.admin.31691.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33118.log 2024-08-17T02:30:18.460 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33762.log 2024-08-17T02:30:18.460 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31691.log.gz 2024-08-17T02:30:18.460 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30196.log: gzip /var/log/ceph/ceph-client.admin.33118.log: -5 --verbose -- /var/log/ceph/ceph-client.0.33335.log 2024-08-17T02:30:18.460 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30196.log.gz 2024-08-17T02:30:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34716.log 2024-08-17T02:30:18.461 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33118.log.gz 2024-08-17T02:30:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.33335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33816.log 2024-08-17T02:30:18.461 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33762.log.gz 2024-08-17T02:30:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34267.log 2024-08-17T02:30:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34716.log: /var/log/ceph/ceph-client.admin.33816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34051.log 2024-08-17T02:30:18.461 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34716.log.gz 2024-08-17T02:30:18.461 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.31313.log 2024-08-17T02:30:18.462 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34267.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33816.log.gz 2024-08-17T02:30:18.462 INFO:teuthology.orchestra.run.smithi019.stderr:gzip /var/log/ceph/ceph-client.admin.34051.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29817.log 2024-08-17T02:30:18.462 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34267.log.gz 2024-08-17T02:30:18.462 INFO:teuthology.orchestra.run.smithi019.stderr:gzip /var/log/ceph/ceph-client.2.31313.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31718.log 2024-08-17T02:30:18.462 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34051.log.gz 2024-08-17T02:30:18.462 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29817.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29817.log.gz 2024-08-17T02:30:18.462 INFO:teuthology.orchestra.run.smithi019.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.2.31313.log.gz 2024-08-17T02:30:18.462 INFO:teuthology.orchestra.run.smithi019.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.33335.log.gz 2024-08-17T02:30:18.463 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31826.log 2024-08-17T02:30:18.463 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.7.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:30:18.487 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30195.log 2024-08-17T02:30:18.487 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31718.log.gz 2024-08-17T02:30:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-08-17T02:30:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29303.log 2024-08-17T02:30:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30195.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31826.log.gz 2024-08-17T02:30:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29543.log 2024-08-17T02:30:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34608.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30195.log.gz 2024-08-17T02:30:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29976.log 2024-08-17T02:30:18.488 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz 2024-08-17T02:30:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29543.log: /var/log/ceph/ceph-client.admin.29968.log 2024-08-17T02:30:18.489 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29303.log.gz 2024-08-17T02:30:18.489 INFO:teuthology.orchestra.run.smithi019.stderr:gzip /var/log/ceph/ceph-client.admin.29976.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30600.log 2024-08-17T02:30:18.489 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29543.log.gz 2024-08-17T02:30:18.489 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31421.log 2024-08-17T02:30:18.489 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29976.log.gz 2024-08-17T02:30:18.489 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30600.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29968.log.gz-5 2024-08-17T02:30:18.489 INFO:teuthology.orchestra.run.smithi019.stderr:--verbose -- /var/log/ceph/ceph-client.admin.30654.log 2024-08-17T02:30:18.489 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30600.log.gz 2024-08-17T02:30:18.490 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32725.log 2024-08-17T02:30:18.490 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31855.log 2024-08-17T02:30:18.490 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30654.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31421.log.gz 2024-08-17T02:30:18.490 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31220.log 2024-08-17T02:30:18.490 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32725.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30654.log.gz 2024-08-17T02:30:18.490 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34132.log 2024-08-17T02:30:18.490 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31855.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32725.log.gz 2024-08-17T02:30:18.490 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 /var/log/ceph/ceph-client.admin.31220.log: --verbose -- /var/log/ceph/ceph-client.admin.32928.log 2024-08-17T02:30:18.491 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31855.log.gz 2024-08-17T02:30:18.491 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29844.log 2024-08-17T02:30:18.491 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31220.log.gz 2024-08-17T02:30:18.491 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29980.log 2024-08-17T02:30:18.491 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32928.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34132.log.gz 2024-08-17T02:30:18.491 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33527.log 2024-08-17T02:30:18.491 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29844.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32928.log.gz 2024-08-17T02:30:18.491 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29980.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.19154.log 2024-08-17T02:30:18.492 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29844.log.gz 2024-08-17T02:30:18.492 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 88.7%/var/log/ceph/ceph-client.admin.33527.log: -- replaced with /var/log/ceph/ceph-client.admin.29980.log.gz-5 2024-08-17T02:30:18.492 INFO:teuthology.orchestra.run.smithi019.stderr:--verbose -- /var/log/ceph/ceph-client.admin.30400.log 2024-08-17T02:30:18.492 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33527.log.gz 2024-08-17T02:30:18.492 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29485.log 2024-08-17T02:30:18.492 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.tmp-client.admin.19154.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.19154.log.gz 2024-08-17T02:30:18.492 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29570.log 2024-08-17T02:30:18.492 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32872.log 2024-08-17T02:30:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29485.log: 88.1%/var/log/ceph/ceph-client.admin.29570.log: -- replaced with /var/log/ceph/ceph-client.admin.30400.log.gz 2024-08-17T02:30:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30681.log 2024-08-17T02:30:18.493 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29485.log.gz 2024-08-17T02:30:18.493 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29570.log.gz 2024-08-17T02:30:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29979.log /var/log/ceph/ceph-client.admin.32872.log: 2024-08-17T02:30:18.493 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32872.log.gz 2024-08-17T02:30:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34554.log 2024-08-17T02:30:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31882.log 2024-08-17T02:30:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29979.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30681.log.gz 2024-08-17T02:30:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33415.log 2024-08-17T02:30:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34554.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29979.log.gz 2024-08-17T02:30:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32274.log 2024-08-17T02:30:18.494 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34554.log.gz 2024-08-17T02:30:18.494 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.31882.log.gz 2024-08-17T02:30:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:--verbose -- /var/log/ceph/ceph-client.0.31173.log 2024-08-17T02:30:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33415.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33415.log.gz 2024-08-17T02:30:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34348.log 2024-08-17T02:30:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33978.log 2024-08-17T02:30:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.31173.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32274.log.gz 2024-08-17T02:30:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33708.log 2024-08-17T02:30:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34483.log 2024-08-17T02:30:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33978.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34348.log.gz 2024-08-17T02:30:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34012.log 2024-08-17T02:30:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33708.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33978.log.gz 2024-08-17T02:30:18.496 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.31173.log.gz 2024-08-17T02:30:18.496 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:30:18.496 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3%/var/log/ceph/ceph-client.admin.34483.log: -- replaced with /var/log/ceph/ceph-client.admin.33708.log.gz 2024-08-17T02:30:18.496 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34159.log 2024-08-17T02:30:18.496 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34012.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34483.log.gz 2024-08-17T02:30:18.496 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34635.log 2024-08-17T02:30:18.496 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34012.log.gz 2024-08-17T02:30:18.496 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34581.log 2024-08-17T02:30:18.497 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34159.log: /var/log/ceph/ceph-client.admin.34635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31583.log 2024-08-17T02:30:18.497 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34159.log.gz 2024-08-17T02:30:18.497 INFO:teuthology.orchestra.run.smithi019.stderr: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:30:18.497 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29763.log 2024-08-17T02:30:18.497 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34581.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34635.log.gz 2024-08-17T02:30:18.497 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30951.log 2024-08-17T02:30:18.497 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31583.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34581.log.gz 2024-08-17T02:30:18.497 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31583.log.gz 2024-08-17T02:30:18.498 INFO:teuthology.orchestra.run.smithi019.stderr:--verbose -- /var/log/ceph/ceph-client.admin.32752.log /var/log/ceph/ceph-client.admin.29763.log: 2024-08-17T02:30:18.498 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35094.log 2024-08-17T02:30:18.498 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29763.log.gz 2024-08-17T02:30:18.498 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:30:18.498 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30951.log.gz 2024-08-17T02:30:18.498 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32752.log: gzip /var/log/ceph/ceph-client.admin.35094.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30191.log 2024-08-17T02:30:18.498 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32752.log.gz 2024-08-17T02:30:18.498 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32644.log 2024-08-17T02:30:18.499 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.0.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35094.log.gz 2024-08-17T02:30:18.499 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30897.log 2024-08-17T02:30:18.499 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30191.log: /var/log/ceph/ceph-client.admin.32644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34526.log 2024-08-17T02:30:18.499 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30191.log.gz 2024-08-17T02:30:18.499 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32644.log.gz 2024-08-17T02:30:18.499 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31745.log 2024-08-17T02:30:18.499 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29973.log 2024-08-17T02:30:18.499 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34526.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30897.log.gz-5 2024-08-17T02:30:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:--verbose -- /var/log/ceph/ceph-client.admin.30192.log 2024-08-17T02:30:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31745.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34526.log.gz 2024-08-17T02:30:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33789.log 2024-08-17T02:30:18.500 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31745.log.gz 2024-08-17T02:30:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30192.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29973.log.gz 2024-08-17T02:30:18.500 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30192.log.gz 2024-08-17T02:30:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33654.log 2024-08-17T02:30:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29599.log 2024-08-17T02:30:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34959.log 2024-08-17T02:30:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33654.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33789.log.gz 2024-08-17T02:30:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31936.log 2024-08-17T02:30:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29599.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33654.log.gz 2024-08-17T02:30:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31061.log 2024-08-17T02:30:18.501 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29599.log.gz 2024-08-17T02:30:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34905.log 2024-08-17T02:30:18.501 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34959.log.gz 2024-08-17T02:30:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31061.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31936.log.gz 2024-08-17T02:30:18.502 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31061.log.gz 2024-08-17T02:30:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-08-17T02:30:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34932.log 2024-08-17T02:30:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35013.log 2024-08-17T02:30:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33951.log: /var/log/ceph/ceph-client.admin.34932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30843.log 2024-08-17T02:30:18.502 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34905.log.gz 2024-08-17T02:30:18.502 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz 2024-08-17T02:30:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31909.log 2024-08-17T02:30:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35013.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34932.log.gz 2024-08-17T02:30:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30388.log 2024-08-17T02:30:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30843.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35013.log.gz 2024-08-17T02:30:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35067.log 2024-08-17T02:30:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31909.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30843.log.gz 2024-08-17T02:30:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31361.log 2024-08-17T02:30:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30388.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31909.log.gz 2024-08-17T02:30:18.504 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34186.log 2024-08-17T02:30:18.504 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30388.log.gz 2024-08-17T02:30:18.504 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35067.log.gz 2024-08-17T02:30:18.504 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29655.log 2024-08-17T02:30:18.504 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31664.log 2024-08-17T02:30:18.504 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34186.log: /var/log/ceph/ceph-client.admin.29655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32590.log 2024-08-17T02:30:18.504 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31361.log.gz 2024-08-17T02:30:18.504 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34186.log.gz 2024-08-17T02:30:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29337.log 2024-08-17T02:30:18.505 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29655.log.gz 2024-08-17T02:30:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31664.log.gz-5 2024-08-17T02:30:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:--verbose -- /var/log/ceph/ceph-client.admin.33277.log 2024-08-17T02:30:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32590.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:30:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29337.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32590.log.gz 2024-08-17T02:30:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33843.log 2024-08-17T02:30:18.505 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29337.log.gz 2024-08-17T02:30:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32139.log 2024-08-17T02:30:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.3.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33277.log.gz 2024-08-17T02:30:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29246.log 2024-08-17T02:30:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34851.log 2024-08-17T02:30:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32139.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33843.log.gz 2024-08-17T02:30:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29246.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32139.log.gz 2024-08-17T02:30:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34294.log 2024-08-17T02:30:18.506 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29246.log.gz 2024-08-17T02:30:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34851.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34851.log.gz 2024-08-17T02:30:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34878.log 2024-08-17T02:30:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32415.log 2024-08-17T02:30:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34294.log: /var/log/ceph/ceph-client.admin.34878.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34294.log.gz 2024-08-17T02:30:18.507 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34878.log.gz 2024-08-17T02:30:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31610.log 2024-08-17T02:30:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30408.log 2024-08-17T02:30:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32415.log: /var/log/ceph/ceph-client.admin.31610.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32415.log.gz 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31610.log.gz 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31772.log 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33091.log 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30408.log: /var/log/ceph/ceph-client.admin.31772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33681.log 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30408.log.gz 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4%/var/log/ceph/ceph-client.admin.33091.log: -- replaced with /var/log/ceph/ceph-client.admin.31772.log.gz 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33199.log 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33681.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33091.log.gz 2024-08-17T02:30:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.2.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33681.log.gz 2024-08-17T02:30:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30396.log 2024-08-17T02:30:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33199.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33199.log.gz 2024-08-17T02:30:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30396.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30396.log.gz 2024-08-17T02:30:18.509 INFO:teuthology.orchestra.run.smithi119.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:30:18.510 INFO:teuthology.orchestra.run.smithi119.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:30:18.563 INFO:teuthology.orchestra.run.smithi119.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:30:18.585 INFO:teuthology.orchestra.run.smithi119.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:30:18.594 INFO:teuthology.orchestra.run.smithi119.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:30:18.601 INFO:teuthology.orchestra.run.smithi019.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:30:18.628 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:30:18.629 INFO:teuthology.orchestra.run.smithi119.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:30:18.630 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-08-17T02:30:18.631 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m0.263s 2024-08-17T02:30:18.631 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m1.078s 2024-08-17T02:30:18.631 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.064s 2024-08-17T02:30:18.646 INFO:teuthology.orchestra.run.smithi019.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:30:18.657 INFO:teuthology.orchestra.run.smithi019.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:30:18.666 INFO:teuthology.orchestra.run.smithi019.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:30:18.667 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-08-17T02:30:18.668 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m0.302s 2024-08-17T02:30:18.668 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m1.158s 2024-08-17T02:30:18.668 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.138s 2024-08-17T02:30:18.668 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:30:18.668 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250/remote/smithi019/log 2024-08-17T02:30:18.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:30:19.031 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250/remote/smithi119/log 2024-08-17T02:30:19.032 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:30:19.190 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:30:19.207 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:30:19.208 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:30:19.210 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:30:19.275 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:30:19.284 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:30:19.284 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:30:19.287 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:30:19.309 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:30:19.309 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-08-17T02:30:19.309 INFO:teuthology.orchestra.run.smithi119.stdout:*hv01.front.sepi 67.205.162.81 3 u 51 64 177 0.064 -0.200 0.156 2024-08-17T02:30:19.309 INFO:teuthology.orchestra.run.smithi119.stdout:+hv02.front.sepi 63.231.80.2 3 u 46 64 177 0.104 -0.077 0.211 2024-08-17T02:30:19.309 INFO:teuthology.orchestra.run.smithi119.stdout:+hv03.front.sepi 74.6.168.72 3 u 43 64 177 0.078 -0.433 0.162 2024-08-17T02:30:19.309 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:30:19.310 INFO:teuthology.orchestra.run.smithi019.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:30:19.310 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================== 2024-08-17T02:30:19.310 INFO:teuthology.orchestra.run.smithi019.stdout:+hv01.front.sepi 67.205.162.81 3 u 47 64 177 0.162 0.789 0.794 2024-08-17T02:30:19.310 INFO:teuthology.orchestra.run.smithi019.stdout:+hv02.front.sepi 63.231.80.2 3 u 53 64 177 0.080 0.855 1.040 2024-08-17T02:30:19.311 INFO:teuthology.orchestra.run.smithi019.stdout:*hv03.front.sepi 74.6.168.72 3 u 53 64 177 0.140 0.588 1.033 2024-08-17T02:30:19.311 INFO:teuthology.orchestra.run.smithi019.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:30:19.312 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:30:19.320 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:30:19.321 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:30:19.329 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:30:19.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:30:19.346 INFO:teuthology.task.internal:Duration was 789.132597 seconds 2024-08-17T02:30:19.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:30:19.354 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:30:19.355 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:30:19.357 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:30:19.409 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:30:19.410 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-08-17T02:30:19.410 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:30:19.424 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-08-17T02:30:19.424 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:30:19.438 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:30:19.438 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:30:19.440 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:30:19.476 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:30:19.477 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:30:19.519 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:30:19.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:30:19.606 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:30:19.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:30:19.623 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:30:19.640 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:30:19.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:19.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:19.666 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-08-17T02:30:19.667 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-08-17T02:30:19.683 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:19.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:19.731 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:19.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:19.737 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:30:19.747 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:30:19.747 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250/remote/smithi019 2024-08-17T02:30:19.748 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:30:19.773 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858250/remote/smithi119 2024-08-17T02:30:19.774 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:30:19.804 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:30:19.804 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:30:19.806 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:30:19.812 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:30:19.823 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:30:19.823 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:30:19.833 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:30:19.833 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:30:19.855 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:30:19.860 INFO:teuthology.orchestra.run.smithi019.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:30 /home/ubuntu/cephtest 2024-08-17T02:30:19.863 INFO:teuthology.orchestra.run.smithi119.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:30 /home/ubuntu/cephtest 2024-08-17T02:30:19.865 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:30:19.876 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:30:19.897 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 789.1325972080231 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ada7c5437c3e47f391ba58c7d0ed06c5 status: fail success: false 2024-08-17T02:30:19.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:30:19.976 INFO:teuthology.run:FAIL